Sep 28 17:00:14 devstack cinder-volume[75924]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 17:00:14 devstack cinder-volume[75924]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 17:00:14 devstack cinder-volume[75924]: we strongly recommend against using it for new projects. Sep 28 17:00:14 devstack cinder-volume[75924]: If you are already using Eventlet, we recommend migrating to a different Sep 28 17:00:14 devstack cinder-volume[75924]: framework. For more detail see Sep 28 17:00:14 devstack cinder-volume[75924]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 17:00:14 devstack cinder-volume[75924]: import eventlet # noqa Sep 28 17:00:18 devstack cinder-volume[75924]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75924) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:00:18 devstack cinder-volume[75924]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75924) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:00:18 devstack cinder-volume[75924]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75924) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:00:19 devstack cinder-volume[75924]: INFO dbcounter [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] Registered counter for database cinder Sep 28 17:00:19 devstack cinder-volume[75924]: DEBUG oslo_db.sqlalchemy.engines [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75924) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:00:19 devstack cinder-volume[75924]: DEBUG dbcounter [-] [75924] Writer thread running {{(pid=75924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:00:19 devstack cinder-volume[75924]: INFO cinder.rpc [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 17:00:19 devstack cinder-volume[75924]: INFO cinder.rpc [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 17:00:19 devstack cinder-volume[75924]: DEBUG oslo_db.sqlalchemy.engines [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75924) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:00:19 devstack cinder-volume[75924]: INFO cinder.volume.manager [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] Determined volume DB was empty at startup. Sep 28 17:00:19 devstack cinder-volume[75924]: DEBUG cinder.volume.manager [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75924) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 17:00:19 devstack cinder-volume[75924]: INFO cinder.volume.manager [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 17:00:19 devstack cinder-volume[75924]: WARNING stevedore.named [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 17:00:19 devstack cinder-volume[75924]: WARNING castellan.key_manager [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:00:19 devstack cinder-volume[75924]: WARNING cinder.keymgr.conf_key_mgr [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:00:19 devstack cinder-volume[75924]: DEBUG cinder.volume.drivers.lvm [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75924) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 28 17:00:19 devstack cinder-volume[75924]: DEBUG oslo_concurrency.processutils [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_concurrency.processutils [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] CMD "cinder-rtstool verify" returned: 0 in 0.544s {{(pid=75924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_db.sqlalchemy.engines [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75924) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:00:20 devstack cinder-volume[75924]: INFO cinder.rpc [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 28 17:00:20 devstack cinder-volume[75924]: INFO cinder.rpc [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 28 17:00:20 devstack cinder-volume[75924]: WARNING stevedore.named [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 17:00:20 devstack cinder-volume[75924]: WARNING castellan.key_manager [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:00:20 devstack cinder-volume[75924]: INFO cinder.volume.manager [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_db.sqlalchemy.engines [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75924) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:00:20 devstack cinder-volume[75924]: INFO oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] Starting 1 workers Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] Started child 76274 {{(pid=75924) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] Full set of CONF: {{(pid=75924) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] ******************************************************************************** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] Configuration options gathered from: {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] ================================================================================ {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 17:00:20 devstack cinder-volume[76274]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] allow_availability_zone_fallback = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] allow_compression_on_image_upload = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] allowed_direct_url_schemes = [] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] api_rate_limit = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] auth_strategy = keystone {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] az_cache_duration = 3600 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_availability_zone = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_host = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_name = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_stats_polling_interval = 60 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backup_api_class = cinder.backup.api.API {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backup_name_template = backup-%s {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backup_use_same_host = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backup_use_temp_snapshot = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] chap_password = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] chap_username = {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cinder_internal_tenant_project_id = 7c3b82ea58834ecea83776cfec35a8bb {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cinder_internal_tenant_user_id = aaac8a54c6c44a38b9088e4ea3aa66df {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cloned_volume_same_az = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cluster = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] compression_format = gzip {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] compute_api_class = cinder.compute.nova.API {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] config_dir = [] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] config_source = [] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] control_exchange = openstack {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] debug = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] default_availability_zone = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] default_group_type = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] default_volume_type = lvmdriver-1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] disk_geometry = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] driver_client_cert = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] driver_client_cert_key = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] driver_data_namespace = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] driver_ssl_cert_path = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] driver_ssl_cert_verify = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] driver_use_ssl = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] enable_force_upload = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] enable_new_services = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] enable_unsupported_driver = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] enforce_multipath_for_image_xfer = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] filter_function = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] glance_api_insecure = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] glance_api_servers = ['http://192.168.122.38/image'] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] glance_api_ssl_compression = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] glance_ca_certificates_file = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] glance_catalog_info = image:glance:publicURL {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] glance_certfile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] glance_keyfile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] glance_num_retries = 3 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] glance_request_timeout = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] goodness_function = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] graceful_shutdown_timeout = 5 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] group_api_class = cinder.group.api.API {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] host = devstack {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] image_compress_on_upload = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] image_conversion_address_space_limit = 1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] image_conversion_cpu_limit = 60 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] image_conversion_disable = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] image_introspection_address_space_limit = 1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] image_introspection_cpu_limit = 60 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] image_upload_use_cinder_backend = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] image_upload_use_internal_tenant = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] image_volume_cache_enabled = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] image_volume_cache_max_count = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] image_volume_cache_max_size_gb = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] init_host_max_objects_retrieval = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] instance_format = [instance: %(uuid)s] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] iscsi_target_flags = {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] iscsi_write_cache = on {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] iser_helper = tgtadm {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] iser_ip_address = 192.168.122.38 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] iser_port = 3260 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] log_color = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] log_config_append = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] log_dir = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] log_file = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] log_options = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] log_rotate_interval = 1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] log_rotate_interval_type = days {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] log_rotation_type = none {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] max_age = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] max_logfile_count = 30 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] max_logfile_size_mb = 200 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] max_over_subscription_ratio = 20.0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] message_reap_interval = 86400 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] message_ttl = 2592000 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] migration_create_volume_timeout_secs = 300 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] monkey_patch = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] monkey_patch_modules = [] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] my_ip = 192.168.122.38 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] no_snapshot_gb_quota = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] num_iser_scan_tries = 3 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] num_shell_tries = 3 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] num_volume_device_scan_tries = 3 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] nvmeof_conn_info_version = 1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] nvmet_ns_id = 10 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] nvmet_port_id = 1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] osapi_max_limit = 1000 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] osapi_volume_ext_list = [] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] osapi_volume_listen_port = 8776 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] osapi_volume_use_ssl = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] osapi_volume_workers = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] per_volume_size_limit = -1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] periodic_fuzzy_delay = 60 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] periodic_interval = 60 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] public_endpoint = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] publish_errors = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] quota_backup_gigabytes = 1000 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] quota_backups = 10 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] quota_gigabytes = 1000 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] quota_groups = 10 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] quota_snapshots = 10 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] quota_volumes = 10 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] rate_limit_burst = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] rate_limit_except_level = CRITICAL {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] rate_limit_interval = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] reinit_driver_count = 3 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] replication_device = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] report_discard_supported = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] report_interval = 120 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] reservation_clean_interval = 86400 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] reservation_expire = 86400 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] reserved_image_namespaces = [] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] reserved_percentage = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[76274]: INFO cinder.volume.manager [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] rpc_response_timeout = 120 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] run_external_periodic_tasks = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] scst_target_driver = iscsi {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] scst_target_iqn_name = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] service_down_time = 720 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] shell_completion = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] snapshot_name_template = snapshot-%s {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] snapshot_same_host = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] split_loggers = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] state_path = /opt/stack/data/cinder {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] storage_availability_zone = nova {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] storage_protocol = iSCSI {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] syslog_log_facility = LOG_USER {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] target_helper = lioadm {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] target_ip_address = 192.168.122.38 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] target_port = 3260 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] target_protocol = iscsi {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] target_secondary_ip_addresses = [] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] trace_flags = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] transport_url = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] until_refresh = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] use_chap_auth = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] use_default_quota_class = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] use_journal = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] use_json = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] use_multipath_for_image_xfer = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] use_stderr = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] use_syslog = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] verify_glance_signatures = enabled {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] volume_api_class = cinder.volume.api.API {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] volume_backend_name = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] volume_clear = zero {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] volume_clear_ionice = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] volume_clear_size = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] volume_copy_bps_limit = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] volume_dd_blocksize = 1M {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] volume_name_template = volume-%s {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] volume_service_inithost_offload = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] volume_usage_audit_period = month {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] zoning_mode = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_concurrency.disable_process_locking = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.auth_section = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.auth_type = password {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.auth_version = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.cache = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.certfile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.include_service_catalog = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.insecure = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.interface = public {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.keyfile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.memcache_password = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.memcache_username = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.region_name = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.service_type = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.38/identity {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.backend = dogpile.cache.null {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.backend_argument = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.backend_expiration_time = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.config_prefix = cache.oslo {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.debug_cache_backend = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.enable_retry_client = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.enable_socket_keepalive = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.enabled = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.expiration_time = 600 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.hashclient_retry_attempts = 2 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.memcache_dead_retry = 300 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.memcache_pool_maxsize = 10 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.memcache_sasl_enabled = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.password = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.proxies = [] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.redis_db = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.redis_server = localhost:6379 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.retry_attempts = 2 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.retry_delay = 0.0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.socket_keepalive_count = 1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.socket_keepalive_idle = 1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.socket_keepalive_interval = 1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.socket_timeout = 1.0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.tls_allowed_ciphers = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.tls_cafile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.tls_certfile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.tls_enabled = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.tls_keyfile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cache.username = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] coordination.backend_url = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] database.asyncio_connection = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] database.asyncio_slave_connection = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] database.backend = sqlalchemy {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] database.connection = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] database.connection_debug = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] database.connection_parameters = {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] database.connection_recycle_time = 3600 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] database.connection_trace = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] database.db_inc_retry_interval = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] database.db_max_retries = 20 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] database.db_max_retry_interval = 10 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] database.db_retry_interval = 1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] database.max_overflow = 50 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] database.max_pool_size = 5 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] database.max_retries = 10 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] database.mysql_wsrep_sync_wait = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] database.pool_timeout = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] database.retry_interval = 10 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] database.slave_connection = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] database.sqlite_synchronous = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] database.synchronous_reader = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] database.use_db_reconnect = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_tracing.insecure = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] profiler.connection_string = messaging:// {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] profiler.enabled = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] profiler.es_doc_type = notification {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] profiler.es_scroll_size = 10000 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] profiler.es_scroll_time = 2m {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] profiler.filter_error_trace = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] profiler.hmac_keys = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] profiler.sentinel_service_name = mymaster {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] profiler.socket_timeout = 0.1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] profiler.trace_requests = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] profiler.trace_sqlalchemy = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] profiler_jaeger.process_tags = {} {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] profiler_jaeger.service_name_prefix = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] profiler_otlp.service_name_prefix = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_policy.enforce_new_defaults = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_policy.policy_default_rule = default {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_policy.policy_file = policy.yaml {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] privsep_osbrick.group = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] privsep_osbrick.helper_command = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] privsep_osbrick.user = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cinder_sys_admin.group = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cinder_sys_admin.helper_command = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] cinder_sys_admin.user = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] service_user.auth_section = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] service_user.auth_type = password {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] service_user.cafile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] service_user.certfile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] service_user.collect_timing = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] service_user.insecure = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] service_user.keyfile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] service_user.send_service_user_token = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] service_user.split_loggers = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] service_user.timeout = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] service_user.tls_ciphers = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] service_user.tls_min_version = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] glance.auth_section = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] glance.auth_type = password {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] glance.certfile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] glance.collect_timing = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] glance.insecure = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] glance.keyfile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] glance.region_name = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] glance.split_loggers = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] glance.timeout = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] glance.tls_ciphers = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] glance.tls_min_version = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.backend_availability_zone = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.chap_password = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.chap_username = {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.disk_geometry = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.driver_client_cert = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.driver_client_cert_key = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.driver_data_namespace = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.driver_use_ssl = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.extra_capabilities = {} {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.filter_function = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.goodness_function = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.iscsi_target_flags = {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.iscsi_write_cache = on {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.iser_helper = tgtadm {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.iser_ip_address = 192.168.122.38 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.iser_port = 3260 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack sudo[76302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.lvm_share_target = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.lvm_type = auto {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack sudo[76302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.num_shell_tries = 3 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.replication_device = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.report_discard_supported = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.reserved_percentage = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.target_helper = tgtadm {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.target_ip_address = 192.168.122.38 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.target_port = 3260 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.target_protocol = iscsi {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.trace_flags = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.unique_fqdn_network = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.use_chap_auth = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.volume_backend_name = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.volume_clear = zero {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.volume_clear_ionice = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.volume_clear_size = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_reports.file_event_handler = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_reports.log_dir = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.backend_host = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.chap_password = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.chap_username = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.disk_geometry = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.driver_client_cert = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.extra_capabilities = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.filter_function = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.goodness_function = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.iser_helper = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.iser_ip_address = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.iser_port = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.lvm_share_target = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.lvm_type = auto {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.num_shell_tries = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.replication_device = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.report_discard_supported = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.reserved_percentage = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.scst_target_driver = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.storage_protocol = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.target_helper = lioadm {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.target_ip_address = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.target_port = 3260 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.trace_flags = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.use_chap_auth = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.volume_clear = zero {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.volume_clear_size = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] lvmdriver-1.volumes_dir = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.ssl = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_notifications.driver = [] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_notifications.retry = -1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] key_manager.fixed_key = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] barbican.barbican_api_version = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] barbican.barbican_endpoint = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] barbican.barbican_endpoint_type = public {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] barbican.barbican_region_name = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] barbican.cafile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] barbican.certfile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] barbican.collect_timing = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] barbican.insecure = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] barbican.keyfile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] barbican.number_of_retries = 60 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] barbican.retry_delay = 1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] barbican.send_service_user_token = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] barbican.split_loggers = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] barbican.timeout = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] barbican.tls_ciphers = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] barbican.tls_min_version = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] barbican.verify_ssl = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] barbican.verify_ssl_path = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] barbican_service_user.auth_section = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] barbican_service_user.auth_type = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] barbican_service_user.cafile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] barbican_service_user.certfile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] barbican_service_user.collect_timing = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] barbican_service_user.insecure = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] barbican_service_user.keyfile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] barbican_service_user.split_loggers = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] barbican_service_user.timeout = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] barbican_service_user.tls_ciphers = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] barbican_service_user.tls_min_version = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] vault.approle_role_id = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] vault.approle_secret_id = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] vault.auth_method = approle {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] vault.auth_path = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] vault.kv_mountpoint = secret {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] vault.kv_path = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] vault.kv_version = 2 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] vault.namespace = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] vault.root_token_id = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] vault.ssl_ca_crt_file = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] vault.timeout = 60.0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] vault.token_file = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] vault.token_role = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] vault.use_ssl = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:21 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] ******************************************************************************** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 17:00:21 devstack sudo[76302]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:21 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:21 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:21 devstack sudo[76366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:00:21 devstack sudo[76366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:21 devstack sudo[76366]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:21 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.334s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:21 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:00:21 devstack cinder-volume[76274]: INFO cinder.brick.local_dev.lvm [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 28 17:00:21 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:21 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:21 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:21 devstack sudo[76456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:00:21 devstack sudo[76456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:21 devstack sudo[76456]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:21 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.307s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:21 devstack cinder-volume[76274]: DEBUG cinder.brick.local_dev.lvm [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76274) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 28 17:00:21 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:21 devstack sudo[76541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:00:21 devstack sudo[76541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:23 devstack sudo[76541]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:23 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.581s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:23 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:23 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:23 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:23 devstack sudo[76793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:00:23 devstack sudo[76793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:23 devstack sudo[76793]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:23 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.357s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:23 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:23 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:23 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:23 devstack sudo[76837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 28 17:00:23 devstack sudo[76837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:24 devstack sudo[76837]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:24 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.317s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:24 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:24 devstack sudo[76846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:00:24 devstack sudo[76846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:24 devstack sudo[76846]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:24 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.383s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:24 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:24 devstack sudo[76853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:00:24 devstack sudo[76853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:24 devstack sudo[76853]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:24 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:24 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:24 devstack sudo[76856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:00:24 devstack sudo[76856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:25 devstack sudo[76856]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:25 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:25 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:25 devstack sudo[76859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:00:25 devstack sudo[76859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:25 devstack sudo[76859]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:25 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.284s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:25 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:25 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:25 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:25 devstack sudo[76863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:00:25 devstack sudo[76863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:25 devstack sudo[76863]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:25 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.295s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:25 devstack cinder-volume[76274]: INFO cinder.volume.drivers.lvm [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 28 17:00:25 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:25 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:25 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:25 devstack sudo[76867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:00:25 devstack sudo[76867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:26 devstack sudo[76867]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:26 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.327s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:26 devstack cinder-volume[76274]: DEBUG cinder.volume.drivers.lvm [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Updating volume stats {{(pid=76274) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 17:00:26 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:26 devstack sudo[76871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:00:26 devstack sudo[76871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:26 devstack sudo[76871]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:26 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.346s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:26 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:26 devstack sudo[76875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:00:26 devstack sudo[76875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:26 devstack sudo[76875]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:26 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.314s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:26 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:26 devstack sudo[76878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:00:26 devstack sudo[76878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:27 devstack sudo[76878]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:27 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.301s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:27 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:27 devstack sudo[76881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:00:27 devstack sudo[76881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:27 devstack sudo[76881]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:27 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.330s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:27 devstack cinder-volume[76274]: INFO cinder.volume.driver [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 17:00:27 devstack cinder-volume[76274]: DEBUG cinder.volume.driver [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76274) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 17:00:27 devstack cinder-volume[76274]: DEBUG oslo_db.sqlalchemy.engines [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76274) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:00:27 devstack cinder-volume[76274]: DEBUG dbcounter [-] [76274] Writer thread running {{(pid=76274) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:00:27 devstack cinder-volume[76274]: DEBUG cinder.db.api [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Building query based on filter {{(pid=76274) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 17:00:27 devstack cinder-volume[76274]: DEBUG cinder.image.image_utils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76274) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 17:00:27 devstack cinder-volume[76274]: INFO cinder.keymgr.migration [None req-3a40eab0-c1dd-4abd-aee0-dedc490c6043 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 17:00:27 devstack cinder-volume[76274]: DEBUG cinder.volume.drivers.lvm [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Updating volume stats {{(pid=76274) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 17:00:27 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:27 devstack sudo[76889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:00:27 devstack sudo[76889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:28 devstack sudo[76889]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:28 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.317s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:28 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:28 devstack sudo[76893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:00:28 devstack sudo[76893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:28 devstack sudo[76893]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:28 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:28 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:28 devstack sudo[76896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:00:28 devstack sudo[76896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:28 devstack sudo[76896]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:28 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.300s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:28 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:28 devstack sudo[76899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:00:28 devstack sudo[76899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:28 devstack sudo[76899]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:28 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.318s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:28 devstack cinder-volume[76274]: DEBUG cinder.manager [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Notifying Schedulers of capabilities ... {{(pid=76274) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:00:29 devstack cinder-volume[76274]: INFO cinder.volume.manager [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Driver initialization completed successfully. Sep 28 17:00:29 devstack cinder-volume[76274]: INFO cinder.manager [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Initiating service 2 cleanup Sep 28 17:00:29 devstack cinder-volume[76274]: INFO cinder.manager [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Service 2 cleanup completed. Sep 28 17:00:29 devstack cinder-volume[76274]: DEBUG cinder.service [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Creating RPC server for service cinder-volume {{(pid=76274) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 17:00:29 devstack cinder-volume[76274]: DEBUG cinder.service [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76274) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 17:00:29 devstack cinder-volume[76274]: INFO cinder.volume.manager [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 28 17:00:29 devstack cinder-volume[76274]: DEBUG cinder.volume.drivers.lvm [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Updating volume stats {{(pid=76274) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 17:00:29 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:29 devstack sudo[76902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:00:29 devstack sudo[76902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:29 devstack sudo[76902]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:29 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:29 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:29 devstack sudo[76907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:00:29 devstack sudo[76907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:29 devstack sudo[76907]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:29 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:29 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:29 devstack sudo[76914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:00:29 devstack sudo[76914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:30 devstack sudo[76914]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:30 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.446s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:30 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:30 devstack sudo[76956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:00:30 devstack sudo[76956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:30 devstack sudo[76956]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:30 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.325s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:30 devstack cinder-volume[76274]: INFO cinder.volume.manager [None req-1fc9f74b-a768-42d2-80f5-d31623163dd5 None None] Driver post RPC initialization completed successfully. Sep 28 17:00:30 devstack cinder-volume[75924]: DEBUG dbcounter [-] [75924] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:00:39 devstack cinder-volume[76274]: DEBUG dbcounter [-] [76274] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76274) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:00:40 devstack cinder-volume[76274]: DEBUG dbcounter [-] [76274] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=76274) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:01:13 devstack cinder-volume[76274]: DEBUG oslo_service.periodic_task [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] Running periodic task VolumeManager._thread_info {{(pid=76274) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:01:13 devstack cinder-volume[76274]: DEBUG cinder.volume.manager [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] thread count: 6 {{(pid=76274) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:01:13 devstack cinder-volume[76274]: DEBUG cinder.volume.manager [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] thread info: [<_MainThread(MainThread, started 124038637736064)>, , , , , ] {{(pid=76274) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:02:13 devstack cinder-volume[76274]: DEBUG oslo_service.periodic_task [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76274) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:02:13 devstack cinder-volume[76274]: DEBUG cinder.volume.drivers.lvm [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] Updating volume stats {{(pid=76274) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 17:02:13 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:13 devstack sudo[81999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:02:13 devstack sudo[81999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:13 devstack sudo[81999]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:13 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:13 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:13 devstack sudo[82002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:02:13 devstack sudo[82002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:14 devstack sudo[82002]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:14 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:14 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:14 devstack sudo[82005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:02:14 devstack sudo[82005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:14 devstack sudo[82005]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:14 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.332s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:14 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:14 devstack sudo[82024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:02:14 devstack sudo[82024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:14 devstack sudo[82024]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:14 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:14 devstack cinder-volume[76274]: DEBUG cinder.manager [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] Notifying Schedulers of capabilities ... {{(pid=76274) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:02:14 devstack cinder-volume[76274]: DEBUG oslo_service.periodic_task [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] Running periodic task VolumeManager._thread_info {{(pid=76274) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:02:14 devstack cinder-volume[76274]: DEBUG cinder.volume.manager [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] thread count: 6 {{(pid=76274) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:02:14 devstack cinder-volume[76274]: DEBUG cinder.volume.manager [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] thread info: [<_MainThread(MainThread, started 124038637736064)>, , , , , ] {{(pid=76274) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:02:40 devstack cinder-volume[76274]: DEBUG dbcounter [-] [76274] Writing DB stats cinder:SELECT=1 {{(pid=76274) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:02:40 devstack cinder-volume[76274]: DEBUG dbcounter [-] [76274] Writing DB stats cinder:UPDATE=1 {{(pid=76274) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:03:13 devstack cinder-volume[76274]: DEBUG oslo_service.periodic_task [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76274) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:03:13 devstack cinder-volume[76274]: DEBUG cinder.volume.drivers.lvm [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] Updating volume stats {{(pid=76274) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 17:03:13 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:13 devstack sudo[83105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:03:13 devstack sudo[83105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:13 devstack sudo[83105]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:13 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.401s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:13 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:13 devstack sudo[83133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:03:13 devstack sudo[83133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:14 devstack sudo[83133]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:14 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:14 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:14 devstack sudo[83153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:03:14 devstack sudo[83153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:14 devstack sudo[83153]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:14 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.343s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:14 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:14 devstack sudo[83195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:03:14 devstack sudo[83195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:14 devstack sudo[83195]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:14 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.334s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:14 devstack cinder-volume[76274]: DEBUG cinder.manager [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] Notifying Schedulers of capabilities ... {{(pid=76274) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:04:13 devstack cinder-volume[76274]: DEBUG oslo_service.periodic_task [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76274) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:04:13 devstack cinder-volume[76274]: DEBUG cinder.volume.drivers.lvm [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] Updating volume stats {{(pid=76274) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 17:04:13 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:13 devstack sudo[84571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:04:13 devstack sudo[84571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:13 devstack sudo[84571]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:13 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.366s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:13 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:13 devstack sudo[84590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:04:13 devstack sudo[84590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:14 devstack sudo[84590]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:14 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:14 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:14 devstack sudo[84593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:04:14 devstack sudo[84593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:14 devstack sudo[84593]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:14 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.335s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:14 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:14 devstack sudo[84596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:04:14 devstack sudo[84596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:14 devstack sudo[84596]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:14 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.357s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:14 devstack cinder-volume[76274]: DEBUG cinder.manager [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] Notifying Schedulers of capabilities ... {{(pid=76274) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:04:14 devstack cinder-volume[76274]: DEBUG oslo_service.periodic_task [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] Running periodic task VolumeManager._thread_info {{(pid=76274) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:04:14 devstack cinder-volume[76274]: DEBUG cinder.volume.manager [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] thread count: 6 {{(pid=76274) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:04:14 devstack cinder-volume[76274]: DEBUG cinder.volume.manager [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] thread info: [<_MainThread(MainThread, started 124038637736064)>, , , , , ] {{(pid=76274) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:04:40 devstack cinder-volume[76274]: DEBUG dbcounter [-] [76274] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76274) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:05:13 devstack cinder-volume[76274]: DEBUG oslo_service.periodic_task [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76274) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:05:13 devstack cinder-volume[76274]: DEBUG cinder.volume.drivers.lvm [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] Updating volume stats {{(pid=76274) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 17:05:13 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:13 devstack sudo[85485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:05:13 devstack sudo[85485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:13 devstack sudo[85485]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:13 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.338s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:13 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:13 devstack sudo[85498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:05:13 devstack sudo[85498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:14 devstack sudo[85498]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:14 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.326s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:14 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:14 devstack sudo[85514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:05:14 devstack sudo[85514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:14 devstack sudo[85514]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:14 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.329s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:14 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:14 devstack sudo[85517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:05:14 devstack sudo[85517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:14 devstack sudo[85517]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:14 devstack cinder-volume[76274]: DEBUG oslo_concurrency.processutils [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.326s {{(pid=76274) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:14 devstack cinder-volume[76274]: DEBUG cinder.manager [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] Notifying Schedulers of capabilities ... {{(pid=76274) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:05:14 devstack cinder-volume[76274]: DEBUG oslo_service.periodic_task [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] Running periodic task VolumeManager._thread_info {{(pid=76274) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:05:14 devstack cinder-volume[76274]: DEBUG cinder.volume.manager [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] thread count: 6 {{(pid=76274) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:05:14 devstack cinder-volume[76274]: DEBUG cinder.volume.manager [None req-bff2c67b-1250-49b6-a8fa-9dd7d4de8ff9 None None] thread info: [<_MainThread(MainThread, started 124038637736064)>, , , , , ] {{(pid=76274) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:05:43 devstack cinder-volume[75924]: INFO oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] Caught SIGTERM, stopping children Sep 28 17:05:43 devstack cinder-volume[75924]: DEBUG oslo_concurrency.lockutils [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] Acquiring lock "singleton_lock" {{(pid=75924) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:05:43 devstack cinder-volume[75924]: DEBUG oslo_concurrency.lockutils [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] Acquired lock "singleton_lock" {{(pid=75924) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:05:43 devstack cinder-volume[75924]: DEBUG oslo_concurrency.lockutils [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] Releasing lock "singleton_lock" {{(pid=75924) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:05:43 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] Stop services. {{(pid=75924) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 17:05:43 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] Killing children. {{(pid=75924) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 17:05:43 devstack cinder-volume[75924]: INFO oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] Waiting on 1 children to exit Sep 28 17:05:44 devstack cinder-volume[76274]: DEBUG oslo_concurrency.lockutils [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] Acquiring lock "singleton_lock" {{(pid=76274) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:05:44 devstack cinder-volume[76274]: DEBUG oslo_concurrency.lockutils [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] Acquired lock "singleton_lock" {{(pid=76274) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:05:44 devstack cinder-volume[76274]: DEBUG oslo_concurrency.lockutils [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] Releasing lock "singleton_lock" {{(pid=76274) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:05:44 devstack cinder-volume[76274]: WARNING amqp [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 17:05:44 devstack cinder-volume[76274]: WARNING amqp [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 17:05:44 devstack cinder-volume[75924]: INFO oslo_service.backend._eventlet.service [None req-50751e51-665f-4f48-8434-6bf9e02376f2 None None] Child 76274 exited with status 0 Sep 28 17:05:44 devstack cinder-volume[86066]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 17:05:44 devstack cinder-volume[86066]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 17:05:44 devstack cinder-volume[86066]: we strongly recommend against using it for new projects. Sep 28 17:05:44 devstack cinder-volume[86066]: If you are already using Eventlet, we recommend migrating to a different Sep 28 17:05:44 devstack cinder-volume[86066]: framework. For more detail see Sep 28 17:05:44 devstack cinder-volume[86066]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 17:05:44 devstack cinder-volume[86066]: import eventlet # noqa Sep 28 17:05:47 devstack cinder-volume[86066]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86066) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:05:47 devstack cinder-volume[86066]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86066) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:05:47 devstack cinder-volume[86066]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86066) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:05:48 devstack cinder-volume[86066]: INFO dbcounter [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] Registered counter for database cinder Sep 28 17:05:48 devstack cinder-volume[86066]: DEBUG oslo_db.sqlalchemy.engines [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86066) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:05:48 devstack cinder-volume[86066]: DEBUG dbcounter [-] [86066] Writer thread running {{(pid=86066) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:05:48 devstack cinder-volume[86066]: INFO cinder.rpc [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 17:05:48 devstack cinder-volume[86066]: INFO cinder.rpc [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 17:05:48 devstack cinder-volume[86066]: DEBUG oslo_db.sqlalchemy.engines [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86066) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:05:48 devstack cinder-volume[86066]: INFO cinder.volume.manager [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] Determined volume DB was empty at startup. Sep 28 17:05:48 devstack cinder-volume[86066]: DEBUG cinder.volume.manager [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86066) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 17:05:48 devstack cinder-volume[86066]: INFO cinder.volume.manager [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 17:05:48 devstack cinder-volume[86066]: WARNING stevedore.named [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 17:05:48 devstack cinder-volume[86066]: WARNING castellan.key_manager [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:05:48 devstack cinder-volume[86066]: WARNING cinder.keymgr.conf_key_mgr [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:05:48 devstack cinder-volume[86066]: INFO cinder.volume.manager [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 17:05:48 devstack cinder-volume[86066]: DEBUG oslo_db.sqlalchemy.engines [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86066) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:05:49 devstack cinder-volume[86066]: INFO oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] Starting 1 workers Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] Started child 86285 {{(pid=86066) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] Full set of CONF: {{(pid=86066) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] ******************************************************************************** {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] Configuration options gathered from: {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 17:05:49 devstack cinder-volume[86285]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] ================================================================================ {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] allow_availability_zone_fallback = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] allow_compression_on_image_upload = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] allowed_direct_url_schemes = [] {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] api_rate_limit = True {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] auth_strategy = keystone {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_availability_zone = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_host = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_name = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_stats_polling_interval = 60 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backup_api_class = cinder.backup.api.API {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backup_name_template = backup-%s {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backup_use_same_host = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backup_use_temp_snapshot = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] chap_password = **** {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] chap_username = {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cinder_internal_tenant_project_id = 7c3b82ea58834ecea83776cfec35a8bb {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cinder_internal_tenant_user_id = aaac8a54c6c44a38b9088e4ea3aa66df {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cluster = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] compression_format = gzip {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] compute_api_class = cinder.compute.nova.API {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] config_dir = [] {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] config_source = [] {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] control_exchange = openstack {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] debug = True {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] default_availability_zone = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] default_group_type = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] default_volume_type = QuobyteHD {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] disk_geometry = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] driver_client_cert = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] driver_client_cert_key = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] driver_data_namespace = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] driver_ssl_cert_path = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] driver_ssl_cert_verify = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] driver_use_ssl = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] enable_new_services = True {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] enable_unsupported_driver = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] enabled_backends = ['QuobyteHD'] {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] enforce_multipath_for_image_xfer = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] filter_function = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] glance_api_insecure = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] glance_api_servers = ['http://192.168.122.38/image'] {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] glance_api_ssl_compression = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] glance_ca_certificates_file = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] glance_catalog_info = image:glance:publicURL {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] glance_certfile = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] glance_keyfile = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] glance_num_retries = 3 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] glance_request_timeout = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] goodness_function = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] graceful_shutdown_timeout = 5 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] group_api_class = cinder.group.api.API {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] host = devstack {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] image_compress_on_upload = True {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] image_conversion_address_space_limit = 1 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] image_conversion_cpu_limit = 60 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] image_conversion_disable = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] image_introspection_address_space_limit = 1 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] image_introspection_cpu_limit = 60 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] image_upload_use_cinder_backend = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] image_upload_use_internal_tenant = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] image_volume_cache_enabled = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] image_volume_cache_max_count = 0 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] image_volume_cache_max_size_gb = 0 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] init_host_max_objects_retrieval = 0 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] instance_format = [instance: %(uuid)s] {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] iscsi_target_flags = {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] iscsi_write_cache = on {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] iser_helper = tgtadm {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] iser_ip_address = 192.168.122.38 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] iser_port = 3260 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] log_color = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] log_config_append = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86285]: INFO cinder.volume.manager [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] log_dir = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] log_file = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] log_options = True {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] log_rotate_interval = 1 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] log_rotate_interval_type = days {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] log_rotation_type = none {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86285]: DEBUG cinder.volume.drivers.remotefs [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86285) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] max_age = 0 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] max_logfile_count = 30 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] max_logfile_size_mb = 200 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] max_over_subscription_ratio = 20.0 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] message_reap_interval = 86400 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] message_ttl = 2592000 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] migration_create_volume_timeout_secs = 300 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] monkey_patch = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] monkey_patch_modules = [] {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] my_ip = 192.168.122.38 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] no_snapshot_gb_quota = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] num_iser_scan_tries = 3 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] num_shell_tries = 3 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] num_volume_device_scan_tries = 3 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] nvmeof_conn_info_version = 1 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] nvmet_ns_id = 10 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] nvmet_port_id = 1 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] osapi_max_limit = 1000 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] osapi_volume_ext_list = [] {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] osapi_volume_listen_port = 8776 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] osapi_volume_use_ssl = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] osapi_volume_workers = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] per_volume_size_limit = -1 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] periodic_fuzzy_delay = 60 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] periodic_interval = 60 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] public_endpoint = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] publish_errors = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] quota_backup_gigabytes = 1000 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] quota_backups = 10 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] quota_gigabytes = 1000 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] quota_groups = 10 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] quota_snapshots = 10 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] quota_volumes = 10 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] rate_limit_burst = 0 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] rate_limit_except_level = CRITICAL {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] rate_limit_interval = 0 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] reinit_driver_count = 3 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] replication_device = **** {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] report_discard_supported = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] report_interval = 120 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] reservation_clean_interval = 86400 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] reservation_expire = 86400 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] reserved_image_namespaces = [] {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] reserved_percentage = 0 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] rpc_response_timeout = 120 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] run_external_periodic_tasks = True {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] scst_target_driver = iscsi {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] scst_target_iqn_name = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] service_down_time = 720 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] shell_completion = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] snapshot_name_template = snapshot-%s {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] split_loggers = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] state_path = /opt/stack/data/cinder {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] storage_availability_zone = nova {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] storage_protocol = iSCSI {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] syslog_log_facility = LOG_USER {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] target_helper = lioadm {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] target_ip_address = 192.168.122.38 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] target_port = 3260 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] target_protocol = iscsi {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] target_secondary_ip_addresses = [] {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] trace_flags = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] transport_url = **** {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] until_refresh = 0 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] use_chap_auth = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] use_default_quota_class = True {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] use_journal = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] use_json = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] use_multipath_for_image_xfer = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] use_stderr = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] use_syslog = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] verify_glance_signatures = enabled {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] volume_api_class = cinder.volume.api.API {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] volume_backend_name = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] volume_clear = zero {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] volume_clear_ionice = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] volume_clear_size = 0 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] volume_copy_bps_limit = 0 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] volume_dd_blocksize = 1M {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] volume_name_template = volume-%s {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] volume_service_inithost_offload = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] volume_usage_audit_period = month {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] zoning_mode = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_concurrency.disable_process_locking = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.auth_section = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.auth_type = password {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.auth_version = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.cache = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.certfile = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.include_service_catalog = True {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.insecure = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.interface = public {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.keyfile = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.memcache_password = **** {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.memcache_username = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.region_name = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.service_type = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.38/identity {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.backend = dogpile.cache.null {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.backend_argument = **** {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.backend_expiration_time = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.config_prefix = cache.oslo {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.debug_cache_backend = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.enable_retry_client = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.enable_socket_keepalive = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.enabled = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.expiration_time = 600 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.hashclient_retry_attempts = 2 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.memcache_dead_retry = 300 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.memcache_pool_maxsize = 10 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.memcache_sasl_enabled = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.password = **** {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.proxies = [] {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.redis_db = 0 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.redis_server = localhost:6379 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.retry_attempts = 2 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.retry_delay = 0.0 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.socket_keepalive_count = 1 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.socket_keepalive_idle = 1 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.socket_keepalive_interval = 1 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.socket_timeout = 1.0 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.tls_allowed_ciphers = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.tls_cafile = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.tls_certfile = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.tls_enabled = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.tls_keyfile = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cache.username = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] coordination.backend_url = **** {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] database.asyncio_connection = **** {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] database.asyncio_slave_connection = **** {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] database.backend = sqlalchemy {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] database.connection = **** {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] database.connection_debug = 0 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] database.connection_parameters = {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] database.connection_recycle_time = 3600 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] database.connection_trace = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] database.db_inc_retry_interval = True {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] database.db_max_retries = 20 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] database.db_max_retry_interval = 10 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] database.db_retry_interval = 1 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] database.max_overflow = 50 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] database.max_pool_size = 5 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] database.max_retries = 10 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] database.mysql_wsrep_sync_wait = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] database.pool_timeout = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] database.retry_interval = 10 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] database.slave_connection = **** {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] database.sqlite_synchronous = True {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] database.synchronous_reader = True {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] database.use_db_reconnect = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_tracing.insecure = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] profiler.connection_string = messaging:// {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] profiler.enabled = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] profiler.es_doc_type = notification {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] profiler.es_scroll_size = 10000 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] profiler.es_scroll_time = 2m {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] profiler.filter_error_trace = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] profiler.hmac_keys = **** {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] profiler.sentinel_service_name = mymaster {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] profiler.socket_timeout = 0.1 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] profiler.trace_requests = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] profiler.trace_sqlalchemy = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] profiler_jaeger.process_tags = {} {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] profiler_jaeger.service_name_prefix = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] profiler_otlp.service_name_prefix = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_policy.enforce_new_defaults = True {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_policy.policy_default_rule = default {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_policy.policy_file = policy.yaml {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] privsep_osbrick.group = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] privsep_osbrick.helper_command = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] privsep_osbrick.user = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cinder_sys_admin.group = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cinder_sys_admin.helper_command = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] cinder_sys_admin.user = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] service_user.auth_section = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] service_user.auth_type = password {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] service_user.cafile = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] service_user.certfile = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] service_user.collect_timing = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] service_user.insecure = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] service_user.keyfile = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] service_user.send_service_user_token = True {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] service_user.split_loggers = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] service_user.timeout = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] service_user.tls_ciphers = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] service_user.tls_min_version = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] glance.auth_section = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] glance.auth_type = password {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] glance.certfile = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] glance.collect_timing = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] glance.insecure = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] glance.keyfile = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] glance.region_name = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] glance.split_loggers = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] glance.timeout = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] glance.tls_ciphers = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] glance.tls_min_version = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.backend_availability_zone = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.chap_password = **** {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.chap_username = {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.disk_geometry = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.driver_client_cert = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.driver_client_cert_key = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.driver_data_namespace = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.driver_use_ssl = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.extra_capabilities = {} {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.filter_function = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.goodness_function = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.iscsi_target_flags = {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.iscsi_write_cache = on {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.iser_helper = tgtadm {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86285]: DEBUG cinder.volume.drivers.quobyte [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86285) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 17:05:49 devstack cinder-volume[86285]: WARNING cinder.volume.drivers.quobyte [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.iser_ip_address = 192.168.122.38 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.iser_port = 3260 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.nas_host = {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.nas_login = admin {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.nas_mount_options = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.nas_password = **** {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.nas_private_key = {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.nas_share_path = {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.num_shell_tries = 3 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86285]: WARNING cinder.volume.drivers.quobyte [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.quobyte_volume_url = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.replication_device = **** {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.report_discard_supported = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.reserved_percentage = 0 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86285]: DEBUG oslo_concurrency.processutils [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] Running cmd (subprocess): mount.quobyte {{(pid=86285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.target_helper = tgtadm {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.target_ip_address = 192.168.122.38 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.target_port = 3260 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.target_protocol = iscsi {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.trace_flags = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.unique_fqdn_network = True {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.use_chap_auth = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.volume_backend_name = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.volume_clear = zero {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.volume_clear_ionice = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.volume_clear_size = 0 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_reports.file_event_handler = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_reports.log_dir = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.backend_availability_zone = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.backend_host = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.chap_password = **** {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.chap_username = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.chiscsi_conf = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.disk_geometry = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.driver_client_cert = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.driver_data_namespace = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.driver_use_ssl = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.extra_capabilities = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.filter_function = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.goodness_function = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.iser_helper = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.iser_ip_address = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.iser_port = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.iser_target_prefix = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.nas_host = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.nas_login = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.nas_mount_options = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.nas_password = **** {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.nas_private_key = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.nas_share_path = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.nas_ssh_port = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.num_shell_tries = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.nvmet_port_id = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.replication_device = **** {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.report_discard_supported = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.reserved_percentage = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.scst_target_driver = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.storage_protocol = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.target_helper = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.target_ip_address = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.target_port = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.target_prefix = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.target_protocol = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.trace_flags = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.use_chap_auth = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.volume_clear = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.volume_clear_size = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] QuobyteHD.volumes_dir = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.ssl = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_notifications.driver = [] {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_notifications.retry = -1 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] key_manager.fixed_key = **** {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] barbican.barbican_api_version = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] barbican.barbican_endpoint = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] barbican.barbican_endpoint_type = public {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] barbican.barbican_region_name = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] barbican.cafile = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] barbican.certfile = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] barbican.collect_timing = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] barbican.insecure = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] barbican.keyfile = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] barbican.number_of_retries = 60 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] barbican.retry_delay = 1 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] barbican.send_service_user_token = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] barbican.split_loggers = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] barbican.timeout = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] barbican.tls_ciphers = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] barbican.tls_min_version = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] barbican.verify_ssl = True {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] barbican.verify_ssl_path = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] barbican_service_user.auth_section = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] barbican_service_user.auth_type = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] barbican_service_user.cafile = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] barbican_service_user.certfile = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] barbican_service_user.collect_timing = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] barbican_service_user.insecure = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] barbican_service_user.keyfile = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] barbican_service_user.split_loggers = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] barbican_service_user.timeout = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] barbican_service_user.tls_ciphers = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] barbican_service_user.tls_min_version = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] vault.approle_role_id = **** {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] vault.approle_secret_id = **** {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] vault.auth_method = approle {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] vault.auth_path = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] vault.kv_mountpoint = secret {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] vault.kv_path = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] vault.kv_version = 2 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] vault.namespace = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] vault.root_token_id = **** {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] vault.ssl_ca_crt_file = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] vault.timeout = 60.0 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] vault.token_file = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] vault.token_role = None {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] vault.use_ssl = False {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:05:49 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] ******************************************************************************** {{(pid=86066) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 17:05:49 devstack quobyte-client[86288]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 17:05:49 devstack quobyte-client[86288]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 17:05:49 devstack cinder-volume[86285]: DEBUG oslo_concurrency.processutils [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] CMD "mount.quobyte" returned: 1 in 0.143s {{(pid=86285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:49 devstack cinder-volume[86285]: DEBUG oslo_concurrency.lockutils [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86285) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:49 devstack cinder-volume[86285]: DEBUG oslo_concurrency.lockutils [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86285) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:49 devstack cinder-volume[86285]: DEBUG cinder.volume.drivers.quobyte [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86285) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:49 devstack cinder-volume[86285]: INFO cinder.volume.drivers.quobyte [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 ... Sep 28 17:05:49 devstack cinder-volume[86285]: DEBUG oslo_concurrency.processutils [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 -c /etc/quobyte/client-cinder.cfg {{(pid=86285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:49 devstack sudo[86290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 -c /etc/quobyte/client-cinder.cfg Sep 28 17:05:49 devstack sudo[86290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:49 devstack sudo[86290]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:49 devstack cinder-volume[86285]: DEBUG oslo_concurrency.processutils [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.512s {{(pid=86285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:49 devstack cinder-volume[86285]: INFO cinder.volume.drivers.quobyte [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 succeeded Sep 28 17:05:49 devstack cinder-volume[86285]: DEBUG cinder.volume.drivers.quobyte [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86285) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:49 devstack cinder-volume[86285]: DEBUG oslo_concurrency.lockutils [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.524s {{(pid=86285) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:49 devstack cinder-volume[86285]: DEBUG oslo_concurrency.processutils [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:49 devstack sudo[86392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:05:49 devstack sudo[86392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:50 devstack sudo[86392]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:50 devstack cinder-volume[86285]: DEBUG oslo_concurrency.processutils [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.301s {{(pid=86285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:50 devstack cinder-volume[86285]: INFO cinder.volume.driver [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] Driver hasn't implemented _init_vendor_properties() Sep 28 17:05:50 devstack cinder-volume[86285]: DEBUG cinder.volume.driver [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1193580627441, 'free_capacity_gb': 1775.1193580627441, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86285) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 17:05:50 devstack cinder-volume[86285]: DEBUG oslo_db.sqlalchemy.engines [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86285) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:05:50 devstack cinder-volume[86285]: DEBUG dbcounter [-] [86285] Writer thread running {{(pid=86285) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:05:50 devstack cinder-volume[86285]: DEBUG cinder.db.api [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] Building query based on filter {{(pid=86285) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 17:05:50 devstack cinder-volume[86285]: DEBUG cinder.image.image_utils [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86285) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 17:05:50 devstack cinder-volume[86285]: INFO cinder.keymgr.migration [None req-8b0d3a06-bed1-4b3d-9ddf-397474ae8472 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 17:05:50 devstack cinder-volume[86285]: DEBUG oslo_concurrency.lockutils [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86285) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:50 devstack cinder-volume[86285]: DEBUG oslo_concurrency.lockutils [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86285) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:50 devstack cinder-volume[86285]: DEBUG cinder.volume.drivers.quobyte [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86285) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:50 devstack cinder-volume[86285]: DEBUG cinder.volume.drivers.quobyte [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86285) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:50 devstack cinder-volume[86285]: DEBUG oslo_concurrency.lockutils [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86285) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:50 devstack cinder-volume[86285]: DEBUG oslo_concurrency.processutils [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:50 devstack sudo[86395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:05:50 devstack sudo[86395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:50 devstack sudo[86395]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:50 devstack cinder-volume[86285]: DEBUG oslo_concurrency.processutils [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.317s {{(pid=86285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:50 devstack cinder-volume[86285]: DEBUG cinder.manager [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] Notifying Schedulers of capabilities ... {{(pid=86285) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:05:50 devstack cinder-volume[86285]: INFO cinder.volume.manager [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] Driver initialization completed successfully. Sep 28 17:05:50 devstack cinder-volume[86285]: INFO cinder.manager [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] Initiating service 3 cleanup Sep 28 17:05:50 devstack cinder-volume[86285]: INFO cinder.manager [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] Service 3 cleanup completed. Sep 28 17:05:50 devstack cinder-volume[86285]: DEBUG cinder.service [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] Creating RPC server for service cinder-volume {{(pid=86285) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 17:05:50 devstack cinder-volume[86285]: DEBUG cinder.service [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86285) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 17:05:50 devstack cinder-volume[86285]: INFO cinder.volume.manager [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 17:05:50 devstack cinder-volume[86285]: DEBUG oslo_concurrency.lockutils [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86285) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:50 devstack cinder-volume[86285]: DEBUG oslo_concurrency.lockutils [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86285) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:50 devstack cinder-volume[86285]: DEBUG cinder.volume.drivers.quobyte [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86285) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:50 devstack cinder-volume[86285]: DEBUG cinder.volume.drivers.quobyte [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86285) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:50 devstack cinder-volume[86285]: DEBUG oslo_concurrency.lockutils [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86285) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:50 devstack cinder-volume[86285]: DEBUG oslo_concurrency.processutils [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:50 devstack sudo[86398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:05:50 devstack sudo[86398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:51 devstack sudo[86398]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:51 devstack cinder-volume[86285]: DEBUG oslo_concurrency.processutils [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.324s {{(pid=86285) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:51 devstack cinder-volume[86285]: INFO cinder.volume.manager [None req-54858aa2-b6e4-4550-82b5-afc7a7de793e None None] Driver post RPC initialization completed successfully. Sep 28 17:05:56 devstack cinder-volume[86066]: INFO oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] Caught SIGTERM, stopping children Sep 28 17:05:56 devstack cinder-volume[86066]: DEBUG oslo_concurrency.lockutils [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] Acquiring lock "singleton_lock" {{(pid=86066) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:05:56 devstack cinder-volume[86066]: DEBUG oslo_concurrency.lockutils [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] Acquired lock "singleton_lock" {{(pid=86066) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:05:56 devstack cinder-volume[86066]: DEBUG oslo_concurrency.lockutils [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] Releasing lock "singleton_lock" {{(pid=86066) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:05:56 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] Stop services. {{(pid=86066) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 17:05:56 devstack cinder-volume[86066]: DEBUG oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] Killing children. {{(pid=86066) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 17:05:56 devstack cinder-volume[86066]: INFO oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] Waiting on 1 children to exit Sep 28 17:05:59 devstack cinder-volume[86285]: DEBUG oslo_concurrency.lockutils [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] Acquiring lock "singleton_lock" {{(pid=86285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:05:59 devstack cinder-volume[86285]: DEBUG oslo_concurrency.lockutils [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] Acquired lock "singleton_lock" {{(pid=86285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:05:59 devstack cinder-volume[86285]: DEBUG oslo_concurrency.lockutils [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] Releasing lock "singleton_lock" {{(pid=86285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:05:59 devstack cinder-volume[86285]: WARNING amqp [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 17:05:59 devstack cinder-volume[86285]: WARNING amqp [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 17:05:59 devstack cinder-volume[86066]: INFO oslo_service.backend._eventlet.service [None req-a686d021-0ee9-4f99-b843-9ce94e7a6da2 None None] Child 86285 exited with status 0 Sep 28 17:05:59 devstack cinder-volume[86593]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 17:05:59 devstack cinder-volume[86593]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 17:05:59 devstack cinder-volume[86593]: we strongly recommend against using it for new projects. Sep 28 17:05:59 devstack cinder-volume[86593]: If you are already using Eventlet, we recommend migrating to a different Sep 28 17:05:59 devstack cinder-volume[86593]: framework. For more detail see Sep 28 17:05:59 devstack cinder-volume[86593]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 17:05:59 devstack cinder-volume[86593]: import eventlet # noqa Sep 28 17:06:03 devstack cinder-volume[86593]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86593) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:06:03 devstack cinder-volume[86593]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86593) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:06:03 devstack cinder-volume[86593]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86593) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:06:04 devstack cinder-volume[86593]: INFO dbcounter [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] Registered counter for database cinder Sep 28 17:06:04 devstack cinder-volume[86593]: DEBUG oslo_db.sqlalchemy.engines [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86593) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:06:04 devstack cinder-volume[86593]: DEBUG dbcounter [-] [86593] Writer thread running {{(pid=86593) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:06:04 devstack cinder-volume[86593]: INFO cinder.rpc [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 17:06:04 devstack cinder-volume[86593]: INFO cinder.rpc [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 17:06:04 devstack cinder-volume[86593]: DEBUG oslo_db.sqlalchemy.engines [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86593) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:06:05 devstack cinder-volume[86593]: INFO cinder.volume.manager [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] Determined volume DB was empty at startup. Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG cinder.volume.manager [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86593) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 17:06:05 devstack cinder-volume[86593]: WARNING stevedore.named [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 17:06:05 devstack cinder-volume[86593]: WARNING castellan.key_manager [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:06:05 devstack cinder-volume[86593]: WARNING cinder.keymgr.conf_key_mgr [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:06:05 devstack cinder-volume[86593]: INFO cinder.volume.manager [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_db.sqlalchemy.engines [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86593) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:06:05 devstack cinder-volume[86593]: INFO oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] Starting 1 workers Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] Started child 86917 {{(pid=86593) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] Full set of CONF: {{(pid=86593) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 17:06:05 devstack cinder-volume[86917]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] ******************************************************************************** {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] Configuration options gathered from: {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] ================================================================================ {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] allow_availability_zone_fallback = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] allow_compression_on_image_upload = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] allowed_direct_url_schemes = [] {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] api_rate_limit = True {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] auth_strategy = keystone {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_availability_zone = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_host = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_name = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_stats_polling_interval = 60 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backup_api_class = cinder.backup.api.API {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backup_name_template = backup-%s {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backup_use_same_host = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backup_use_temp_snapshot = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] chap_password = **** {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] chap_username = {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cinder_internal_tenant_project_id = 7c3b82ea58834ecea83776cfec35a8bb {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cinder_internal_tenant_user_id = aaac8a54c6c44a38b9088e4ea3aa66df {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cluster = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] compression_format = gzip {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] compute_api_class = cinder.compute.nova.API {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] config_dir = [] {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] config_source = [] {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] control_exchange = openstack {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] debug = True {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] default_availability_zone = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] default_group_type = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] default_volume_type = QuobyteHD {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] disk_geometry = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] driver_client_cert = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] driver_client_cert_key = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] driver_data_namespace = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] driver_ssl_cert_path = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] driver_ssl_cert_verify = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] driver_use_ssl = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] enable_new_services = True {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] enable_unsupported_driver = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] enabled_backends = ['QuobyteHD'] {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] enforce_multipath_for_image_xfer = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] filter_function = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] glance_api_insecure = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] glance_api_servers = ['http://192.168.122.38/image'] {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] glance_api_ssl_compression = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] glance_ca_certificates_file = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] glance_catalog_info = image:glance:publicURL {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] glance_certfile = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] glance_keyfile = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] glance_num_retries = 3 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] glance_request_timeout = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] goodness_function = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] graceful_shutdown_timeout = 5 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] group_api_class = cinder.group.api.API {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] host = devstack {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] image_compress_on_upload = True {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] image_conversion_address_space_limit = 1 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] image_conversion_cpu_limit = 60 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] image_conversion_disable = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] image_introspection_address_space_limit = 1 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] image_introspection_cpu_limit = 60 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] image_upload_use_cinder_backend = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] image_upload_use_internal_tenant = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] image_volume_cache_enabled = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] image_volume_cache_max_count = 0 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] image_volume_cache_max_size_gb = 0 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] init_host_max_objects_retrieval = 0 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] instance_format = [instance: %(uuid)s] {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] iscsi_target_flags = {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] iscsi_write_cache = on {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] iser_helper = tgtadm {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] iser_ip_address = 192.168.122.38 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] iser_port = 3260 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] log_color = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] log_config_append = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] log_dir = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] log_file = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] log_options = True {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] log_rotate_interval = 1 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] log_rotate_interval_type = days {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] log_rotation_type = none {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] max_age = 0 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] max_logfile_count = 30 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] max_logfile_size_mb = 200 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] max_over_subscription_ratio = 20.0 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] message_reap_interval = 86400 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] message_ttl = 2592000 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] migration_create_volume_timeout_secs = 300 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] monkey_patch = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] monkey_patch_modules = [] {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] my_ip = 192.168.122.38 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] no_snapshot_gb_quota = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] num_iser_scan_tries = 3 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] num_shell_tries = 3 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] num_volume_device_scan_tries = 3 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] nvmeof_conn_info_version = 1 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] nvmet_ns_id = 10 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] nvmet_port_id = 1 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] osapi_max_limit = 1000 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] osapi_volume_ext_list = [] {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] osapi_volume_listen_port = 8776 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] osapi_volume_use_ssl = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] osapi_volume_workers = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] per_volume_size_limit = -1 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] periodic_fuzzy_delay = 60 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] periodic_interval = 60 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] public_endpoint = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] publish_errors = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] quota_backup_gigabytes = 1000 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] quota_backups = 10 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] quota_gigabytes = 1000 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] quota_groups = 10 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] quota_snapshots = 10 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] quota_volumes = 10 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] rate_limit_burst = 0 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] rate_limit_except_level = CRITICAL {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] rate_limit_interval = 0 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] reinit_driver_count = 3 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] replication_device = **** {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] report_discard_supported = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] report_interval = 120 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] reservation_clean_interval = 86400 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] reservation_expire = 86400 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] reserved_image_namespaces = [] {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] reserved_percentage = 0 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] rpc_response_timeout = 120 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] run_external_periodic_tasks = True {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] scst_target_driver = iscsi {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] scst_target_iqn_name = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] service_down_time = 720 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] shell_completion = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] snapshot_name_template = snapshot-%s {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] split_loggers = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] state_path = /opt/stack/data/cinder {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] storage_availability_zone = nova {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] storage_protocol = iSCSI {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] syslog_log_facility = LOG_USER {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] target_helper = lioadm {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] target_ip_address = 192.168.122.38 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] target_port = 3260 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] target_protocol = iscsi {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] target_secondary_ip_addresses = [] {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] trace_flags = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] transport_url = **** {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] until_refresh = 0 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] use_chap_auth = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] use_default_quota_class = True {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] use_journal = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] use_json = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] use_multipath_for_image_xfer = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] use_stderr = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] use_syslog = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] verify_glance_signatures = enabled {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] volume_api_class = cinder.volume.api.API {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] volume_backend_name = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] volume_clear = zero {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] volume_clear_ionice = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] volume_clear_size = 0 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] volume_copy_bps_limit = 0 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] volume_dd_blocksize = 1M {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86917) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] volume_name_template = volume-%s {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] volume_service_inithost_offload = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] volume_usage_audit_period = month {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] zoning_mode = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_concurrency.disable_process_locking = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.auth_section = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.auth_type = password {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.auth_version = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.cache = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.certfile = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.include_service_catalog = True {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.insecure = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.interface = public {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.keyfile = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.memcache_password = **** {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.memcache_username = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.region_name = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.service_type = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.38/identity {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.backend = dogpile.cache.null {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.backend_argument = **** {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.backend_expiration_time = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.config_prefix = cache.oslo {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.debug_cache_backend = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.enable_retry_client = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.enable_socket_keepalive = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.enabled = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.expiration_time = 600 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.hashclient_retry_attempts = 2 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.memcache_dead_retry = 300 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.memcache_pool_maxsize = 10 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.memcache_sasl_enabled = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.password = **** {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.proxies = [] {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.redis_db = 0 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.redis_server = localhost:6379 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.retry_attempts = 2 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.retry_delay = 0.0 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.socket_keepalive_count = 1 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.socket_keepalive_idle = 1 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.socket_keepalive_interval = 1 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.socket_timeout = 1.0 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.tls_allowed_ciphers = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.tls_cafile = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.tls_certfile = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.tls_enabled = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.tls_keyfile = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cache.username = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] coordination.backend_url = **** {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] database.asyncio_connection = **** {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] database.asyncio_slave_connection = **** {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] database.backend = sqlalchemy {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] database.connection = **** {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] database.connection_debug = 0 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] database.connection_parameters = {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] database.connection_recycle_time = 3600 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] database.connection_trace = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] database.db_inc_retry_interval = True {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] database.db_max_retries = 20 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] database.db_max_retry_interval = 10 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] database.db_retry_interval = 1 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] database.max_overflow = 50 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] database.max_pool_size = 5 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] database.max_retries = 10 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] database.mysql_wsrep_sync_wait = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] database.pool_timeout = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] database.retry_interval = 10 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] database.slave_connection = **** {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] database.sqlite_synchronous = True {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] database.synchronous_reader = True {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] database.use_db_reconnect = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_tracing.insecure = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] profiler.connection_string = messaging:// {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] profiler.enabled = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] profiler.es_doc_type = notification {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] profiler.es_scroll_size = 10000 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] profiler.es_scroll_time = 2m {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] profiler.filter_error_trace = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] profiler.hmac_keys = **** {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] profiler.sentinel_service_name = mymaster {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] profiler.socket_timeout = 0.1 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] profiler.trace_requests = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] profiler.trace_sqlalchemy = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] profiler_jaeger.process_tags = {} {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] profiler_jaeger.service_name_prefix = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] profiler_otlp.service_name_prefix = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_policy.enforce_new_defaults = True {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_policy.policy_default_rule = default {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_policy.policy_file = policy.yaml {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] privsep_osbrick.group = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] privsep_osbrick.helper_command = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] privsep_osbrick.user = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cinder_sys_admin.group = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cinder_sys_admin.helper_command = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] cinder_sys_admin.user = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] service_user.auth_section = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] service_user.auth_type = password {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] service_user.cafile = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] service_user.certfile = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] service_user.collect_timing = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] service_user.insecure = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] service_user.keyfile = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] service_user.send_service_user_token = True {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] service_user.split_loggers = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] service_user.timeout = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] service_user.tls_ciphers = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] service_user.tls_min_version = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] glance.auth_section = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] glance.auth_type = password {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] glance.certfile = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] glance.collect_timing = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] glance.insecure = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] glance.keyfile = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] glance.region_name = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] glance.split_loggers = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] glance.timeout = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] glance.tls_ciphers = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] glance.tls_min_version = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.backend_availability_zone = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.chap_password = **** {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.chap_username = {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.disk_geometry = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.driver_client_cert = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.driver_client_cert_key = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.driver_data_namespace = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.driver_use_ssl = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.extra_capabilities = {} {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.filter_function = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.goodness_function = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.iscsi_target_flags = {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.iscsi_write_cache = on {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.iser_helper = tgtadm {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.iser_ip_address = 192.168.122.38 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.iser_port = 3260 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.nas_host = {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.nas_login = admin {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.nas_mount_options = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.nas_password = **** {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.nas_private_key = {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.nas_share_path = {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.num_shell_tries = 3 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.quobyte_volume_url = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.replication_device = **** {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.report_discard_supported = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.reserved_percentage = 0 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86917) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.target_helper = tgtadm {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.target_ip_address = 192.168.122.38 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.target_port = 3260 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.target_protocol = iscsi {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.trace_flags = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.unique_fqdn_network = True {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.use_chap_auth = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.volume_backend_name = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.volume_clear = zero {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.volume_clear_ionice = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.volume_clear_size = 0 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.quobyte [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_reports.file_event_handler = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_reports.log_dir = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.backend_availability_zone = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.backend_host = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.chap_password = **** {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.chap_username = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.chiscsi_conf = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.disk_geometry = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.driver_client_cert = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.quobyte [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.driver_data_namespace = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.driver_use_ssl = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.extra_capabilities = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.filter_function = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.goodness_function = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] Running cmd (subprocess): mount.quobyte {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.iser_helper = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.iser_ip_address = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.iser_port = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.iser_target_prefix = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.nas_host = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.nas_login = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.nas_mount_options = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.nas_password = **** {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.nas_private_key = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.nas_share_path = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.nas_ssh_port = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.num_shell_tries = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.nvmet_port_id = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.replication_device = **** {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.report_discard_supported = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.reserved_percentage = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.scst_target_driver = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.storage_protocol = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.target_helper = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.target_ip_address = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.target_port = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.target_prefix = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.target_protocol = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.trace_flags = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.use_chap_auth = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.volume_clear = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.volume_clear_size = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] QuobyteHD.volumes_dir = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.ssl = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_notifications.driver = [] {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_notifications.retry = -1 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] key_manager.fixed_key = **** {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] barbican.barbican_api_version = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] barbican.barbican_endpoint = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] barbican.barbican_endpoint_type = public {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] barbican.barbican_region_name = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] barbican.cafile = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] barbican.certfile = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] barbican.collect_timing = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] barbican.insecure = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] barbican.keyfile = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] barbican.number_of_retries = 60 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] barbican.retry_delay = 1 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] barbican.send_service_user_token = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] barbican.split_loggers = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] barbican.timeout = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] barbican.tls_ciphers = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] barbican.tls_min_version = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] barbican.verify_ssl = True {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] barbican.verify_ssl_path = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] barbican_service_user.auth_section = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] barbican_service_user.auth_type = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack quobyte-client[86918]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] barbican_service_user.cafile = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] barbican_service_user.certfile = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] barbican_service_user.collect_timing = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] barbican_service_user.insecure = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] barbican_service_user.keyfile = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] barbican_service_user.split_loggers = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] barbican_service_user.timeout = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack quobyte-client[86918]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] barbican_service_user.tls_ciphers = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] barbican_service_user.tls_min_version = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] vault.approle_role_id = **** {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] vault.approle_secret_id = **** {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] vault.auth_method = approle {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] vault.auth_path = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] vault.kv_mountpoint = secret {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] vault.kv_path = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] vault.kv_version = 2 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] vault.namespace = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] vault.root_token_id = **** {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] vault.ssl_ca_crt_file = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] vault.timeout = 60.0 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] vault.token_file = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] vault.token_role = None {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] vault.use_ssl = False {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:06:05 devstack cinder-volume[86593]: DEBUG oslo_service.backend._eventlet.service [None req-fc786b6d-0590-4206-a104-a678afd03812 None None] ******************************************************************************** {{(pid=86593) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 17:06:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] CMD "mount.quobyte" returned: 1 in 0.147s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:05 devstack sudo[86919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:06:05 devstack sudo[86919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:06 devstack sudo[86919]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.558s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:06 devstack cinder-volume[86917]: INFO cinder.volume.driver [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 17:06:06 devstack cinder-volume[86917]: DEBUG cinder.volume.driver [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1098976135254, 'free_capacity_gb': 1775.1098976135254, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86917) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 17:06:06 devstack cinder-volume[86917]: DEBUG oslo_db.sqlalchemy.engines [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86917) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:06:06 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writer thread running {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:06:06 devstack cinder-volume[86917]: DEBUG cinder.db.api [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] Building query based on filter {{(pid=86917) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 17:06:06 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86917) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 17:06:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:06 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:06 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:06 devstack cinder-volume[86917]: INFO cinder.keymgr.migration [None req-0e56b96e-d214-4ad8-9d7f-cd4e0b8c3903 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 17:06:06 devstack sudo[86934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:06:06 devstack sudo[86934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:06 devstack sudo[86934]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.333s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:06 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:06:06 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] Driver initialization completed successfully. Sep 28 17:06:06 devstack cinder-volume[86917]: INFO cinder.manager [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] Initiating service 3 cleanup Sep 28 17:06:06 devstack cinder-volume[86917]: INFO cinder.manager [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] Service 3 cleanup completed. Sep 28 17:06:06 devstack cinder-volume[86917]: DEBUG cinder.service [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] Creating RPC server for service cinder-volume {{(pid=86917) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 17:06:06 devstack cinder-volume[86917]: DEBUG cinder.service [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86917) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 17:06:07 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 17:06:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:07 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:07 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:07 devstack sudo[86945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:06:07 devstack sudo[86945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:07 devstack sudo[86945]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.300s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:07 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-256b03fb-6bb2-4756-9a51-fd3271a15941 None None] Driver post RPC initialization completed successfully. Sep 28 17:06:15 devstack cinder-volume[86593]: DEBUG dbcounter [-] [86593] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86593) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:06:16 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=3 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:06:17 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:06:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager._thread_info {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:06:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread count: 6 {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:06:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread info: [<_MainThread(MainThread, started 132915553284224)>, , , , , ] {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:07:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:07:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:49 devstack sudo[87727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:07:49 devstack sudo[87727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:49 devstack sudo[87727]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.550s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:49 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:07:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager._thread_info {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:07:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread count: 6 {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:07:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread info: [<_MainThread(MainThread, started 132915553284224)>, , , , , ] {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:07:59 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee893cd0-bc08-4d8a-907b-ee3e5d8865b6 tempest-VolumesAdminNegativeTest-183273606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:07:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ee893cd0-bc08-4d8a-907b-ee3e5d8865b6 tempest-VolumesAdminNegativeTest-183273606 None] Flow 'volume_create_manager' (bbc7e56b-9c01-42af-b6cc-08d9d81c5de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:07:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ee893cd0-bc08-4d8a-907b-ee3e5d8865b6 tempest-VolumesAdminNegativeTest-183273606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76bb34eb-802c-4713-aa3e-66c0ebaafad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ee893cd0-bc08-4d8a-907b-ee3e5d8865b6 tempest-VolumesAdminNegativeTest-183273606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76bb34eb-802c-4713-aa3e-66c0ebaafad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-108637079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6c2bc19-1295-43e1-834c-30ab48d4e5f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2622373d697e45cda325289563ec8630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:07:59Z,use_quota=True,user_id='9281757e26ff493a9280bad0d6d8365f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ee893cd0-bc08-4d8a-907b-ee3e5d8865b6 tempest-VolumesAdminNegativeTest-183273606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61425f32-46d3-488b-b4de-9d0b966896ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ee893cd0-bc08-4d8a-907b-ee3e5d8865b6 tempest-VolumesAdminNegativeTest-183273606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61425f32-46d3-488b-b4de-9d0b966896ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ee893cd0-bc08-4d8a-907b-ee3e5d8865b6 tempest-VolumesAdminNegativeTest-183273606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e443fed5-0a0c-42b4-add2-d44e9c691650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ee893cd0-bc08-4d8a-907b-ee3e5d8865b6 tempest-VolumesAdminNegativeTest-183273606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e443fed5-0a0c-42b4-add2-d44e9c691650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6c2bc19-1295-43e1-834c-30ab48d4e5f7', 'volume_name': 'volume-c6c2bc19-1295-43e1-834c-30ab48d4e5f7', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ee893cd0-bc08-4d8a-907b-ee3e5d8865b6 tempest-VolumesAdminNegativeTest-183273606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (122506fb-2824-4c65-89e0-9f6075fd2848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ee893cd0-bc08-4d8a-907b-ee3e5d8865b6 tempest-VolumesAdminNegativeTest-183273606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (122506fb-2824-4c65-89e0-9f6075fd2848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ee893cd0-bc08-4d8a-907b-ee3e5d8865b6 tempest-VolumesAdminNegativeTest-183273606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc9ee525-6d3b-4f05-80b5-0c90439fa572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:59 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-ee893cd0-bc08-4d8a-907b-ee3e5d8865b6 tempest-VolumesAdminNegativeTest-183273606 None] Volume c6c2bc19-1295-43e1-834c-30ab48d4e5f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6c2bc19-1295-43e1-834c-30ab48d4e5f7', 'volume_size': 1} Sep 28 17:07:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ee893cd0-bc08-4d8a-907b-ee3e5d8865b6 tempest-VolumesAdminNegativeTest-183273606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ee893cd0-bc08-4d8a-907b-ee3e5d8865b6 tempest-VolumesAdminNegativeTest-183273606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:59 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ee893cd0-bc08-4d8a-907b-ee3e5d8865b6 tempest-VolumesAdminNegativeTest-183273606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-108637079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6c2bc19-1295-43e1-834c-30ab48d4e5f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2622373d697e45cda325289563ec8630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:07:59Z,use_quota=True,user_id='9281757e26ff493a9280bad0d6d8365f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:07:59 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-ee893cd0-bc08-4d8a-907b-ee3e5d8865b6 tempest-VolumesAdminNegativeTest-183273606 None] Creating volume c6c2bc19-1295-43e1-834c-30ab48d4e5f7 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:07:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ee893cd0-bc08-4d8a-907b-ee3e5d8865b6 tempest-VolumesAdminNegativeTest-183273606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ee893cd0-bc08-4d8a-907b-ee3e5d8865b6 tempest-VolumesAdminNegativeTest-183273606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:59 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ee893cd0-bc08-4d8a-907b-ee3e5d8865b6 tempest-VolumesAdminNegativeTest-183273606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:59 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ee893cd0-bc08-4d8a-907b-ee3e5d8865b6 tempest-VolumesAdminNegativeTest-183273606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ee893cd0-bc08-4d8a-907b-ee3e5d8865b6 tempest-VolumesAdminNegativeTest-183273606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:59 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ee893cd0-bc08-4d8a-907b-ee3e5d8865b6 tempest-VolumesAdminNegativeTest-183273606 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:07:59 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-ee893cd0-bc08-4d8a-907b-ee3e5d8865b6 tempest-VolumesAdminNegativeTest-183273606 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:07:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ee893cd0-bc08-4d8a-907b-ee3e5d8865b6 tempest-VolumesAdminNegativeTest-183273606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c6c2bc19-1295-43e1-834c-30ab48d4e5f7 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:59 devstack sudo[87795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c6c2bc19-1295-43e1-834c-30ab48d4e5f7 1073741824 Sep 28 17:07:59 devstack sudo[87795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:01 devstack sudo[87795]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ee893cd0-bc08-4d8a-907b-ee3e5d8865b6 tempest-VolumesAdminNegativeTest-183273606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c6c2bc19-1295-43e1-834c-30ab48d4e5f7 1073741824" returned: 0 in 1.682s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ee893cd0-bc08-4d8a-907b-ee3e5d8865b6 tempest-VolumesAdminNegativeTest-183273606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c6c2bc19-1295-43e1-834c-30ab48d4e5f7 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:01 devstack sudo[88115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c6c2bc19-1295-43e1-834c-30ab48d4e5f7 Sep 28 17:08:01 devstack sudo[88115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:02 devstack sudo[88115]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ee893cd0-bc08-4d8a-907b-ee3e5d8865b6 tempest-VolumesAdminNegativeTest-183273606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c6c2bc19-1295-43e1-834c-30ab48d4e5f7" returned: 0 in 0.958s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:02 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ee893cd0-bc08-4d8a-907b-ee3e5d8865b6 tempest-VolumesAdminNegativeTest-183273606 None] <== create_volume: return (2796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ee893cd0-bc08-4d8a-907b-ee3e5d8865b6 tempest-VolumesAdminNegativeTest-183273606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.803s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:02 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ee893cd0-bc08-4d8a-907b-ee3e5d8865b6 tempest-VolumesAdminNegativeTest-183273606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc9ee525-6d3b-4f05-80b5-0c90439fa572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6c2bc19-1295-43e1-834c-30ab48d4e5f7', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:02 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ee893cd0-bc08-4d8a-907b-ee3e5d8865b6 tempest-VolumesAdminNegativeTest-183273606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1613f13d-c8df-44c5-9d69-e9f4311904e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:02 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-ee893cd0-bc08-4d8a-907b-ee3e5d8865b6 tempest-VolumesAdminNegativeTest-183273606 None] Volume volume-c6c2bc19-1295-43e1-834c-30ab48d4e5f7 (c6c2bc19-1295-43e1-834c-30ab48d4e5f7): created successfully Sep 28 17:08:02 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ee893cd0-bc08-4d8a-907b-ee3e5d8865b6 tempest-VolumesAdminNegativeTest-183273606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1613f13d-c8df-44c5-9d69-e9f4311904e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:02 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ee893cd0-bc08-4d8a-907b-ee3e5d8865b6 tempest-VolumesAdminNegativeTest-183273606 None] Flow 'volume_create_manager' (bbc7e56b-9c01-42af-b6cc-08d9d81c5de6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:02 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-ee893cd0-bc08-4d8a-907b-ee3e5d8865b6 tempest-VolumesAdminNegativeTest-183273606 None] Created volume successfully. Sep 28 17:08:04 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ba219bd7-2efb-4e03-af89-eec895c8d892 tempest-VolumesAdminNegativeTest-183273606 None] Acquiring lock "cinder-c6c2bc19-1295-43e1-834c-30ab48d4e5f7-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:04 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ba219bd7-2efb-4e03-af89-eec895c8d892 tempest-VolumesAdminNegativeTest-183273606 None] Lock "cinder-c6c2bc19-1295-43e1-834c-30ab48d4e5f7-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:04 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ba219bd7-2efb-4e03-af89-eec895c8d892 tempest-VolumesAdminNegativeTest-183273606 None] Acquiring lock "cinder-quobyte-c6c2bc19-1295-43e1-834c-30ab48d4e5f7" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:04 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ba219bd7-2efb-4e03-af89-eec895c8d892 tempest-VolumesAdminNegativeTest-183273606 None] Lock "cinder-quobyte-c6c2bc19-1295-43e1-834c-30ab48d4e5f7" acquired by "delete_volume" :: waited 0.044s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:04 devstack cinder-volume[86917]: INFO oslo.privsep.daemon [None req-ba219bd7-2efb-4e03-af89-eec895c8d892 tempest-VolumesAdminNegativeTest-183273606 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp6yaq0_gd/privsep.sock'] Sep 28 17:08:04 devstack sudo[88205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp6yaq0_gd/privsep.sock Sep 28 17:08:04 devstack sudo[88205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:07 devstack cinder-volume[86917]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 28 17:08:07 devstack cinder-volume[86917]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 17:08:07 devstack cinder-volume[86917]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 28 17:08:07 devstack cinder-volume[86917]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 17:08:07 devstack cinder-volume[86917]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 28 17:08:07 devstack cinder-volume[86917]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 28 17:08:07 devstack cinder-volume[86917]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 17:08:07 devstack cinder-volume[86917]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 17:08:07 devstack cinder-volume[86917]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 28 17:08:08 devstack sudo[88205]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:08 devstack cinder-volume[86917]: INFO oslo.privsep.daemon [None req-ba219bd7-2efb-4e03-af89-eec895c8d892 tempest-VolumesAdminNegativeTest-183273606 None] Spawned new privsep daemon via rootwrap Sep 28 17:08:08 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [None req-ba219bd7-2efb-4e03-af89-eec895c8d892 tempest-VolumesAdminNegativeTest-183273606 None] Accepted privsep connection to /tmp/tmp6yaq0_gd/privsep.sock {{(pid=86917) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 28 17:08:08 devstack cinder-volume[86917]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 28 17:08:08 devstack cinder-volume[86917]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 28 17:08:08 devstack cinder-volume[86917]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 28 17:08:08 devstack cinder-volume[86917]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88269 Sep 28 17:08:08 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84c323d-ff5d-4f94-99cb-20e0cb3a7a73]: (2,) {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:08 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e7e277-d0f3-4703-83db-f51d8b921a51]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ba219bd7-2efb-4e03-af89-eec895c8d892 tempest-VolumesAdminNegativeTest-183273606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c6c2bc19-1295-43e1-834c-30ab48d4e5f7 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:08 devstack sudo[88276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c6c2bc19-1295-43e1-834c-30ab48d4e5f7 Sep 28 17:08:08 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:09 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ba219bd7-2efb-4e03-af89-eec895c8d892 tempest-VolumesAdminNegativeTest-183273606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c6c2bc19-1295-43e1-834c-30ab48d4e5f7" returned: 0 in 0.749s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ba219bd7-2efb-4e03-af89-eec895c8d892 tempest-VolumesAdminNegativeTest-183273606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c6c2bc19-1295-43e1-834c-30ab48d4e5f7 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:09 devstack sudo[88291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c6c2bc19-1295-43e1-834c-30ab48d4e5f7 Sep 28 17:08:09 devstack sudo[88291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:09 devstack sudo[88291]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ba219bd7-2efb-4e03-af89-eec895c8d892 tempest-VolumesAdminNegativeTest-183273606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c6c2bc19-1295-43e1-834c-30ab48d4e5f7" returned: 0 in 0.560s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:10 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ba219bd7-2efb-4e03-af89-eec895c8d892 tempest-VolumesAdminNegativeTest-183273606 None] Lock "cinder-quobyte-c6c2bc19-1295-43e1-834c-30ab48d4e5f7" released by "delete_volume" :: held 5.162s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:10 devstack cinder-volume[86917]: WARNING cinder.quota [None req-ba219bd7-2efb-4e03-af89-eec895c8d892 tempest-VolumesAdminNegativeTest-183273606 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:08:10 devstack cinder-volume[86917]: WARNING cinder.quota [None req-ba219bd7-2efb-4e03-af89-eec895c8d892 tempest-VolumesAdminNegativeTest-183273606 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:08:10 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-ba219bd7-2efb-4e03-af89-eec895c8d892 tempest-VolumesAdminNegativeTest-183273606 None] Created reservations ['ecf43dd8-7980-48a4-8ff5-d58a4ea60f0e', '308e4e47-9aa5-4e98-bfbf-b9e2ac53076e', '54c142f3-eb2d-4fe5-b122-d7976499518d', 'e776f1ad-230f-4eeb-9e4f-79fb609e83b1'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ba219bd7-2efb-4e03-af89-eec895c8d892 tempest-VolumesAdminNegativeTest-183273606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ba219bd7-2efb-4e03-af89-eec895c8d892 tempest-VolumesAdminNegativeTest-183273606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:10 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ba219bd7-2efb-4e03-af89-eec895c8d892 tempest-VolumesAdminNegativeTest-183273606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:10 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ba219bd7-2efb-4e03-af89-eec895c8d892 tempest-VolumesAdminNegativeTest-183273606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ba219bd7-2efb-4e03-af89-eec895c8d892 tempest-VolumesAdminNegativeTest-183273606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ba219bd7-2efb-4e03-af89-eec895c8d892 tempest-VolumesAdminNegativeTest-183273606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:10 devstack sudo[88313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:08:10 devstack sudo[88313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:11 devstack sudo[88313]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ba219bd7-2efb-4e03-af89-eec895c8d892 tempest-VolumesAdminNegativeTest-183273606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.593s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:11 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-ba219bd7-2efb-4e03-af89-eec895c8d892 tempest-VolumesAdminNegativeTest-183273606 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:11 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-ba219bd7-2efb-4e03-af89-eec895c8d892 tempest-VolumesAdminNegativeTest-183273606 None] Deleted volume successfully. Sep 28 17:08:11 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ba219bd7-2efb-4e03-af89-eec895c8d892 tempest-VolumesAdminNegativeTest-183273606 None] Lock "cinder-c6c2bc19-1295-43e1-834c-30ab48d4e5f7-delete_volume" released by "delete_volume" :: held 6.535s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:20 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=9,cinder:UPDATE=11,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:08:20 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-18ec898e-33d8-4c13-9db3-cc90726a87f2 tempest-ServersNegativeTestJSON-907254977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-18ec898e-33d8-4c13-9db3-cc90726a87f2 tempest-ServersNegativeTestJSON-907254977 None] Flow 'volume_create_manager' (4beaa64a-e87c-4e69-afdd-82ed43f8d543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-18ec898e-33d8-4c13-9db3-cc90726a87f2 tempest-ServersNegativeTestJSON-907254977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0090a32-40b1-4dd4-87cf-42c5dc4edd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-18ec898e-33d8-4c13-9db3-cc90726a87f2 tempest-ServersNegativeTestJSON-907254977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0090a32-40b1-4dd4-87cf-42c5dc4edd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1260027452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce3a172-6581-4c72-84b2-8f9fb35aa6d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47c8cdaad60745e9933b326fa8cff9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:21Z,use_quota=True,user_id='747b5ca778ac44eb8c9924a4f2e49c58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-18ec898e-33d8-4c13-9db3-cc90726a87f2 tempest-ServersNegativeTestJSON-907254977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5be790af-de37-42ff-bb49-907501b6df38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-18ec898e-33d8-4c13-9db3-cc90726a87f2 tempest-ServersNegativeTestJSON-907254977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5be790af-de37-42ff-bb49-907501b6df38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-18ec898e-33d8-4c13-9db3-cc90726a87f2 tempest-ServersNegativeTestJSON-907254977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (932ee16e-dc7a-4a74-bcfb-70fcd51072ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-18ec898e-33d8-4c13-9db3-cc90726a87f2 tempest-ServersNegativeTestJSON-907254977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (932ee16e-dc7a-4a74-bcfb-70fcd51072ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ce3a172-6581-4c72-84b2-8f9fb35aa6d0', 'volume_name': 'volume-6ce3a172-6581-4c72-84b2-8f9fb35aa6d0', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-18ec898e-33d8-4c13-9db3-cc90726a87f2 tempest-ServersNegativeTestJSON-907254977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6019b30-507f-4a78-a3c3-12a70e9cbaf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-18ec898e-33d8-4c13-9db3-cc90726a87f2 tempest-ServersNegativeTestJSON-907254977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6019b30-507f-4a78-a3c3-12a70e9cbaf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-18ec898e-33d8-4c13-9db3-cc90726a87f2 tempest-ServersNegativeTestJSON-907254977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44b3b2e1-a3b3-4931-a4c5-fee68bd61a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:21 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-18ec898e-33d8-4c13-9db3-cc90726a87f2 tempest-ServersNegativeTestJSON-907254977 None] Volume 6ce3a172-6581-4c72-84b2-8f9fb35aa6d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ce3a172-6581-4c72-84b2-8f9fb35aa6d0', 'volume_size': 1} Sep 28 17:08:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-18ec898e-33d8-4c13-9db3-cc90726a87f2 tempest-ServersNegativeTestJSON-907254977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-18ec898e-33d8-4c13-9db3-cc90726a87f2 tempest-ServersNegativeTestJSON-907254977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:21 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-18ec898e-33d8-4c13-9db3-cc90726a87f2 tempest-ServersNegativeTestJSON-907254977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1260027452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce3a172-6581-4c72-84b2-8f9fb35aa6d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47c8cdaad60745e9933b326fa8cff9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:21Z,use_quota=True,user_id='747b5ca778ac44eb8c9924a4f2e49c58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:21 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-18ec898e-33d8-4c13-9db3-cc90726a87f2 tempest-ServersNegativeTestJSON-907254977 None] Creating volume 6ce3a172-6581-4c72-84b2-8f9fb35aa6d0 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-18ec898e-33d8-4c13-9db3-cc90726a87f2 tempest-ServersNegativeTestJSON-907254977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-18ec898e-33d8-4c13-9db3-cc90726a87f2 tempest-ServersNegativeTestJSON-907254977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:21 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-18ec898e-33d8-4c13-9db3-cc90726a87f2 tempest-ServersNegativeTestJSON-907254977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:21 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-18ec898e-33d8-4c13-9db3-cc90726a87f2 tempest-ServersNegativeTestJSON-907254977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-18ec898e-33d8-4c13-9db3-cc90726a87f2 tempest-ServersNegativeTestJSON-907254977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:21 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-18ec898e-33d8-4c13-9db3-cc90726a87f2 tempest-ServersNegativeTestJSON-907254977 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:21 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-18ec898e-33d8-4c13-9db3-cc90726a87f2 tempest-ServersNegativeTestJSON-907254977 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:08:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-18ec898e-33d8-4c13-9db3-cc90726a87f2 tempest-ServersNegativeTestJSON-907254977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6ce3a172-6581-4c72-84b2-8f9fb35aa6d0 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:21 devstack sudo[88396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6ce3a172-6581-4c72-84b2-8f9fb35aa6d0 1073741824 Sep 28 17:08:21 devstack sudo[88396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:21 devstack sudo[88396]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-18ec898e-33d8-4c13-9db3-cc90726a87f2 tempest-ServersNegativeTestJSON-907254977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6ce3a172-6581-4c72-84b2-8f9fb35aa6d0 1073741824" returned: 0 in 0.819s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-18ec898e-33d8-4c13-9db3-cc90726a87f2 tempest-ServersNegativeTestJSON-907254977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6ce3a172-6581-4c72-84b2-8f9fb35aa6d0 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:22 devstack sudo[88402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6ce3a172-6581-4c72-84b2-8f9fb35aa6d0 Sep 28 17:08:22 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:22 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-18ec898e-33d8-4c13-9db3-cc90726a87f2 tempest-ServersNegativeTestJSON-907254977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6ce3a172-6581-4c72-84b2-8f9fb35aa6d0" returned: 0 in 0.684s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:22 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-18ec898e-33d8-4c13-9db3-cc90726a87f2 tempest-ServersNegativeTestJSON-907254977 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-18ec898e-33d8-4c13-9db3-cc90726a87f2 tempest-ServersNegativeTestJSON-907254977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-18ec898e-33d8-4c13-9db3-cc90726a87f2 tempest-ServersNegativeTestJSON-907254977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44b3b2e1-a3b3-4931-a4c5-fee68bd61a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ce3a172-6581-4c72-84b2-8f9fb35aa6d0', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-18ec898e-33d8-4c13-9db3-cc90726a87f2 tempest-ServersNegativeTestJSON-907254977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e33a3e3-1e4b-4af0-b750-3a2a4b3c6d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:22 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc4c9ff1-e987-43bb-9d1e-9e7dd8eab2db tempest-ServerActionsTestOtherA-1979217729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dc4c9ff1-e987-43bb-9d1e-9e7dd8eab2db tempest-ServerActionsTestOtherA-1979217729 None] Flow 'volume_create_manager' (701ca36d-0c16-4a53-bb8b-a129619cad06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dc4c9ff1-e987-43bb-9d1e-9e7dd8eab2db tempest-ServerActionsTestOtherA-1979217729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44cb90f-fdb2-439e-a448-06233655bd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dc4c9ff1-e987-43bb-9d1e-9e7dd8eab2db tempest-ServerActionsTestOtherA-1979217729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44cb90f-fdb2-439e-a448-06233655bd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2033002160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc22351f-4995-410e-9a2d-6b8377a22234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f2df8aa6f2a422bb66da214ea0c183b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:23Z,use_quota=True,user_id='e56c2c9a8d4f4b85adc91cb1a1777784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dc4c9ff1-e987-43bb-9d1e-9e7dd8eab2db tempest-ServerActionsTestOtherA-1979217729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc29cc56-c85c-4884-b1a4-c009dedd1265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dc4c9ff1-e987-43bb-9d1e-9e7dd8eab2db tempest-ServerActionsTestOtherA-1979217729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc29cc56-c85c-4884-b1a4-c009dedd1265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dc4c9ff1-e987-43bb-9d1e-9e7dd8eab2db tempest-ServerActionsTestOtherA-1979217729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caef43fe-5d8d-4d24-a8e3-c439f0bfde2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dc4c9ff1-e987-43bb-9d1e-9e7dd8eab2db tempest-ServerActionsTestOtherA-1979217729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caef43fe-5d8d-4d24-a8e3-c439f0bfde2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc22351f-4995-410e-9a2d-6b8377a22234', 'volume_name': 'volume-dc22351f-4995-410e-9a2d-6b8377a22234', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dc4c9ff1-e987-43bb-9d1e-9e7dd8eab2db tempest-ServerActionsTestOtherA-1979217729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc2862c-4642-4290-9bce-1598d5d007df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dc4c9ff1-e987-43bb-9d1e-9e7dd8eab2db tempest-ServerActionsTestOtherA-1979217729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc2862c-4642-4290-9bce-1598d5d007df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dc4c9ff1-e987-43bb-9d1e-9e7dd8eab2db tempest-ServerActionsTestOtherA-1979217729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1bacda3-0856-485c-a075-bf19c044a36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:23 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-dc4c9ff1-e987-43bb-9d1e-9e7dd8eab2db tempest-ServerActionsTestOtherA-1979217729 None] Volume dc22351f-4995-410e-9a2d-6b8377a22234: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc22351f-4995-410e-9a2d-6b8377a22234', 'volume_size': 1} Sep 28 17:08:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-dc4c9ff1-e987-43bb-9d1e-9e7dd8eab2db tempest-ServerActionsTestOtherA-1979217729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-dc4c9ff1-e987-43bb-9d1e-9e7dd8eab2db tempest-ServerActionsTestOtherA-1979217729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:23 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-dc4c9ff1-e987-43bb-9d1e-9e7dd8eab2db tempest-ServerActionsTestOtherA-1979217729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2033002160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc22351f-4995-410e-9a2d-6b8377a22234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f2df8aa6f2a422bb66da214ea0c183b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:23Z,use_quota=True,user_id='e56c2c9a8d4f4b85adc91cb1a1777784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:23 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-dc4c9ff1-e987-43bb-9d1e-9e7dd8eab2db tempest-ServerActionsTestOtherA-1979217729 None] Creating volume dc22351f-4995-410e-9a2d-6b8377a22234 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-dc4c9ff1-e987-43bb-9d1e-9e7dd8eab2db tempest-ServerActionsTestOtherA-1979217729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-dc4c9ff1-e987-43bb-9d1e-9e7dd8eab2db tempest-ServerActionsTestOtherA-1979217729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:23 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-dc4c9ff1-e987-43bb-9d1e-9e7dd8eab2db tempest-ServerActionsTestOtherA-1979217729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:23 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-dc4c9ff1-e987-43bb-9d1e-9e7dd8eab2db tempest-ServerActionsTestOtherA-1979217729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-dc4c9ff1-e987-43bb-9d1e-9e7dd8eab2db tempest-ServerActionsTestOtherA-1979217729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:23 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-dc4c9ff1-e987-43bb-9d1e-9e7dd8eab2db tempest-ServerActionsTestOtherA-1979217729 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:23 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-dc4c9ff1-e987-43bb-9d1e-9e7dd8eab2db tempest-ServerActionsTestOtherA-1979217729 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:08:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-dc4c9ff1-e987-43bb-9d1e-9e7dd8eab2db tempest-ServerActionsTestOtherA-1979217729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc22351f-4995-410e-9a2d-6b8377a22234 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:23 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-18ec898e-33d8-4c13-9db3-cc90726a87f2 tempest-ServersNegativeTestJSON-907254977 None] Volume volume-6ce3a172-6581-4c72-84b2-8f9fb35aa6d0 (6ce3a172-6581-4c72-84b2-8f9fb35aa6d0): created successfully Sep 28 17:08:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-18ec898e-33d8-4c13-9db3-cc90726a87f2 tempest-ServersNegativeTestJSON-907254977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e33a3e3-1e4b-4af0-b750-3a2a4b3c6d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-18ec898e-33d8-4c13-9db3-cc90726a87f2 tempest-ServersNegativeTestJSON-907254977 None] Flow 'volume_create_manager' (4beaa64a-e87c-4e69-afdd-82ed43f8d543) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:23 devstack sudo[88406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc22351f-4995-410e-9a2d-6b8377a22234 1073741824 Sep 28 17:08:23 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-18ec898e-33d8-4c13-9db3-cc90726a87f2 tempest-ServersNegativeTestJSON-907254977 None] Created volume successfully. Sep 28 17:08:23 devstack sudo[88406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:23 devstack sudo[88406]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-dc4c9ff1-e987-43bb-9d1e-9e7dd8eab2db tempest-ServerActionsTestOtherA-1979217729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc22351f-4995-410e-9a2d-6b8377a22234 1073741824" returned: 0 in 0.803s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-dc4c9ff1-e987-43bb-9d1e-9e7dd8eab2db tempest-ServerActionsTestOtherA-1979217729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc22351f-4995-410e-9a2d-6b8377a22234 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:24 devstack sudo[88412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc22351f-4995-410e-9a2d-6b8377a22234 Sep 28 17:08:24 devstack sudo[88412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:24 devstack sudo[88412]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-dc4c9ff1-e987-43bb-9d1e-9e7dd8eab2db tempest-ServerActionsTestOtherA-1979217729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc22351f-4995-410e-9a2d-6b8377a22234" returned: 0 in 0.539s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-dc4c9ff1-e987-43bb-9d1e-9e7dd8eab2db tempest-ServerActionsTestOtherA-1979217729 None] <== create_volume: return (1409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-dc4c9ff1-e987-43bb-9d1e-9e7dd8eab2db tempest-ServerActionsTestOtherA-1979217729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dc4c9ff1-e987-43bb-9d1e-9e7dd8eab2db tempest-ServerActionsTestOtherA-1979217729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1bacda3-0856-485c-a075-bf19c044a36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc22351f-4995-410e-9a2d-6b8377a22234', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dc4c9ff1-e987-43bb-9d1e-9e7dd8eab2db tempest-ServerActionsTestOtherA-1979217729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (716517a8-fd21-441d-81f1-f15a9ed30e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:24 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-dc4c9ff1-e987-43bb-9d1e-9e7dd8eab2db tempest-ServerActionsTestOtherA-1979217729 None] Volume volume-dc22351f-4995-410e-9a2d-6b8377a22234 (dc22351f-4995-410e-9a2d-6b8377a22234): created successfully Sep 28 17:08:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dc4c9ff1-e987-43bb-9d1e-9e7dd8eab2db tempest-ServerActionsTestOtherA-1979217729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (716517a8-fd21-441d-81f1-f15a9ed30e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dc4c9ff1-e987-43bb-9d1e-9e7dd8eab2db tempest-ServerActionsTestOtherA-1979217729 None] Flow 'volume_create_manager' (701ca36d-0c16-4a53-bb8b-a129619cad06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:24 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-dc4c9ff1-e987-43bb-9d1e-9e7dd8eab2db tempest-ServerActionsTestOtherA-1979217729 None] Created volume successfully. Sep 28 17:08:32 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7c74779-f7c6-4ca9-b3da-e990d11ab071 tempest-ServersNegativeTestJSON-907254977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a7c74779-f7c6-4ca9-b3da-e990d11ab071 tempest-ServersNegativeTestJSON-907254977 None] Flow 'volume_create_manager' (37ca4a20-14d9-4398-8796-46b9c5d2ef66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a7c74779-f7c6-4ca9-b3da-e990d11ab071 tempest-ServersNegativeTestJSON-907254977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d421f9c3-ee61-4ad8-9969-7f7ba43d092c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a7c74779-f7c6-4ca9-b3da-e990d11ab071 tempest-ServersNegativeTestJSON-907254977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d421f9c3-ee61-4ad8-9969-7f7ba43d092c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-954506298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48a576d5-9a0f-4366-9ee7-eb0e8e47352a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47c8cdaad60745e9933b326fa8cff9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:32Z,use_quota=True,user_id='747b5ca778ac44eb8c9924a4f2e49c58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a7c74779-f7c6-4ca9-b3da-e990d11ab071 tempest-ServersNegativeTestJSON-907254977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd27acf-8442-4925-8d0d-0798cbae0e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a7c74779-f7c6-4ca9-b3da-e990d11ab071 tempest-ServersNegativeTestJSON-907254977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd27acf-8442-4925-8d0d-0798cbae0e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a7c74779-f7c6-4ca9-b3da-e990d11ab071 tempest-ServersNegativeTestJSON-907254977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed7684e9-ea3e-49d7-a17c-473ad8cee6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a7c74779-f7c6-4ca9-b3da-e990d11ab071 tempest-ServersNegativeTestJSON-907254977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed7684e9-ea3e-49d7-a17c-473ad8cee6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48a576d5-9a0f-4366-9ee7-eb0e8e47352a', 'volume_name': 'volume-48a576d5-9a0f-4366-9ee7-eb0e8e47352a', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a7c74779-f7c6-4ca9-b3da-e990d11ab071 tempest-ServersNegativeTestJSON-907254977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (964cfdb6-3245-4a04-a220-e1d0be0eea15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a7c74779-f7c6-4ca9-b3da-e990d11ab071 tempest-ServersNegativeTestJSON-907254977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (964cfdb6-3245-4a04-a220-e1d0be0eea15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a7c74779-f7c6-4ca9-b3da-e990d11ab071 tempest-ServersNegativeTestJSON-907254977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70b44564-fc79-40b4-ac2c-62c45e8b1d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:32 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-a7c74779-f7c6-4ca9-b3da-e990d11ab071 tempest-ServersNegativeTestJSON-907254977 None] Volume 48a576d5-9a0f-4366-9ee7-eb0e8e47352a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48a576d5-9a0f-4366-9ee7-eb0e8e47352a', 'volume_size': 1} Sep 28 17:08:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a7c74779-f7c6-4ca9-b3da-e990d11ab071 tempest-ServersNegativeTestJSON-907254977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a7c74779-f7c6-4ca9-b3da-e990d11ab071 tempest-ServersNegativeTestJSON-907254977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a7c74779-f7c6-4ca9-b3da-e990d11ab071 tempest-ServersNegativeTestJSON-907254977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-954506298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48a576d5-9a0f-4366-9ee7-eb0e8e47352a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47c8cdaad60745e9933b326fa8cff9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:32Z,use_quota=True,user_id='747b5ca778ac44eb8c9924a4f2e49c58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-a7c74779-f7c6-4ca9-b3da-e990d11ab071 tempest-ServersNegativeTestJSON-907254977 None] Creating volume 48a576d5-9a0f-4366-9ee7-eb0e8e47352a {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a7c74779-f7c6-4ca9-b3da-e990d11ab071 tempest-ServersNegativeTestJSON-907254977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a7c74779-f7c6-4ca9-b3da-e990d11ab071 tempest-ServersNegativeTestJSON-907254977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a7c74779-f7c6-4ca9-b3da-e990d11ab071 tempest-ServersNegativeTestJSON-907254977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a7c74779-f7c6-4ca9-b3da-e990d11ab071 tempest-ServersNegativeTestJSON-907254977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a7c74779-f7c6-4ca9-b3da-e990d11ab071 tempest-ServersNegativeTestJSON-907254977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a7c74779-f7c6-4ca9-b3da-e990d11ab071 tempest-ServersNegativeTestJSON-907254977 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:32 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-a7c74779-f7c6-4ca9-b3da-e990d11ab071 tempest-ServersNegativeTestJSON-907254977 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:08:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a7c74779-f7c6-4ca9-b3da-e990d11ab071 tempest-ServersNegativeTestJSON-907254977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48a576d5-9a0f-4366-9ee7-eb0e8e47352a 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:32 devstack sudo[88421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48a576d5-9a0f-4366-9ee7-eb0e8e47352a 1073741824 Sep 28 17:08:32 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:33 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a7c74779-f7c6-4ca9-b3da-e990d11ab071 tempest-ServersNegativeTestJSON-907254977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48a576d5-9a0f-4366-9ee7-eb0e8e47352a 1073741824" returned: 0 in 0.780s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a7c74779-f7c6-4ca9-b3da-e990d11ab071 tempest-ServersNegativeTestJSON-907254977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48a576d5-9a0f-4366-9ee7-eb0e8e47352a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:33 devstack sudo[88429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48a576d5-9a0f-4366-9ee7-eb0e8e47352a Sep 28 17:08:33 devstack sudo[88429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:33 devstack sudo[88429]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a7c74779-f7c6-4ca9-b3da-e990d11ab071 tempest-ServersNegativeTestJSON-907254977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48a576d5-9a0f-4366-9ee7-eb0e8e47352a" returned: 0 in 0.421s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:33 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a7c74779-f7c6-4ca9-b3da-e990d11ab071 tempest-ServersNegativeTestJSON-907254977 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a7c74779-f7c6-4ca9-b3da-e990d11ab071 tempest-ServersNegativeTestJSON-907254977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:33 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a7c74779-f7c6-4ca9-b3da-e990d11ab071 tempest-ServersNegativeTestJSON-907254977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70b44564-fc79-40b4-ac2c-62c45e8b1d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48a576d5-9a0f-4366-9ee7-eb0e8e47352a', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:33 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a7c74779-f7c6-4ca9-b3da-e990d11ab071 tempest-ServersNegativeTestJSON-907254977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d713902-c2c6-4efb-83b7-5ed2b7c5b7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:34 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-a7c74779-f7c6-4ca9-b3da-e990d11ab071 tempest-ServersNegativeTestJSON-907254977 None] Volume volume-48a576d5-9a0f-4366-9ee7-eb0e8e47352a (48a576d5-9a0f-4366-9ee7-eb0e8e47352a): created successfully Sep 28 17:08:34 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a7c74779-f7c6-4ca9-b3da-e990d11ab071 tempest-ServersNegativeTestJSON-907254977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d713902-c2c6-4efb-83b7-5ed2b7c5b7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:34 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a7c74779-f7c6-4ca9-b3da-e990d11ab071 tempest-ServersNegativeTestJSON-907254977 None] Flow 'volume_create_manager' (37ca4a20-14d9-4398-8796-46b9c5d2ef66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:34 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-a7c74779-f7c6-4ca9-b3da-e990d11ab071 tempest-ServersNegativeTestJSON-907254977 None] Created volume successfully. Sep 28 17:08:38 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0f7aa144-8781-4230-9767-d470792b4e18 tempest-ServersNegativeTestJSON-907254977 None] Acquiring lock "cinder-48a576d5-9a0f-4366-9ee7-eb0e8e47352a-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:38 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0f7aa144-8781-4230-9767-d470792b4e18 tempest-ServersNegativeTestJSON-907254977 None] Lock "cinder-48a576d5-9a0f-4366-9ee7-eb0e8e47352a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:38 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0f7aa144-8781-4230-9767-d470792b4e18 tempest-ServersNegativeTestJSON-907254977 None] Acquiring lock "cinder-quobyte-48a576d5-9a0f-4366-9ee7-eb0e8e47352a" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:38 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0f7aa144-8781-4230-9767-d470792b4e18 tempest-ServersNegativeTestJSON-907254977 None] Lock "cinder-quobyte-48a576d5-9a0f-4366-9ee7-eb0e8e47352a" acquired by "delete_volume" :: waited 0.033s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:38 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3286cebc-6c75-4091-aef1-fc26eacd8dc6]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0f7aa144-8781-4230-9767-d470792b4e18 tempest-ServersNegativeTestJSON-907254977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48a576d5-9a0f-4366-9ee7-eb0e8e47352a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:38 devstack sudo[88432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48a576d5-9a0f-4366-9ee7-eb0e8e47352a Sep 28 17:08:38 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:39 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0f7aa144-8781-4230-9767-d470792b4e18 tempest-ServersNegativeTestJSON-907254977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48a576d5-9a0f-4366-9ee7-eb0e8e47352a" returned: 0 in 0.763s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0f7aa144-8781-4230-9767-d470792b4e18 tempest-ServersNegativeTestJSON-907254977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48a576d5-9a0f-4366-9ee7-eb0e8e47352a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:39 devstack sudo[88441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48a576d5-9a0f-4366-9ee7-eb0e8e47352a Sep 28 17:08:39 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:39 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0f7aa144-8781-4230-9767-d470792b4e18 tempest-ServersNegativeTestJSON-907254977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48a576d5-9a0f-4366-9ee7-eb0e8e47352a" returned: 0 in 0.547s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:39 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0f7aa144-8781-4230-9767-d470792b4e18 tempest-ServersNegativeTestJSON-907254977 None] Lock "cinder-quobyte-48a576d5-9a0f-4366-9ee7-eb0e8e47352a" released by "delete_volume" :: held 1.410s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:39 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-0f7aa144-8781-4230-9767-d470792b4e18 tempest-ServersNegativeTestJSON-907254977 None] Created reservations ['bf5ce14d-706d-42a9-a66e-ee85670c16b0', 'c1b19aeb-90c5-4f78-82e7-51fe8e32b24e', '7b85d7b7-899b-4204-becc-3fb2d7c23992', '8615e85f-95d9-4179-bd58-7de80e31d64c'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0f7aa144-8781-4230-9767-d470792b4e18 tempest-ServersNegativeTestJSON-907254977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0f7aa144-8781-4230-9767-d470792b4e18 tempest-ServersNegativeTestJSON-907254977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:39 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0f7aa144-8781-4230-9767-d470792b4e18 tempest-ServersNegativeTestJSON-907254977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:39 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0f7aa144-8781-4230-9767-d470792b4e18 tempest-ServersNegativeTestJSON-907254977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0f7aa144-8781-4230-9767-d470792b4e18 tempest-ServersNegativeTestJSON-907254977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0f7aa144-8781-4230-9767-d470792b4e18 tempest-ServersNegativeTestJSON-907254977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:39 devstack sudo[88448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:08:39 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:40 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0f7aa144-8781-4230-9767-d470792b4e18 tempest-ServersNegativeTestJSON-907254977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.489s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:40 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-0f7aa144-8781-4230-9767-d470792b4e18 tempest-ServersNegativeTestJSON-907254977 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:40 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-0f7aa144-8781-4230-9767-d470792b4e18 tempest-ServersNegativeTestJSON-907254977 None] Deleted volume successfully. Sep 28 17:08:40 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0f7aa144-8781-4230-9767-d470792b4e18 tempest-ServersNegativeTestJSON-907254977 None] Lock "cinder-48a576d5-9a0f-4366-9ee7-eb0e8e47352a-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:40 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f3363dd6-3512-4fd7-8488-ee82fb50d14d tempest-ServersNegativeTestJSON-907254977 None] Acquiring lock "cinder-6ce3a172-6581-4c72-84b2-8f9fb35aa6d0-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:40 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f3363dd6-3512-4fd7-8488-ee82fb50d14d tempest-ServersNegativeTestJSON-907254977 None] Lock "cinder-6ce3a172-6581-4c72-84b2-8f9fb35aa6d0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:40 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f3363dd6-3512-4fd7-8488-ee82fb50d14d tempest-ServersNegativeTestJSON-907254977 None] Acquiring lock "cinder-quobyte-6ce3a172-6581-4c72-84b2-8f9fb35aa6d0" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:40 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f3363dd6-3512-4fd7-8488-ee82fb50d14d tempest-ServersNegativeTestJSON-907254977 None] Lock "cinder-quobyte-6ce3a172-6581-4c72-84b2-8f9fb35aa6d0" acquired by "delete_volume" :: waited 0.040s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:40 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1192a14-9c5f-423a-b890-8bb4b65c2734]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f3363dd6-3512-4fd7-8488-ee82fb50d14d tempest-ServersNegativeTestJSON-907254977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6ce3a172-6581-4c72-84b2-8f9fb35aa6d0 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:40 devstack sudo[88451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6ce3a172-6581-4c72-84b2-8f9fb35aa6d0 Sep 28 17:08:40 devstack sudo[88451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:41 devstack sudo[88451]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f3363dd6-3512-4fd7-8488-ee82fb50d14d tempest-ServersNegativeTestJSON-907254977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6ce3a172-6581-4c72-84b2-8f9fb35aa6d0" returned: 0 in 0.646s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f3363dd6-3512-4fd7-8488-ee82fb50d14d tempest-ServersNegativeTestJSON-907254977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6ce3a172-6581-4c72-84b2-8f9fb35aa6d0 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:41 devstack sudo[88458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6ce3a172-6581-4c72-84b2-8f9fb35aa6d0 Sep 28 17:08:41 devstack sudo[88458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:42 devstack sudo[88458]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f3363dd6-3512-4fd7-8488-ee82fb50d14d tempest-ServersNegativeTestJSON-907254977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6ce3a172-6581-4c72-84b2-8f9fb35aa6d0" returned: 0 in 0.614s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:42 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f3363dd6-3512-4fd7-8488-ee82fb50d14d tempest-ServersNegativeTestJSON-907254977 None] Lock "cinder-quobyte-6ce3a172-6581-4c72-84b2-8f9fb35aa6d0" released by "delete_volume" :: held 1.330s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:42 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-f3363dd6-3512-4fd7-8488-ee82fb50d14d tempest-ServersNegativeTestJSON-907254977 None] Created reservations ['453ebfab-07de-4fb6-8c94-95d3c35706fe', '14b7c77d-0a6c-48fe-9080-904e03ecfb89', '0aa56c86-df0a-418b-bc06-23810dc124e8', '7886fc55-555e-4258-87b6-da175cb7d1bb'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f3363dd6-3512-4fd7-8488-ee82fb50d14d tempest-ServersNegativeTestJSON-907254977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f3363dd6-3512-4fd7-8488-ee82fb50d14d tempest-ServersNegativeTestJSON-907254977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:42 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f3363dd6-3512-4fd7-8488-ee82fb50d14d tempest-ServersNegativeTestJSON-907254977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:42 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f3363dd6-3512-4fd7-8488-ee82fb50d14d tempest-ServersNegativeTestJSON-907254977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f3363dd6-3512-4fd7-8488-ee82fb50d14d tempest-ServersNegativeTestJSON-907254977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f3363dd6-3512-4fd7-8488-ee82fb50d14d tempest-ServersNegativeTestJSON-907254977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:42 devstack sudo[88467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:08:42 devstack sudo[88467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:42 devstack sudo[88467]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f3363dd6-3512-4fd7-8488-ee82fb50d14d tempest-ServersNegativeTestJSON-907254977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.412s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:42 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-f3363dd6-3512-4fd7-8488-ee82fb50d14d tempest-ServersNegativeTestJSON-907254977 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:42 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-f3363dd6-3512-4fd7-8488-ee82fb50d14d tempest-ServersNegativeTestJSON-907254977 None] Deleted volume successfully. Sep 28 17:08:42 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f3363dd6-3512-4fd7-8488-ee82fb50d14d tempest-ServersNegativeTestJSON-907254977 None] Lock "cinder-6ce3a172-6581-4c72-84b2-8f9fb35aa6d0-delete_volume" released by "delete_volume" :: held 2.158s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:08:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:49 devstack sudo[88515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:08:49 devstack sudo[88515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:49 devstack sudo[88515]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.458s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:49 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:52 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:UPDATE=32,cinder:SELECT=14,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:08:52 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=24,cinder:UPDATE=30,cinder:INSERT=8,cinder:DELETE=5 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:09:00 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-219275ae-35be-4706-b82c-4c66a2a92e81 tempest-TaggedAttachmentsTest-1248553864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:09:00 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-219275ae-35be-4706-b82c-4c66a2a92e81 tempest-TaggedAttachmentsTest-1248553864 None] Flow 'volume_create_manager' (a1df4f29-796f-4f42-a42a-ab3db373cf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:00 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-219275ae-35be-4706-b82c-4c66a2a92e81 tempest-TaggedAttachmentsTest-1248553864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2320a4b-018d-44e1-9df7-3a9937afd0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:00 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-219275ae-35be-4706-b82c-4c66a2a92e81 tempest-TaggedAttachmentsTest-1248553864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2320a4b-018d-44e1-9df7-3a9937afd0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1249396698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3094602-735a-4989-9ba6-64fbd555d509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87fb1714549b47cd90123af3d92912d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:01Z,use_quota=True,user_id='599f92c2ad6b44b28ab22296f198e2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-219275ae-35be-4706-b82c-4c66a2a92e81 tempest-TaggedAttachmentsTest-1248553864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc563649-1160-46a8-bd97-a70c4641465e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-219275ae-35be-4706-b82c-4c66a2a92e81 tempest-TaggedAttachmentsTest-1248553864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc563649-1160-46a8-bd97-a70c4641465e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-219275ae-35be-4706-b82c-4c66a2a92e81 tempest-TaggedAttachmentsTest-1248553864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2bc9df0-cb71-4a75-ba94-fafbf01c942c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-219275ae-35be-4706-b82c-4c66a2a92e81 tempest-TaggedAttachmentsTest-1248553864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2bc9df0-cb71-4a75-ba94-fafbf01c942c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3094602-735a-4989-9ba6-64fbd555d509', 'volume_name': 'volume-e3094602-735a-4989-9ba6-64fbd555d509', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-219275ae-35be-4706-b82c-4c66a2a92e81 tempest-TaggedAttachmentsTest-1248553864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77c5516-078d-4ee9-8564-c0b2ba72441b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-219275ae-35be-4706-b82c-4c66a2a92e81 tempest-TaggedAttachmentsTest-1248553864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77c5516-078d-4ee9-8564-c0b2ba72441b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-219275ae-35be-4706-b82c-4c66a2a92e81 tempest-TaggedAttachmentsTest-1248553864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e4667a2-0cbe-4281-8d54-1a20185101c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:01 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-219275ae-35be-4706-b82c-4c66a2a92e81 tempest-TaggedAttachmentsTest-1248553864 None] Volume e3094602-735a-4989-9ba6-64fbd555d509: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3094602-735a-4989-9ba6-64fbd555d509', 'volume_size': 1} Sep 28 17:09:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-219275ae-35be-4706-b82c-4c66a2a92e81 tempest-TaggedAttachmentsTest-1248553864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-219275ae-35be-4706-b82c-4c66a2a92e81 tempest-TaggedAttachmentsTest-1248553864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:01 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-219275ae-35be-4706-b82c-4c66a2a92e81 tempest-TaggedAttachmentsTest-1248553864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1249396698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3094602-735a-4989-9ba6-64fbd555d509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87fb1714549b47cd90123af3d92912d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:01Z,use_quota=True,user_id='599f92c2ad6b44b28ab22296f198e2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:09:01 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-219275ae-35be-4706-b82c-4c66a2a92e81 tempest-TaggedAttachmentsTest-1248553864 None] Creating volume e3094602-735a-4989-9ba6-64fbd555d509 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:09:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-219275ae-35be-4706-b82c-4c66a2a92e81 tempest-TaggedAttachmentsTest-1248553864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-219275ae-35be-4706-b82c-4c66a2a92e81 tempest-TaggedAttachmentsTest-1248553864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:01 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-219275ae-35be-4706-b82c-4c66a2a92e81 tempest-TaggedAttachmentsTest-1248553864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:01 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-219275ae-35be-4706-b82c-4c66a2a92e81 tempest-TaggedAttachmentsTest-1248553864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-219275ae-35be-4706-b82c-4c66a2a92e81 tempest-TaggedAttachmentsTest-1248553864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:01 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-219275ae-35be-4706-b82c-4c66a2a92e81 tempest-TaggedAttachmentsTest-1248553864 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:09:01 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-219275ae-35be-4706-b82c-4c66a2a92e81 tempest-TaggedAttachmentsTest-1248553864 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:09:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-219275ae-35be-4706-b82c-4c66a2a92e81 tempest-TaggedAttachmentsTest-1248553864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e3094602-735a-4989-9ba6-64fbd555d509 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:01 devstack sudo[88586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e3094602-735a-4989-9ba6-64fbd555d509 1073741824 Sep 28 17:09:01 devstack sudo[88586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:01 devstack sudo[88586]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-219275ae-35be-4706-b82c-4c66a2a92e81 tempest-TaggedAttachmentsTest-1248553864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e3094602-735a-4989-9ba6-64fbd555d509 1073741824" returned: 0 in 0.776s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-219275ae-35be-4706-b82c-4c66a2a92e81 tempest-TaggedAttachmentsTest-1248553864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e3094602-735a-4989-9ba6-64fbd555d509 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:01 devstack sudo[88592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e3094602-735a-4989-9ba6-64fbd555d509 Sep 28 17:09:01 devstack sudo[88592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:02 devstack sudo[88592]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-219275ae-35be-4706-b82c-4c66a2a92e81 tempest-TaggedAttachmentsTest-1248553864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e3094602-735a-4989-9ba6-64fbd555d509" returned: 0 in 0.504s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:02 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-219275ae-35be-4706-b82c-4c66a2a92e81 tempest-TaggedAttachmentsTest-1248553864 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:09:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-219275ae-35be-4706-b82c-4c66a2a92e81 tempest-TaggedAttachmentsTest-1248553864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:02 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-219275ae-35be-4706-b82c-4c66a2a92e81 tempest-TaggedAttachmentsTest-1248553864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e4667a2-0cbe-4281-8d54-1a20185101c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3094602-735a-4989-9ba6-64fbd555d509', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:02 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-219275ae-35be-4706-b82c-4c66a2a92e81 tempest-TaggedAttachmentsTest-1248553864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c35d266-b050-44b9-819c-3b073a308a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:02 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-219275ae-35be-4706-b82c-4c66a2a92e81 tempest-TaggedAttachmentsTest-1248553864 None] Volume volume-e3094602-735a-4989-9ba6-64fbd555d509 (e3094602-735a-4989-9ba6-64fbd555d509): created successfully Sep 28 17:09:02 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-219275ae-35be-4706-b82c-4c66a2a92e81 tempest-TaggedAttachmentsTest-1248553864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c35d266-b050-44b9-819c-3b073a308a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:02 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-219275ae-35be-4706-b82c-4c66a2a92e81 tempest-TaggedAttachmentsTest-1248553864 None] Flow 'volume_create_manager' (a1df4f29-796f-4f42-a42a-ab3db373cf9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:02 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-219275ae-35be-4706-b82c-4c66a2a92e81 tempest-TaggedAttachmentsTest-1248553864 None] Created volume successfully. Sep 28 17:09:12 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:09:12 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:09:30 devstack cinder-volume[86917]: WARNING py.warnings [req-e2878a3b-8031-4160-8b76-7986cdb04e30 req-43a39580-bc98-4fe7-8fb2-25ec7926edad tempest-ServerActionsTestOtherA-1979217729 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 28 17:09:30 devstack cinder-volume[86917]: .first() Sep 28 17:09:30 devstack cinder-volume[86917]: Sep 28 17:09:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-e2878a3b-8031-4160-8b76-7986cdb04e30 req-43a39580-bc98-4fe7-8fb2-25ec7926edad tempest-ServerActionsTestOtherA-1979217729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-e2878a3b-8031-4160-8b76-7986cdb04e30 req-43a39580-bc98-4fe7-8fb2-25ec7926edad tempest-ServerActionsTestOtherA-1979217729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-e2878a3b-8031-4160-8b76-7986cdb04e30 req-43a39580-bc98-4fe7-8fb2-25ec7926edad tempest-ServerActionsTestOtherA-1979217729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-e2878a3b-8031-4160-8b76-7986cdb04e30 req-43a39580-bc98-4fe7-8fb2-25ec7926edad tempest-ServerActionsTestOtherA-1979217729 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069', 'name': 'volume-dc22351f-4995-410e-9a2d-6b8377a22234', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ff049c7d-bb53-448e-91cc-dd0bae6d8cd5', 'enforce_multipath': True} {{(pid=86917) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:09:30 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-e2878a3b-8031-4160-8b76-7986cdb04e30 req-43a39580-bc98-4fe7-8fb2-25ec7926edad tempest-ServerActionsTestOtherA-1979217729 None] attachment_update completed successfully. Sep 28 17:09:38 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-286ea325-2887-4977-bd17-522d1f43fd8e req-8ee01a6c-678d-4f81-ab6a-bbabc7e0aa8c tempest-ServerActionsTestOtherA-1979217729 None] Terminate volume connection completed successfully. Sep 28 17:09:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-286ea325-2887-4977-bd17-522d1f43fd8e req-8ee01a6c-678d-4f81-ab6a-bbabc7e0aa8c tempest-ServerActionsTestOtherA-1979217729 None] Deleting attachment ff049c7d-bb53-448e-91cc-dd0bae6d8cd5. {{(pid=86917) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:09:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-286ea325-2887-4977-bd17-522d1f43fd8e req-41f22f3f-1402-4cbf-ace0-cb4e62e468b8 tempest-ServerActionsTestOtherA-1979217729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-286ea325-2887-4977-bd17-522d1f43fd8e req-41f22f3f-1402-4cbf-ace0-cb4e62e468b8 tempest-ServerActionsTestOtherA-1979217729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-286ea325-2887-4977-bd17-522d1f43fd8e req-41f22f3f-1402-4cbf-ace0-cb4e62e468b8 tempest-ServerActionsTestOtherA-1979217729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.052s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:41 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-286ea325-2887-4977-bd17-522d1f43fd8e req-41f22f3f-1402-4cbf-ace0-cb4e62e468b8 tempest-ServerActionsTestOtherA-1979217729 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069', 'name': 'volume-dc22351f-4995-410e-9a2d-6b8377a22234', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6b3f7f9b-eb28-4caa-a2e3-beba06d50317', 'enforce_multipath': True} {{(pid=86917) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:09:41 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-286ea325-2887-4977-bd17-522d1f43fd8e req-41f22f3f-1402-4cbf-ace0-cb4e62e468b8 tempest-ServerActionsTestOtherA-1979217729 None] attachment_update completed successfully. Sep 28 17:09:48 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9c7b206-d2a1-4a10-a987-457700663c34 tempest-DeleteServersTestJSON-720701050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:09:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a9c7b206-d2a1-4a10-a987-457700663c34 tempest-DeleteServersTestJSON-720701050 None] Flow 'volume_create_manager' (3d5c4d8b-e972-4bee-9365-ff1791b83734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a9c7b206-d2a1-4a10-a987-457700663c34 tempest-DeleteServersTestJSON-720701050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9db30034-b535-4316-91c6-817b4f8a511c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a9c7b206-d2a1-4a10-a987-457700663c34 tempest-DeleteServersTestJSON-720701050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9db30034-b535-4316-91c6-817b4f8a511c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1146763828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51e0e2ee-8d70-4542-a69b-c3686cbf21ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21066dfc74b4412fb353a412bd1014ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:48Z,use_quota=True,user_id='4116bdf334584be6a686eec5ac24959a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a9c7b206-d2a1-4a10-a987-457700663c34 tempest-DeleteServersTestJSON-720701050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f695c4c2-ba56-472b-872c-c227693eb2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a9c7b206-d2a1-4a10-a987-457700663c34 tempest-DeleteServersTestJSON-720701050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f695c4c2-ba56-472b-872c-c227693eb2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a9c7b206-d2a1-4a10-a987-457700663c34 tempest-DeleteServersTestJSON-720701050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e59e69cc-9251-41a3-8c9a-6f0f46cc1155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a9c7b206-d2a1-4a10-a987-457700663c34 tempest-DeleteServersTestJSON-720701050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e59e69cc-9251-41a3-8c9a-6f0f46cc1155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51e0e2ee-8d70-4542-a69b-c3686cbf21ce', 'volume_name': 'volume-51e0e2ee-8d70-4542-a69b-c3686cbf21ce', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a9c7b206-d2a1-4a10-a987-457700663c34 tempest-DeleteServersTestJSON-720701050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b17f3e59-d0ef-45c9-b398-4b86e37d8760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a9c7b206-d2a1-4a10-a987-457700663c34 tempest-DeleteServersTestJSON-720701050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b17f3e59-d0ef-45c9-b398-4b86e37d8760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a9c7b206-d2a1-4a10-a987-457700663c34 tempest-DeleteServersTestJSON-720701050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e7a41b3-795c-4023-93ee-3b7ffea08812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:48 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-a9c7b206-d2a1-4a10-a987-457700663c34 tempest-DeleteServersTestJSON-720701050 None] Volume 51e0e2ee-8d70-4542-a69b-c3686cbf21ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51e0e2ee-8d70-4542-a69b-c3686cbf21ce', 'volume_size': 1} Sep 28 17:09:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a9c7b206-d2a1-4a10-a987-457700663c34 tempest-DeleteServersTestJSON-720701050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a9c7b206-d2a1-4a10-a987-457700663c34 tempest-DeleteServersTestJSON-720701050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:48 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a9c7b206-d2a1-4a10-a987-457700663c34 tempest-DeleteServersTestJSON-720701050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1146763828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51e0e2ee-8d70-4542-a69b-c3686cbf21ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21066dfc74b4412fb353a412bd1014ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:48Z,use_quota=True,user_id='4116bdf334584be6a686eec5ac24959a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:09:48 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-a9c7b206-d2a1-4a10-a987-457700663c34 tempest-DeleteServersTestJSON-720701050 None] Creating volume 51e0e2ee-8d70-4542-a69b-c3686cbf21ce {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:09:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a9c7b206-d2a1-4a10-a987-457700663c34 tempest-DeleteServersTestJSON-720701050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a9c7b206-d2a1-4a10-a987-457700663c34 tempest-DeleteServersTestJSON-720701050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:48 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a9c7b206-d2a1-4a10-a987-457700663c34 tempest-DeleteServersTestJSON-720701050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:48 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a9c7b206-d2a1-4a10-a987-457700663c34 tempest-DeleteServersTestJSON-720701050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a9c7b206-d2a1-4a10-a987-457700663c34 tempest-DeleteServersTestJSON-720701050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:48 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a9c7b206-d2a1-4a10-a987-457700663c34 tempest-DeleteServersTestJSON-720701050 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:09:48 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-a9c7b206-d2a1-4a10-a987-457700663c34 tempest-DeleteServersTestJSON-720701050 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:09:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a9c7b206-d2a1-4a10-a987-457700663c34 tempest-DeleteServersTestJSON-720701050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-51e0e2ee-8d70-4542-a69b-c3686cbf21ce 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:48 devstack sudo[89953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-51e0e2ee-8d70-4542-a69b-c3686cbf21ce 1073741824 Sep 28 17:09:48 devstack sudo[89953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:09:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:49 devstack sudo[89953]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a9c7b206-d2a1-4a10-a987-457700663c34 tempest-DeleteServersTestJSON-720701050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-51e0e2ee-8d70-4542-a69b-c3686cbf21ce 1073741824" returned: 0 in 1.077s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:49 devstack sudo[89970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:09:49 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a9c7b206-d2a1-4a10-a987-457700663c34 tempest-DeleteServersTestJSON-720701050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-51e0e2ee-8d70-4542-a69b-c3686cbf21ce {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:49 devstack sudo[89973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-51e0e2ee-8d70-4542-a69b-c3686cbf21ce Sep 28 17:09:49 devstack sudo[89973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:50 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.956s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:50 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:50 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager._thread_info {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:09:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread count: 8 {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:09:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread info: [<_MainThread(MainThread, started 132915553284224)>, , , , , , , ] {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:09:50 devstack sudo[89973]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a9c7b206-d2a1-4a10-a987-457700663c34 tempest-DeleteServersTestJSON-720701050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-51e0e2ee-8d70-4542-a69b-c3686cbf21ce" returned: 0 in 0.874s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:50 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a9c7b206-d2a1-4a10-a987-457700663c34 tempest-DeleteServersTestJSON-720701050 None] <== create_volume: return (2088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:09:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a9c7b206-d2a1-4a10-a987-457700663c34 tempest-DeleteServersTestJSON-720701050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.092s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a9c7b206-d2a1-4a10-a987-457700663c34 tempest-DeleteServersTestJSON-720701050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e7a41b3-795c-4023-93ee-3b7ffea08812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51e0e2ee-8d70-4542-a69b-c3686cbf21ce', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a9c7b206-d2a1-4a10-a987-457700663c34 tempest-DeleteServersTestJSON-720701050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9563066f-34d3-468e-898e-14f6cad97972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:50 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-a9c7b206-d2a1-4a10-a987-457700663c34 tempest-DeleteServersTestJSON-720701050 None] Volume volume-51e0e2ee-8d70-4542-a69b-c3686cbf21ce (51e0e2ee-8d70-4542-a69b-c3686cbf21ce): created successfully Sep 28 17:09:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a9c7b206-d2a1-4a10-a987-457700663c34 tempest-DeleteServersTestJSON-720701050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9563066f-34d3-468e-898e-14f6cad97972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a9c7b206-d2a1-4a10-a987-457700663c34 tempest-DeleteServersTestJSON-720701050 None] Flow 'volume_create_manager' (3d5c4d8b-e972-4bee-9365-ff1791b83734) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:50 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-a9c7b206-d2a1-4a10-a987-457700663c34 tempest-DeleteServersTestJSON-720701050 None] Created volume successfully. Sep 28 17:09:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-18863550-7308-45d9-a705-3955ebf1e633 req-604d0844-4c86-450f-828e-c08c0c3da979 tempest-DeleteServersTestJSON-720701050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-18863550-7308-45d9-a705-3955ebf1e633 req-604d0844-4c86-450f-828e-c08c0c3da979 tempest-DeleteServersTestJSON-720701050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-18863550-7308-45d9-a705-3955ebf1e633 req-604d0844-4c86-450f-828e-c08c0c3da979 tempest-DeleteServersTestJSON-720701050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-18863550-7308-45d9-a705-3955ebf1e633 req-604d0844-4c86-450f-828e-c08c0c3da979 tempest-DeleteServersTestJSON-720701050 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069', 'name': 'volume-51e0e2ee-8d70-4542-a69b-c3686cbf21ce', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '159c11c0-7472-4774-96ef-60614d023a48', 'enforce_multipath': True} {{(pid=86917) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:09:55 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-18863550-7308-45d9-a705-3955ebf1e633 req-604d0844-4c86-450f-828e-c08c0c3da979 tempest-DeleteServersTestJSON-720701050 None] attachment_update completed successfully. Sep 28 17:10:04 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-73a5dce1-4bb8-4ba4-8a73-89478dc6db6c req-22dec1af-4aa1-4288-b58c-0cb17de8cab5 tempest-DeleteServersTestJSON-720701050 None] Terminate volume connection completed successfully. Sep 28 17:10:04 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-73a5dce1-4bb8-4ba4-8a73-89478dc6db6c req-22dec1af-4aa1-4288-b58c-0cb17de8cab5 tempest-DeleteServersTestJSON-720701050 None] Deleting attachment 159c11c0-7472-4774-96ef-60614d023a48. {{(pid=86917) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:10:05 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=26,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:10:07 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c7255043-30ed-4913-86fc-7e122647972d tempest-DeleteServersTestJSON-720701050 None] Acquiring lock "cinder-51e0e2ee-8d70-4542-a69b-c3686cbf21ce-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:07 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c7255043-30ed-4913-86fc-7e122647972d tempest-DeleteServersTestJSON-720701050 None] Lock "cinder-51e0e2ee-8d70-4542-a69b-c3686cbf21ce-delete_volume" acquired by "delete_volume" :: waited 0.114s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:07 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c7255043-30ed-4913-86fc-7e122647972d tempest-DeleteServersTestJSON-720701050 None] Acquiring lock "cinder-quobyte-51e0e2ee-8d70-4542-a69b-c3686cbf21ce" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:07 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c7255043-30ed-4913-86fc-7e122647972d tempest-DeleteServersTestJSON-720701050 None] Lock "cinder-quobyte-51e0e2ee-8d70-4542-a69b-c3686cbf21ce" acquired by "delete_volume" :: waited 0.056s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:07 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee621799-ec2b-4ff9-8e45-47fb1963eca2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7255043-30ed-4913-86fc-7e122647972d tempest-DeleteServersTestJSON-720701050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-51e0e2ee-8d70-4542-a69b-c3686cbf21ce {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:08 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-51e0e2ee-8d70-4542-a69b-c3686cbf21ce Sep 28 17:10:08 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:09 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7255043-30ed-4913-86fc-7e122647972d tempest-DeleteServersTestJSON-720701050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-51e0e2ee-8d70-4542-a69b-c3686cbf21ce" returned: 0 in 1.834s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7255043-30ed-4913-86fc-7e122647972d tempest-DeleteServersTestJSON-720701050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-51e0e2ee-8d70-4542-a69b-c3686cbf21ce {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:09 devstack sudo[90276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-51e0e2ee-8d70-4542-a69b-c3686cbf21ce Sep 28 17:10:09 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:10 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7255043-30ed-4913-86fc-7e122647972d tempest-DeleteServersTestJSON-720701050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-51e0e2ee-8d70-4542-a69b-c3686cbf21ce" returned: 0 in 1.258s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:11 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c7255043-30ed-4913-86fc-7e122647972d tempest-DeleteServersTestJSON-720701050 None] Lock "cinder-quobyte-51e0e2ee-8d70-4542-a69b-c3686cbf21ce" released by "delete_volume" :: held 3.239s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:11 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-c7255043-30ed-4913-86fc-7e122647972d tempest-DeleteServersTestJSON-720701050 None] Created reservations ['ed6ad49c-7458-4a89-8e7b-6254e9805cb3', 'da5b55ff-703e-46d7-a887-1166761c37c2', '3e16eb3c-4ac3-4ac4-9b34-597526892e5d', '71e8498b-f29a-41e3-8ecc-57329e145b33'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c7255043-30ed-4913-86fc-7e122647972d tempest-DeleteServersTestJSON-720701050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c7255043-30ed-4913-86fc-7e122647972d tempest-DeleteServersTestJSON-720701050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c7255043-30ed-4913-86fc-7e122647972d tempest-DeleteServersTestJSON-720701050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c7255043-30ed-4913-86fc-7e122647972d tempest-DeleteServersTestJSON-720701050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c7255043-30ed-4913-86fc-7e122647972d tempest-DeleteServersTestJSON-720701050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7255043-30ed-4913-86fc-7e122647972d tempest-DeleteServersTestJSON-720701050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:11 devstack sudo[90312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:10:11 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:12 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7255043-30ed-4913-86fc-7e122647972d tempest-DeleteServersTestJSON-720701050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.720s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:12 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-c7255043-30ed-4913-86fc-7e122647972d tempest-DeleteServersTestJSON-720701050 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:12 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-c7255043-30ed-4913-86fc-7e122647972d tempest-DeleteServersTestJSON-720701050 None] Deleted volume successfully. Sep 28 17:10:12 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c7255043-30ed-4913-86fc-7e122647972d tempest-DeleteServersTestJSON-720701050 None] Lock "cinder-51e0e2ee-8d70-4542-a69b-c3686cbf21ce-delete_volume" released by "delete_volume" :: held 4.715s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-6e801a4e-44e5-4ec1-850b-62dc7a732f4d req-c279953a-cf09-44ea-81ed-fd8cbe0afc1f tempest-TaggedAttachmentsTest-1248553864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-6e801a4e-44e5-4ec1-850b-62dc7a732f4d req-c279953a-cf09-44ea-81ed-fd8cbe0afc1f tempest-TaggedAttachmentsTest-1248553864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-6e801a4e-44e5-4ec1-850b-62dc7a732f4d req-c279953a-cf09-44ea-81ed-fd8cbe0afc1f tempest-TaggedAttachmentsTest-1248553864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:13 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-6e801a4e-44e5-4ec1-850b-62dc7a732f4d req-c279953a-cf09-44ea-81ed-fd8cbe0afc1f tempest-TaggedAttachmentsTest-1248553864 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069', 'name': 'volume-e3094602-735a-4989-9ba6-64fbd555d509', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b26e5416-8a6d-4d5f-8bb2-823a6477bb4d', 'enforce_multipath': True} {{(pid=86917) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:10:13 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-6e801a4e-44e5-4ec1-850b-62dc7a732f4d req-c279953a-cf09-44ea-81ed-fd8cbe0afc1f tempest-TaggedAttachmentsTest-1248553864 None] attachment_update completed successfully. Sep 28 17:10:17 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-82446a3e-995b-4668-9f8c-96ba56407379 req-20836c1a-2890-4d93-9e30-e89dd597c2cb tempest-TaggedAttachmentsTest-1248553864 None] Terminate volume connection completed successfully. Sep 28 17:10:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-82446a3e-995b-4668-9f8c-96ba56407379 req-20836c1a-2890-4d93-9e30-e89dd597c2cb tempest-TaggedAttachmentsTest-1248553864 None] Deleting attachment b26e5416-8a6d-4d5f-8bb2-823a6477bb4d. {{(pid=86917) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:10:24 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=37,cinder:UPDATE=19,cinder:INSERT=3 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:10:24 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [req-baeef2c3-2e23-4ca5-906d-ce04cb5e6819 req-d407e393-4757-4f09-b47b-ea90fe092ba7 tempest-VolumesSnapshotsTestJSON-32758812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:10:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-baeef2c3-2e23-4ca5-906d-ce04cb5e6819 req-d407e393-4757-4f09-b47b-ea90fe092ba7 tempest-VolumesSnapshotsTestJSON-32758812 None] Flow 'volume_create_manager' (2f23a242-5088-4a95-a7fe-1c5fe343273b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-baeef2c3-2e23-4ca5-906d-ce04cb5e6819 req-d407e393-4757-4f09-b47b-ea90fe092ba7 tempest-VolumesSnapshotsTestJSON-32758812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44a2602-ad5c-4be2-b31a-a9d22674b0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-baeef2c3-2e23-4ca5-906d-ce04cb5e6819 req-d407e393-4757-4f09-b47b-ea90fe092ba7 tempest-VolumesSnapshotsTestJSON-32758812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44a2602-ad5c-4be2-b31a-a9d22674b0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-550774221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a968679e-6684-4b76-b5e7-c2d15a5e0f08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1739b3be99c44a7b9b2c331b627e7dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:24Z,use_quota=True,user_id='9acf5421f0c648d59bca21fb4968b376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-baeef2c3-2e23-4ca5-906d-ce04cb5e6819 req-d407e393-4757-4f09-b47b-ea90fe092ba7 tempest-VolumesSnapshotsTestJSON-32758812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f512dec-f930-49c7-9632-573911337b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-baeef2c3-2e23-4ca5-906d-ce04cb5e6819 req-d407e393-4757-4f09-b47b-ea90fe092ba7 tempest-VolumesSnapshotsTestJSON-32758812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f512dec-f930-49c7-9632-573911337b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-baeef2c3-2e23-4ca5-906d-ce04cb5e6819 req-d407e393-4757-4f09-b47b-ea90fe092ba7 tempest-VolumesSnapshotsTestJSON-32758812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5185a18c-333c-4a50-a225-fa7be8fd7e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-baeef2c3-2e23-4ca5-906d-ce04cb5e6819 req-d407e393-4757-4f09-b47b-ea90fe092ba7 tempest-VolumesSnapshotsTestJSON-32758812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5185a18c-333c-4a50-a225-fa7be8fd7e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a968679e-6684-4b76-b5e7-c2d15a5e0f08', 'volume_name': 'volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-baeef2c3-2e23-4ca5-906d-ce04cb5e6819 req-d407e393-4757-4f09-b47b-ea90fe092ba7 tempest-VolumesSnapshotsTestJSON-32758812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87d52c70-630e-4ca8-9b95-65a3f4364f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-baeef2c3-2e23-4ca5-906d-ce04cb5e6819 req-d407e393-4757-4f09-b47b-ea90fe092ba7 tempest-VolumesSnapshotsTestJSON-32758812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87d52c70-630e-4ca8-9b95-65a3f4364f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-baeef2c3-2e23-4ca5-906d-ce04cb5e6819 req-d407e393-4757-4f09-b47b-ea90fe092ba7 tempest-VolumesSnapshotsTestJSON-32758812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c408193-e54b-4ccc-86b0-328a4c35e54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:24 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [req-baeef2c3-2e23-4ca5-906d-ce04cb5e6819 req-d407e393-4757-4f09-b47b-ea90fe092ba7 tempest-VolumesSnapshotsTestJSON-32758812 None] Volume a968679e-6684-4b76-b5e7-c2d15a5e0f08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08', 'volume_size': 1} Sep 28 17:10:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-baeef2c3-2e23-4ca5-906d-ce04cb5e6819 req-d407e393-4757-4f09-b47b-ea90fe092ba7 tempest-VolumesSnapshotsTestJSON-32758812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-baeef2c3-2e23-4ca5-906d-ce04cb5e6819 req-d407e393-4757-4f09-b47b-ea90fe092ba7 tempest-VolumesSnapshotsTestJSON-32758812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [req-baeef2c3-2e23-4ca5-906d-ce04cb5e6819 req-d407e393-4757-4f09-b47b-ea90fe092ba7 tempest-VolumesSnapshotsTestJSON-32758812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-550774221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a968679e-6684-4b76-b5e7-c2d15a5e0f08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1739b3be99c44a7b9b2c331b627e7dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:24Z,use_quota=True,user_id='9acf5421f0c648d59bca21fb4968b376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:10:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [req-baeef2c3-2e23-4ca5-906d-ce04cb5e6819 req-d407e393-4757-4f09-b47b-ea90fe092ba7 tempest-VolumesSnapshotsTestJSON-32758812 None] Creating volume a968679e-6684-4b76-b5e7-c2d15a5e0f08 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:10:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-baeef2c3-2e23-4ca5-906d-ce04cb5e6819 req-d407e393-4757-4f09-b47b-ea90fe092ba7 tempest-VolumesSnapshotsTestJSON-32758812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-baeef2c3-2e23-4ca5-906d-ce04cb5e6819 req-d407e393-4757-4f09-b47b-ea90fe092ba7 tempest-VolumesSnapshotsTestJSON-32758812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [req-baeef2c3-2e23-4ca5-906d-ce04cb5e6819 req-d407e393-4757-4f09-b47b-ea90fe092ba7 tempest-VolumesSnapshotsTestJSON-32758812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [req-baeef2c3-2e23-4ca5-906d-ce04cb5e6819 req-d407e393-4757-4f09-b47b-ea90fe092ba7 tempest-VolumesSnapshotsTestJSON-32758812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-baeef2c3-2e23-4ca5-906d-ce04cb5e6819 req-d407e393-4757-4f09-b47b-ea90fe092ba7 tempest-VolumesSnapshotsTestJSON-32758812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [req-baeef2c3-2e23-4ca5-906d-ce04cb5e6819 req-d407e393-4757-4f09-b47b-ea90fe092ba7 tempest-VolumesSnapshotsTestJSON-32758812 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:10:24 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [req-baeef2c3-2e23-4ca5-906d-ce04cb5e6819 req-d407e393-4757-4f09-b47b-ea90fe092ba7 tempest-VolumesSnapshotsTestJSON-32758812 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:10:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-baeef2c3-2e23-4ca5-906d-ce04cb5e6819 req-d407e393-4757-4f09-b47b-ea90fe092ba7 tempest-VolumesSnapshotsTestJSON-32758812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:24 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08 1073741824 Sep 28 17:10:24 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:24 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-baeef2c3-2e23-4ca5-906d-ce04cb5e6819 req-d407e393-4757-4f09-b47b-ea90fe092ba7 tempest-VolumesSnapshotsTestJSON-32758812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08 1073741824" returned: 0 in 0.671s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-baeef2c3-2e23-4ca5-906d-ce04cb5e6819 req-d407e393-4757-4f09-b47b-ea90fe092ba7 tempest-VolumesSnapshotsTestJSON-32758812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:24 devstack sudo[90443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08 Sep 28 17:10:24 devstack sudo[90443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:25 devstack sudo[90443]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-baeef2c3-2e23-4ca5-906d-ce04cb5e6819 req-d407e393-4757-4f09-b47b-ea90fe092ba7 tempest-VolumesSnapshotsTestJSON-32758812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08" returned: 0 in 0.328s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:25 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [req-baeef2c3-2e23-4ca5-906d-ce04cb5e6819 req-d407e393-4757-4f09-b47b-ea90fe092ba7 tempest-VolumesSnapshotsTestJSON-32758812 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:10:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-baeef2c3-2e23-4ca5-906d-ce04cb5e6819 req-d407e393-4757-4f09-b47b-ea90fe092ba7 tempest-VolumesSnapshotsTestJSON-32758812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-baeef2c3-2e23-4ca5-906d-ce04cb5e6819 req-d407e393-4757-4f09-b47b-ea90fe092ba7 tempest-VolumesSnapshotsTestJSON-32758812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c408193-e54b-4ccc-86b0-328a4c35e54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-baeef2c3-2e23-4ca5-906d-ce04cb5e6819 req-d407e393-4757-4f09-b47b-ea90fe092ba7 tempest-VolumesSnapshotsTestJSON-32758812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd591371-d8c9-40dc-87ec-caea9016fd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:25 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [req-baeef2c3-2e23-4ca5-906d-ce04cb5e6819 req-d407e393-4757-4f09-b47b-ea90fe092ba7 tempest-VolumesSnapshotsTestJSON-32758812 None] Volume volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08 (a968679e-6684-4b76-b5e7-c2d15a5e0f08): created successfully Sep 28 17:10:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-baeef2c3-2e23-4ca5-906d-ce04cb5e6819 req-d407e393-4757-4f09-b47b-ea90fe092ba7 tempest-VolumesSnapshotsTestJSON-32758812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd591371-d8c9-40dc-87ec-caea9016fd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-baeef2c3-2e23-4ca5-906d-ce04cb5e6819 req-d407e393-4757-4f09-b47b-ea90fe092ba7 tempest-VolumesSnapshotsTestJSON-32758812 None] Flow 'volume_create_manager' (2f23a242-5088-4a95-a7fe-1c5fe343273b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:25 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-baeef2c3-2e23-4ca5-906d-ce04cb5e6819 req-d407e393-4757-4f09-b47b-ea90fe092ba7 tempest-VolumesSnapshotsTestJSON-32758812 None] Created volume successfully. Sep 28 17:10:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-4e7024ee-dd31-4ce9-8906-7b3ca60f9ecc req-69557035-c7e5-494e-bd1e-c915fe052e5d tempest-VolumesSnapshotsTestJSON-32758812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-4e7024ee-dd31-4ce9-8906-7b3ca60f9ecc req-69557035-c7e5-494e-bd1e-c915fe052e5d tempest-VolumesSnapshotsTestJSON-32758812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:26 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [req-4e7024ee-dd31-4ce9-8906-7b3ca60f9ecc req-69557035-c7e5-494e-bd1e-c915fe052e5d tempest-VolumesSnapshotsTestJSON-32758812 None] Creating offline snapshot 4212c283-982f-4410-933d-fb47200944ae of volume a968679e-6684-4b76-b5e7-c2d15a5e0f08 {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:10:26 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0c9ca2-c782-47f2-afa6-d6a2e55b4d21]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-4e7024ee-dd31-4ce9-8906-7b3ca60f9ecc req-69557035-c7e5-494e-bd1e-c915fe052e5d tempest-VolumesSnapshotsTestJSON-32758812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:26 devstack sudo[90450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08 Sep 28 17:10:26 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:27 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-4e7024ee-dd31-4ce9-8906-7b3ca60f9ecc req-69557035-c7e5-494e-bd1e-c915fe052e5d tempest-VolumesSnapshotsTestJSON-32758812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08" returned: 0 in 0.435s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-4e7024ee-dd31-4ce9-8906-7b3ca60f9ecc req-69557035-c7e5-494e-bd1e-c915fe052e5d tempest-VolumesSnapshotsTestJSON-32758812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08.4212c283-982f-4410-933d-fb47200944ae 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:27 devstack sudo[90456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08.4212c283-982f-4410-933d-fb47200944ae 1G Sep 28 17:10:27 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:27 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-4e7024ee-dd31-4ce9-8906-7b3ca60f9ecc req-69557035-c7e5-494e-bd1e-c915fe052e5d tempest-VolumesSnapshotsTestJSON-32758812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08.4212c283-982f-4410-933d-fb47200944ae 1G" returned: 0 in 0.470s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-4e7024ee-dd31-4ce9-8906-7b3ca60f9ecc req-69557035-c7e5-494e-bd1e-c915fe052e5d tempest-VolumesSnapshotsTestJSON-32758812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08.4212c283-982f-4410-933d-fb47200944ae {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:27 devstack sudo[90462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08.4212c283-982f-4410-933d-fb47200944ae Sep 28 17:10:27 devstack sudo[90462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:27 devstack sudo[90462]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-4e7024ee-dd31-4ce9-8906-7b3ca60f9ecc req-69557035-c7e5-494e-bd1e-c915fe052e5d tempest-VolumesSnapshotsTestJSON-32758812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08.4212c283-982f-4410-933d-fb47200944ae" returned: 0 in 0.290s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:27 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [req-4e7024ee-dd31-4ce9-8906-7b3ca60f9ecc req-69557035-c7e5-494e-bd1e-c915fe052e5d tempest-VolumesSnapshotsTestJSON-32758812 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08.4212c283-982f-4410-933d-fb47200944ae is being set with open permissions: ugo+rw Sep 28 17:10:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-4e7024ee-dd31-4ce9-8906-7b3ca60f9ecc req-69557035-c7e5-494e-bd1e-c915fe052e5d tempest-VolumesSnapshotsTestJSON-32758812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08.4212c283-982f-4410-933d-fb47200944ae {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:28 devstack sudo[90467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08.4212c283-982f-4410-933d-fb47200944ae Sep 28 17:10:28 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:28 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-4e7024ee-dd31-4ce9-8906-7b3ca60f9ecc req-69557035-c7e5-494e-bd1e-c915fe052e5d tempest-VolumesSnapshotsTestJSON-32758812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08.4212c283-982f-4410-933d-fb47200944ae" returned: 0 in 0.270s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-4e7024ee-dd31-4ce9-8906-7b3ca60f9ecc req-69557035-c7e5-494e-bd1e-c915fe052e5d tempest-VolumesSnapshotsTestJSON-32758812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:28 devstack sudo[90470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08.info Sep 28 17:10:28 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:28 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-4e7024ee-dd31-4ce9-8906-7b3ca60f9ecc req-69557035-c7e5-494e-bd1e-c915fe052e5d tempest-VolumesSnapshotsTestJSON-32758812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08.info" returned: 0 in 0.323s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:28 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [req-4e7024ee-dd31-4ce9-8906-7b3ca60f9ecc req-69557035-c7e5-494e-bd1e-c915fe052e5d tempest-VolumesSnapshotsTestJSON-32758812 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08.info is being set with open permissions: ugo+rw Sep 28 17:10:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-4e7024ee-dd31-4ce9-8906-7b3ca60f9ecc req-69557035-c7e5-494e-bd1e-c915fe052e5d tempest-VolumesSnapshotsTestJSON-32758812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:28 devstack sudo[90475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08.info Sep 28 17:10:28 devstack sudo[90475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:28 devstack sudo[90475]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-4e7024ee-dd31-4ce9-8906-7b3ca60f9ecc req-69557035-c7e5-494e-bd1e-c915fe052e5d tempest-VolumesSnapshotsTestJSON-32758812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08.info" returned: 0 in 0.300s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-4e7024ee-dd31-4ce9-8906-7b3ca60f9ecc req-69557035-c7e5-494e-bd1e-c915fe052e5d tempest-VolumesSnapshotsTestJSON-32758812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.238s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:28 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-4e7024ee-dd31-4ce9-8906-7b3ca60f9ecc req-69557035-c7e5-494e-bd1e-c915fe052e5d tempest-VolumesSnapshotsTestJSON-32758812 None] Create snapshot completed successfully Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [req-3f85f267-839c-4512-bbc0-84d16674b361 req-2927bc60-a0bd-4247-b351-3956553d737c tempest-VolumesSnapshotsTestJSON-32758812 None] Acquiring lock "cinder-4212c283-982f-4410-933d-fb47200944ae-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [req-3f85f267-839c-4512-bbc0-84d16674b361 req-2927bc60-a0bd-4247-b351-3956553d737c tempest-VolumesSnapshotsTestJSON-32758812 None] Lock "cinder-4212c283-982f-4410-933d-fb47200944ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [req-3f85f267-839c-4512-bbc0-84d16674b361 req-2927bc60-a0bd-4247-b351-3956553d737c tempest-VolumesSnapshotsTestJSON-32758812 None] Acquiring lock "cinder-quobyte-a968679e-6684-4b76-b5e7-c2d15a5e0f08" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [req-3f85f267-839c-4512-bbc0-84d16674b361 req-2927bc60-a0bd-4247-b351-3956553d737c tempest-VolumesSnapshotsTestJSON-32758812 None] Lock "cinder-quobyte-a968679e-6684-4b76-b5e7-c2d15a5e0f08" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [req-3f85f267-839c-4512-bbc0-84d16674b361 req-2927bc60-a0bd-4247-b351-3956553d737c tempest-VolumesSnapshotsTestJSON-32758812 None] Acquiring lock "cinder-quobyte-4212c283-982f-4410-933d-fb47200944ae" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [req-3f85f267-839c-4512-bbc0-84d16674b361 req-2927bc60-a0bd-4247-b351-3956553d737c tempest-VolumesSnapshotsTestJSON-32758812 None] Lock "cinder-quobyte-4212c283-982f-4410-933d-fb47200944ae" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [req-3f85f267-839c-4512-bbc0-84d16674b361 req-2927bc60-a0bd-4247-b351-3956553d737c tempest-VolumesSnapshotsTestJSON-32758812 None] Deleting offline snapshot 4212c283-982f-4410-933d-fb47200944ae of volume a968679e-6684-4b76-b5e7-c2d15a5e0f08 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [req-3f85f267-839c-4512-bbc0-84d16674b361 req-2927bc60-a0bd-4247-b351-3956553d737c tempest-VolumesSnapshotsTestJSON-32758812 None] snapshot_file for this snap is: volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08.4212c283-982f-4410-933d-fb47200944ae {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[30dac881-e281-4220-80a3-3397ca6dd775]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-3f85f267-839c-4512-bbc0-84d16674b361 req-2927bc60-a0bd-4247-b351-3956553d737c tempest-VolumesSnapshotsTestJSON-32758812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08.4212c283-982f-4410-933d-fb47200944ae {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:29 devstack sudo[90478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08.4212c283-982f-4410-933d-fb47200944ae Sep 28 17:10:29 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3fd706f-e5ba-47cc-8929-51c67662c962 tempest-AttachVolumeShelveTestJSON-1861052735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f3fd706f-e5ba-47cc-8929-51c67662c962 tempest-AttachVolumeShelveTestJSON-1861052735 None] Flow 'volume_create_manager' (3cdde5b2-0b09-4c8d-9108-2606f458126f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f3fd706f-e5ba-47cc-8929-51c67662c962 tempest-AttachVolumeShelveTestJSON-1861052735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e633245a-df03-4fdb-94f0-362eca7c0e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f3fd706f-e5ba-47cc-8929-51c67662c962 tempest-AttachVolumeShelveTestJSON-1861052735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e633245a-df03-4fdb-94f0-362eca7c0e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1879941193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fd558c6-b374-4aa5-9d48-20f9d48f3b7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bff420d50425496abac3a0c546be4cfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:30Z,use_quota=True,user_id='7a42bd8d5ffa4b178691d599933f2b1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f3fd706f-e5ba-47cc-8929-51c67662c962 tempest-AttachVolumeShelveTestJSON-1861052735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac863360-2cdf-421e-8060-c2d681eed447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f3fd706f-e5ba-47cc-8929-51c67662c962 tempest-AttachVolumeShelveTestJSON-1861052735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac863360-2cdf-421e-8060-c2d681eed447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f3fd706f-e5ba-47cc-8929-51c67662c962 tempest-AttachVolumeShelveTestJSON-1861052735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab6eb6f-600e-45c6-96d1-8064580267d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f3fd706f-e5ba-47cc-8929-51c67662c962 tempest-AttachVolumeShelveTestJSON-1861052735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab6eb6f-600e-45c6-96d1-8064580267d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fd558c6-b374-4aa5-9d48-20f9d48f3b7f', 'volume_name': 'volume-9fd558c6-b374-4aa5-9d48-20f9d48f3b7f', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f3fd706f-e5ba-47cc-8929-51c67662c962 tempest-AttachVolumeShelveTestJSON-1861052735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bd0b573-9328-42c1-96cf-44e5d9099be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f3fd706f-e5ba-47cc-8929-51c67662c962 tempest-AttachVolumeShelveTestJSON-1861052735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bd0b573-9328-42c1-96cf-44e5d9099be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f3fd706f-e5ba-47cc-8929-51c67662c962 tempest-AttachVolumeShelveTestJSON-1861052735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58e09b98-20ed-4da4-98fa-20b7e5d764de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:29 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-f3fd706f-e5ba-47cc-8929-51c67662c962 tempest-AttachVolumeShelveTestJSON-1861052735 None] Volume 9fd558c6-b374-4aa5-9d48-20f9d48f3b7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fd558c6-b374-4aa5-9d48-20f9d48f3b7f', 'volume_size': 1} Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f3fd706f-e5ba-47cc-8929-51c67662c962 tempest-AttachVolumeShelveTestJSON-1861052735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f3fd706f-e5ba-47cc-8929-51c67662c962 tempest-AttachVolumeShelveTestJSON-1861052735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f3fd706f-e5ba-47cc-8929-51c67662c962 tempest-AttachVolumeShelveTestJSON-1861052735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1879941193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fd558c6-b374-4aa5-9d48-20f9d48f3b7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bff420d50425496abac3a0c546be4cfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:30Z,use_quota=True,user_id='7a42bd8d5ffa4b178691d599933f2b1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-f3fd706f-e5ba-47cc-8929-51c67662c962 tempest-AttachVolumeShelveTestJSON-1861052735 None] Creating volume 9fd558c6-b374-4aa5-9d48-20f9d48f3b7f {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f3fd706f-e5ba-47cc-8929-51c67662c962 tempest-AttachVolumeShelveTestJSON-1861052735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f3fd706f-e5ba-47cc-8929-51c67662c962 tempest-AttachVolumeShelveTestJSON-1861052735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f3fd706f-e5ba-47cc-8929-51c67662c962 tempest-AttachVolumeShelveTestJSON-1861052735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f3fd706f-e5ba-47cc-8929-51c67662c962 tempest-AttachVolumeShelveTestJSON-1861052735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f3fd706f-e5ba-47cc-8929-51c67662c962 tempest-AttachVolumeShelveTestJSON-1861052735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f3fd706f-e5ba-47cc-8929-51c67662c962 tempest-AttachVolumeShelveTestJSON-1861052735 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:10:29 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-f3fd706f-e5ba-47cc-8929-51c67662c962 tempest-AttachVolumeShelveTestJSON-1861052735 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f3fd706f-e5ba-47cc-8929-51c67662c962 tempest-AttachVolumeShelveTestJSON-1861052735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-9fd558c6-b374-4aa5-9d48-20f9d48f3b7f 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:29 devstack sudo[90480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-9fd558c6-b374-4aa5-9d48-20f9d48f3b7f 1073741824 Sep 28 17:10:29 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:29 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-3f85f267-839c-4512-bbc0-84d16674b361 req-2927bc60-a0bd-4247-b351-3956553d737c tempest-VolumesSnapshotsTestJSON-32758812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08.4212c283-982f-4410-933d-fb47200944ae" returned: 0 in 0.503s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [req-3f85f267-839c-4512-bbc0-84d16674b361 req-2927bc60-a0bd-4247-b351-3956553d737c tempest-VolumesSnapshotsTestJSON-32758812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7e141b-4153-41b6-a43c-dab6d348b924]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-3f85f267-839c-4512-bbc0-84d16674b361 req-2927bc60-a0bd-4247-b351-3956553d737c tempest-VolumesSnapshotsTestJSON-32758812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:30 devstack sudo[90486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08 Sep 28 17:10:30 devstack sudo[90486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:30 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f3fd706f-e5ba-47cc-8929-51c67662c962 tempest-AttachVolumeShelveTestJSON-1861052735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-9fd558c6-b374-4aa5-9d48-20f9d48f3b7f 1073741824" returned: 0 in 0.628s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f3fd706f-e5ba-47cc-8929-51c67662c962 tempest-AttachVolumeShelveTestJSON-1861052735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-9fd558c6-b374-4aa5-9d48-20f9d48f3b7f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:30 devstack sudo[90494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-9fd558c6-b374-4aa5-9d48-20f9d48f3b7f Sep 28 17:10:30 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:30 devstack sudo[90486]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-3f85f267-839c-4512-bbc0-84d16674b361 req-2927bc60-a0bd-4247-b351-3956553d737c tempest-VolumesSnapshotsTestJSON-32758812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08" returned: 0 in 0.549s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-3f85f267-839c-4512-bbc0-84d16674b361 req-2927bc60-a0bd-4247-b351-3956553d737c tempest-VolumesSnapshotsTestJSON-32758812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08.4212c283-982f-4410-933d-fb47200944ae {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:30 devstack sudo[90498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08.4212c283-982f-4410-933d-fb47200944ae Sep 28 17:10:30 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:30 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f3fd706f-e5ba-47cc-8929-51c67662c962 tempest-AttachVolumeShelveTestJSON-1861052735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-9fd558c6-b374-4aa5-9d48-20f9d48f3b7f" returned: 0 in 0.489s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:30 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f3fd706f-e5ba-47cc-8929-51c67662c962 tempest-AttachVolumeShelveTestJSON-1861052735 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:10:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f3fd706f-e5ba-47cc-8929-51c67662c962 tempest-AttachVolumeShelveTestJSON-1861052735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f3fd706f-e5ba-47cc-8929-51c67662c962 tempest-AttachVolumeShelveTestJSON-1861052735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58e09b98-20ed-4da4-98fa-20b7e5d764de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fd558c6-b374-4aa5-9d48-20f9d48f3b7f', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f3fd706f-e5ba-47cc-8929-51c67662c962 tempest-AttachVolumeShelveTestJSON-1861052735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebcee53d-c1b1-4769-844c-e86960007550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:30 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-f3fd706f-e5ba-47cc-8929-51c67662c962 tempest-AttachVolumeShelveTestJSON-1861052735 None] Volume volume-9fd558c6-b374-4aa5-9d48-20f9d48f3b7f (9fd558c6-b374-4aa5-9d48-20f9d48f3b7f): created successfully Sep 28 17:10:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f3fd706f-e5ba-47cc-8929-51c67662c962 tempest-AttachVolumeShelveTestJSON-1861052735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebcee53d-c1b1-4769-844c-e86960007550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f3fd706f-e5ba-47cc-8929-51c67662c962 tempest-AttachVolumeShelveTestJSON-1861052735 None] Flow 'volume_create_manager' (3cdde5b2-0b09-4c8d-9108-2606f458126f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:30 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-f3fd706f-e5ba-47cc-8929-51c67662c962 tempest-AttachVolumeShelveTestJSON-1861052735 None] Created volume successfully. Sep 28 17:10:31 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e13cfd2c-d3ac-4b70-b1f6-4b9ddacddf3d tempest-TaggedAttachmentsTest-1248553864 None] Acquiring lock "cinder-e3094602-735a-4989-9ba6-64fbd555d509-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:31 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-3f85f267-839c-4512-bbc0-84d16674b361 req-2927bc60-a0bd-4247-b351-3956553d737c tempest-VolumesSnapshotsTestJSON-32758812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08.4212c283-982f-4410-933d-fb47200944ae" returned: 0 in 0.554s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-3f85f267-839c-4512-bbc0-84d16674b361 req-2927bc60-a0bd-4247-b351-3956553d737c tempest-VolumesSnapshotsTestJSON-32758812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08.4212c283-982f-4410-933d-fb47200944ae {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:31 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e13cfd2c-d3ac-4b70-b1f6-4b9ddacddf3d tempest-TaggedAttachmentsTest-1248553864 None] Lock "cinder-e3094602-735a-4989-9ba6-64fbd555d509-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:31 devstack sudo[90507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08.4212c283-982f-4410-933d-fb47200944ae Sep 28 17:10:31 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:31 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e13cfd2c-d3ac-4b70-b1f6-4b9ddacddf3d tempest-TaggedAttachmentsTest-1248553864 None] Acquiring lock "cinder-quobyte-e3094602-735a-4989-9ba6-64fbd555d509" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:31 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e13cfd2c-d3ac-4b70-b1f6-4b9ddacddf3d tempest-TaggedAttachmentsTest-1248553864 None] Lock "cinder-quobyte-e3094602-735a-4989-9ba6-64fbd555d509" acquired by "delete_volume" :: waited 0.027s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:31 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c82b328-fe3b-43c4-be4f-0f589ddbd29d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e13cfd2c-d3ac-4b70-b1f6-4b9ddacddf3d tempest-TaggedAttachmentsTest-1248553864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e3094602-735a-4989-9ba6-64fbd555d509 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:31 devstack sudo[90509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e3094602-735a-4989-9ba6-64fbd555d509 Sep 28 17:10:31 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:31 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-3f85f267-839c-4512-bbc0-84d16674b361 req-2927bc60-a0bd-4247-b351-3956553d737c tempest-VolumesSnapshotsTestJSON-32758812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08.4212c283-982f-4410-933d-fb47200944ae" returned: 0 in 0.331s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:31 devstack cinder-volume[86917]: DEBUG cinder.coordination [req-3f85f267-839c-4512-bbc0-84d16674b361 req-2927bc60-a0bd-4247-b351-3956553d737c tempest-VolumesSnapshotsTestJSON-32758812 None] Lock "cinder-quobyte-4212c283-982f-4410-933d-fb47200944ae" released by "_delete_snapshot" :: held 2.089s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:31 devstack cinder-volume[86917]: DEBUG cinder.coordination [req-3f85f267-839c-4512-bbc0-84d16674b361 req-2927bc60-a0bd-4247-b351-3956553d737c tempest-VolumesSnapshotsTestJSON-32758812 None] Lock "cinder-quobyte-a968679e-6684-4b76-b5e7-c2d15a5e0f08" released by "delete_snapshot" :: held 2.121s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:31 devstack cinder-volume[86917]: WARNING cinder.quota [req-3f85f267-839c-4512-bbc0-84d16674b361 req-2927bc60-a0bd-4247-b351-3956553d737c tempest-VolumesSnapshotsTestJSON-32758812 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:10:31 devstack cinder-volume[86917]: DEBUG cinder.quota [req-3f85f267-839c-4512-bbc0-84d16674b361 req-2927bc60-a0bd-4247-b351-3956553d737c tempest-VolumesSnapshotsTestJSON-32758812 None] Created reservations ['f8954650-f9e7-4306-ab0e-58d6062dc02e', 'a323ee12-4269-42a4-9b52-c5c4f0ac3e0e', 'b6cc5596-9a9b-4adc-8dbd-1ee278958c18', '3ec7bf3a-cf95-474a-a864-e06f68fc97a7'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:31 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-3f85f267-839c-4512-bbc0-84d16674b361 req-2927bc60-a0bd-4247-b351-3956553d737c tempest-VolumesSnapshotsTestJSON-32758812 None] Delete snapshot completed successfully. Sep 28 17:10:31 devstack cinder-volume[86917]: DEBUG cinder.coordination [req-3f85f267-839c-4512-bbc0-84d16674b361 req-2927bc60-a0bd-4247-b351-3956553d737c tempest-VolumesSnapshotsTestJSON-32758812 None] Lock "cinder-4212c283-982f-4410-933d-fb47200944ae-delete_snapshot" released by "delete_snapshot" :: held 2.378s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:31 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e13cfd2c-d3ac-4b70-b1f6-4b9ddacddf3d tempest-TaggedAttachmentsTest-1248553864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e3094602-735a-4989-9ba6-64fbd555d509" returned: 0 in 0.549s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e13cfd2c-d3ac-4b70-b1f6-4b9ddacddf3d tempest-TaggedAttachmentsTest-1248553864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e3094602-735a-4989-9ba6-64fbd555d509 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:31 devstack sudo[90520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e3094602-735a-4989-9ba6-64fbd555d509 Sep 28 17:10:31 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:32 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e13cfd2c-d3ac-4b70-b1f6-4b9ddacddf3d tempest-TaggedAttachmentsTest-1248553864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e3094602-735a-4989-9ba6-64fbd555d509" returned: 0 in 0.339s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e13cfd2c-d3ac-4b70-b1f6-4b9ddacddf3d tempest-TaggedAttachmentsTest-1248553864 None] Lock "cinder-quobyte-e3094602-735a-4989-9ba6-64fbd555d509" released by "delete_volume" :: held 0.951s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:32 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-e13cfd2c-d3ac-4b70-b1f6-4b9ddacddf3d tempest-TaggedAttachmentsTest-1248553864 None] Created reservations ['24155f87-64df-4d38-84e2-ec840054b338', '076e055d-566b-4abe-a680-ce61e5a412b8', '06664417-9ef1-4b1b-8318-ed0d2822bdf3', '359955f3-f465-40fb-819c-6367db7d8204'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e13cfd2c-d3ac-4b70-b1f6-4b9ddacddf3d tempest-TaggedAttachmentsTest-1248553864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e13cfd2c-d3ac-4b70-b1f6-4b9ddacddf3d tempest-TaggedAttachmentsTest-1248553864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-e13cfd2c-d3ac-4b70-b1f6-4b9ddacddf3d tempest-TaggedAttachmentsTest-1248553864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-e13cfd2c-d3ac-4b70-b1f6-4b9ddacddf3d tempest-TaggedAttachmentsTest-1248553864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e13cfd2c-d3ac-4b70-b1f6-4b9ddacddf3d tempest-TaggedAttachmentsTest-1248553864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e13cfd2c-d3ac-4b70-b1f6-4b9ddacddf3d tempest-TaggedAttachmentsTest-1248553864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:32 devstack sudo[90529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:10:32 devstack sudo[90529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:32 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-5f40e567-4c3f-46da-9ad3-0782a0b81452 req-5e9ba950-2b8b-4e4a-ad13-ddf7df0e82d7 tempest-ServerActionsTestOtherA-1979217729 None] Terminate volume connection completed successfully. Sep 28 17:10:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-5f40e567-4c3f-46da-9ad3-0782a0b81452 req-5e9ba950-2b8b-4e4a-ad13-ddf7df0e82d7 tempest-ServerActionsTestOtherA-1979217729 None] Deleting attachment 6b3f7f9b-eb28-4caa-a2e3-beba06d50317. {{(pid=86917) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:10:32 devstack sudo[90529]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e13cfd2c-d3ac-4b70-b1f6-4b9ddacddf3d tempest-TaggedAttachmentsTest-1248553864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.377s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:32 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-e13cfd2c-d3ac-4b70-b1f6-4b9ddacddf3d tempest-TaggedAttachmentsTest-1248553864 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:32 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-e13cfd2c-d3ac-4b70-b1f6-4b9ddacddf3d tempest-TaggedAttachmentsTest-1248553864 None] Deleted volume successfully. Sep 28 17:10:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e13cfd2c-d3ac-4b70-b1f6-4b9ddacddf3d tempest-TaggedAttachmentsTest-1248553864 None] Lock "cinder-e3094602-735a-4989-9ba6-64fbd555d509-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [req-740cae48-b704-499a-a2d2-cee3ceea3c3d req-753461b8-2994-4083-9320-2f60fb4e5239 tempest-VolumesSnapshotsTestJSON-32758812 None] Acquiring lock "cinder-a968679e-6684-4b76-b5e7-c2d15a5e0f08-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [req-740cae48-b704-499a-a2d2-cee3ceea3c3d req-753461b8-2994-4083-9320-2f60fb4e5239 tempest-VolumesSnapshotsTestJSON-32758812 None] Lock "cinder-a968679e-6684-4b76-b5e7-c2d15a5e0f08-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [req-740cae48-b704-499a-a2d2-cee3ceea3c3d req-753461b8-2994-4083-9320-2f60fb4e5239 tempest-VolumesSnapshotsTestJSON-32758812 None] Acquiring lock "cinder-quobyte-a968679e-6684-4b76-b5e7-c2d15a5e0f08" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [req-740cae48-b704-499a-a2d2-cee3ceea3c3d req-753461b8-2994-4083-9320-2f60fb4e5239 tempest-VolumesSnapshotsTestJSON-32758812 None] Lock "cinder-quobyte-a968679e-6684-4b76-b5e7-c2d15a5e0f08" acquired by "delete_volume" :: waited 0.033s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:33 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33728b6-770e-4803-8c8c-c889badd2a52]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-740cae48-b704-499a-a2d2-cee3ceea3c3d req-753461b8-2994-4083-9320-2f60fb4e5239 tempest-VolumesSnapshotsTestJSON-32758812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:33 devstack sudo[90532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08 Sep 28 17:10:33 devstack sudo[90532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:33 devstack sudo[90532]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-740cae48-b704-499a-a2d2-cee3ceea3c3d req-753461b8-2994-4083-9320-2f60fb4e5239 tempest-VolumesSnapshotsTestJSON-32758812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08" returned: 0 in 0.673s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-740cae48-b704-499a-a2d2-cee3ceea3c3d req-753461b8-2994-4083-9320-2f60fb4e5239 tempest-VolumesSnapshotsTestJSON-32758812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:33 devstack sudo[90544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08 Sep 28 17:10:33 devstack sudo[90544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:34 devstack sudo[90544]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-740cae48-b704-499a-a2d2-cee3ceea3c3d req-753461b8-2994-4083-9320-2f60fb4e5239 tempest-VolumesSnapshotsTestJSON-32758812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a968679e-6684-4b76-b5e7-c2d15a5e0f08" returned: 0 in 0.578s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:34 devstack cinder-volume[86917]: DEBUG cinder.coordination [req-740cae48-b704-499a-a2d2-cee3ceea3c3d req-753461b8-2994-4083-9320-2f60fb4e5239 tempest-VolumesSnapshotsTestJSON-32758812 None] Lock "cinder-quobyte-a968679e-6684-4b76-b5e7-c2d15a5e0f08" released by "delete_volume" :: held 1.351s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:34 devstack cinder-volume[86917]: DEBUG cinder.quota [req-740cae48-b704-499a-a2d2-cee3ceea3c3d req-753461b8-2994-4083-9320-2f60fb4e5239 tempest-VolumesSnapshotsTestJSON-32758812 None] Created reservations ['c96b015f-4c16-4678-afcc-75cfe3798f1d', '8a8de59c-14f0-4de2-86fd-a40d0c21617d', 'e716f52e-7696-4d07-9201-069e3fdd0c57', '9eb2522f-2200-4a61-ac46-ded921d2f5de'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-740cae48-b704-499a-a2d2-cee3ceea3c3d req-753461b8-2994-4083-9320-2f60fb4e5239 tempest-VolumesSnapshotsTestJSON-32758812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-740cae48-b704-499a-a2d2-cee3ceea3c3d req-753461b8-2994-4083-9320-2f60fb4e5239 tempest-VolumesSnapshotsTestJSON-32758812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:34 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [req-740cae48-b704-499a-a2d2-cee3ceea3c3d req-753461b8-2994-4083-9320-2f60fb4e5239 tempest-VolumesSnapshotsTestJSON-32758812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:34 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [req-740cae48-b704-499a-a2d2-cee3ceea3c3d req-753461b8-2994-4083-9320-2f60fb4e5239 tempest-VolumesSnapshotsTestJSON-32758812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-740cae48-b704-499a-a2d2-cee3ceea3c3d req-753461b8-2994-4083-9320-2f60fb4e5239 tempest-VolumesSnapshotsTestJSON-32758812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-740cae48-b704-499a-a2d2-cee3ceea3c3d req-753461b8-2994-4083-9320-2f60fb4e5239 tempest-VolumesSnapshotsTestJSON-32758812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:34 devstack sudo[90575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:10:34 devstack sudo[90575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:35 devstack sudo[90575]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-740cae48-b704-499a-a2d2-cee3ceea3c3d req-753461b8-2994-4083-9320-2f60fb4e5239 tempest-VolumesSnapshotsTestJSON-32758812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.514s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:35 devstack cinder-volume[86917]: DEBUG cinder.manager [req-740cae48-b704-499a-a2d2-cee3ceea3c3d req-753461b8-2994-4083-9320-2f60fb4e5239 tempest-VolumesSnapshotsTestJSON-32758812 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:35 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-740cae48-b704-499a-a2d2-cee3ceea3c3d req-753461b8-2994-4083-9320-2f60fb4e5239 tempest-VolumesSnapshotsTestJSON-32758812 None] Deleted volume successfully. Sep 28 17:10:35 devstack cinder-volume[86917]: DEBUG cinder.coordination [req-740cae48-b704-499a-a2d2-cee3ceea3c3d req-753461b8-2994-4083-9320-2f60fb4e5239 tempest-VolumesSnapshotsTestJSON-32758812 None] Lock "cinder-a968679e-6684-4b76-b5e7-c2d15a5e0f08-delete_volume" released by "delete_volume" :: held 2.343s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:44 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:UPDATE=43,cinder:SELECT=34,cinder:INSERT=11,cinder:DELETE=2 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:10:44 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:10:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Flow 'volume_create_manager' (fef0aad3-efa9-4f94-954d-cd953e9f419e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b37995-7651-473d-b811-3f3f35e87c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b37995-7651-473d-b811-3f3f35e87c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-259197719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cfc0419-bd09-43b0-84a2-d93c3ed707e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f2df8aa6f2a422bb66da214ea0c183b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:45Z,use_quota=True,user_id='e56c2c9a8d4f4b85adc91cb1a1777784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5720135-7024-4daf-bdca-ad654dbd9006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5720135-7024-4daf-bdca-ad654dbd9006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f0eaef4-7aa9-48ef-bfe6-aa935b0d4426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:44 devstack cinder-volume[86917]: DEBUG cinder.image.glance [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Creating Keystone auth plugin from conf {{(pid=86917) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:10:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f0eaef4-7aa9-48ef-bfe6-aa935b0d4426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3cfc0419-bd09-43b0-84a2-d93c3ed707e8', 'volume_name': 'volume-3cfc0419-bd09-43b0-84a2-d93c3ed707e8', 'volume_size': 1, 'image_id': '19d24755-5fa8-4e1d-aef6-b5fdde452855', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19d24755-5fa8-4e1d-aef6-b5fdde452855', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '307b831956a2452b912f3a0d37f5ee84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '19d24755-5fa8-4e1d-aef6-b5fdde452855', 'created_at': datetime.datetime(2026, 9, 28, 15, 0, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 0, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19d24755-5fa8-4e1d-aef6-b5fdde452855/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (addb0716-9daa-4f0c-af18-327292856efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (addb0716-9daa-4f0c-af18-327292856efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a40a63-5040-4c61-8a69-e5b400d0da4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:45 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Volume 3cfc0419-bd09-43b0-84a2-d93c3ed707e8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3cfc0419-bd09-43b0-84a2-d93c3ed707e8', 'volume_size': 1, 'image_id': '19d24755-5fa8-4e1d-aef6-b5fdde452855', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19d24755-5fa8-4e1d-aef6-b5fdde452855', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '307b831956a2452b912f3a0d37f5ee84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '19d24755-5fa8-4e1d-aef6-b5fdde452855', 'created_at': datetime.datetime(2026, 9, 28, 15, 0, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 0, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19d24755-5fa8-4e1d-aef6-b5fdde452855/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 17:10:45 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Trying to clone 3cfc0419-bd09-43b0-84a2-d93c3ed707e8 from image 19d24755-5fa8-4e1d-aef6-b5fdde452855 at location (None, [{'url': 'file:///opt/stack/data/glance/images/19d24755-5fa8-4e1d-aef6-b5fdde452855', 'metadata': {}}]). {{(pid=86917) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:10:46 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_lhzm9kk3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86917) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:10:46 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Image download 20.69 MB at 20.69 MB/s Sep 28 17:10:46 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e395c72-0aa0-47f6-bcc9-2387be2b657b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_lhzm9kk3devstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:46 devstack sudo[90644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_lhzm9kk3devstack@QuobyteHD Sep 28 17:10:46 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:46 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_lhzm9kk3devstack@QuobyteHD" returned: 0 in 0.512s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:46 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Temporary image 19d24755-5fa8-4e1d-aef6-b5fdde452855 is fetched for user e56c2c9a8d4f4b85adc91cb1a1777784. {{(pid=86917) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:10:46 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed0331c-097b-4695-adf0-7a4bc18819e1]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_lhzm9kk3devstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:47 devstack sudo[90650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_lhzm9kk3devstack@QuobyteHD Sep 28 17:10:47 devstack sudo[90650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:47 devstack sudo[90650]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_lhzm9kk3devstack@QuobyteHD" returned: 0 in 0.513s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:47 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-259197719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cfc0419-bd09-43b0-84a2-d93c3ed707e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f2df8aa6f2a422bb66da214ea0c183b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:45Z,use_quota=True,user_id='e56c2c9a8d4f4b85adc91cb1a1777784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:10:47 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Creating volume 3cfc0419-bd09-43b0-84a2-d93c3ed707e8 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:10:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:47 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:47 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:47 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:10:47 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:10:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3cfc0419-bd09-43b0-84a2-d93c3ed707e8 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:47 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3cfc0419-bd09-43b0-84a2-d93c3ed707e8 1073741824 Sep 28 17:10:47 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:48 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3cfc0419-bd09-43b0-84a2-d93c3ed707e8 1073741824" returned: 0 in 0.749s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3cfc0419-bd09-43b0-84a2-d93c3ed707e8 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:48 devstack sudo[90661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3cfc0419-bd09-43b0-84a2-d93c3ed707e8 Sep 28 17:10:48 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-c03ab90b-fb78-427f-9b99-bc6f027912cc req-0f3f46d7-a921-4ac8-820c-dac24e636bff tempest-AttachVolumeShelveTestJSON-1861052735 None] No connector for attachment 51efe80f-94cd-4e2d-b703-29f1db308f30; skipping storage backend terminate_connection call. {{(pid=86917) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 28 17:10:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-c03ab90b-fb78-427f-9b99-bc6f027912cc req-0f3f46d7-a921-4ac8-820c-dac24e636bff tempest-AttachVolumeShelveTestJSON-1861052735 None] Deleting attachment 51efe80f-94cd-4e2d-b703-29f1db308f30. {{(pid=86917) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:10:48 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3cfc0419-bd09-43b0-84a2-d93c3ed707e8" returned: 0 in 0.332s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:48 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:10:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:48 devstack cinder-volume[86917]: DEBUG cinder.volume.volume_utils [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Attempting download of 19d24755-5fa8-4e1d-aef6-b5fdde452855 ((None, [{'url': 'file:///opt/stack/data/glance/images/19d24755-5fa8-4e1d-aef6-b5fdde452855', 'metadata': {}}])) to volume 3cfc0419-bd09-43b0-84a2-d93c3ed707e8. {{(pid=86917) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:10:48 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6221738c-779e-48cf-90f1-3ce8563d8fb4]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19d24755-5fa8-4e1d-aef6-b5fdde452855_1zohi2me {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:48 devstack sudo[90664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19d24755-5fa8-4e1d-aef6-b5fdde452855_1zohi2me Sep 28 17:10:48 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:49 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19d24755-5fa8-4e1d-aef6-b5fdde452855_1zohi2me" returned: 0 in 0.520s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19d24755-5fa8-4e1d-aef6-b5fdde452855_1zohi2me {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:10:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:49 devstack sudo[90670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:10:49 devstack sudo[90670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:49 devstack sudo[90669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19d24755-5fa8-4e1d-aef6-b5fdde452855_1zohi2me Sep 28 17:10:49 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:49 devstack sudo[90670]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.371s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:49 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:49 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19d24755-5fa8-4e1d-aef6-b5fdde452855_1zohi2me" returned: 1 in 0.556s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19d24755-5fa8-4e1d-aef6-b5fdde452855_1zohi2me' failed. Not Retrying. {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:10:49 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[11740eab-f660-446d-94f1-2cfb16dad451]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_lhzm9kk3devstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:50 devstack sudo[90677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_lhzm9kk3devstack@QuobyteHD Sep 28 17:10:50 devstack sudo[90677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:50 devstack sudo[90677]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_lhzm9kk3devstack@QuobyteHD" returned: 0 in 0.720s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:50 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] 19d24755-5fa8-4e1d-aef6-b5fdde452855 was qcow2, converting to qcow2 {{(pid=86917) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:10:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_lhzm9kk3devstack@QuobyteHD /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3cfc0419-bd09-43b0-84a2-d93c3ed707e8 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:50 devstack sudo[90682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_lhzm9kk3devstack@QuobyteHD /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3cfc0419-bd09-43b0-84a2-d93c3ed707e8 Sep 28 17:10:50 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:51 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc774829-7821-4c1c-b683-be457a3e3ecd tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:10:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dc774829-7821-4c1c-b683-be457a3e3ecd tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Flow 'volume_create_manager' (f66a10a6-2321-416c-88cd-362144e3b91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dc774829-7821-4c1c-b683-be457a3e3ecd tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e602830b-6335-4cda-8b92-79e7438aa8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dc774829-7821-4c1c-b683-be457a3e3ecd tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e602830b-6335-4cda-8b92-79e7438aa8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1959223700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f0dbd98-d450-42f7-aceb-6ddc36b4c1ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b731315fe2a4461b2d834f7eb0cee5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:52Z,use_quota=True,user_id='8ac070af225d4e03a982f13648411d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9356e4b-8e16-4ba7-aef6-5a93ca5759a7),volume_type_id=b9356e4b-8e16-4ba7-aef6-5a93ca5759a7)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dc774829-7821-4c1c-b683-be457a3e3ecd tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd54129-fe5a-45b4-b049-34a90a08e6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dc774829-7821-4c1c-b683-be457a3e3ecd tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd54129-fe5a-45b4-b049-34a90a08e6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dc774829-7821-4c1c-b683-be457a3e3ecd tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17a991d5-764e-4d92-9c26-9f23bc00dd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dc774829-7821-4c1c-b683-be457a3e3ecd tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17a991d5-764e-4d92-9c26-9f23bc00dd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f0dbd98-d450-42f7-aceb-6ddc36b4c1ae', 'volume_name': 'volume-4f0dbd98-d450-42f7-aceb-6ddc36b4c1ae', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dc774829-7821-4c1c-b683-be457a3e3ecd tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba6c25a5-e594-40e0-9b48-c0ed3a66c6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dc774829-7821-4c1c-b683-be457a3e3ecd tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba6c25a5-e594-40e0-9b48-c0ed3a66c6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dc774829-7821-4c1c-b683-be457a3e3ecd tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22b274eb-62a5-4cff-a4fd-52296ada8fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:52 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-dc774829-7821-4c1c-b683-be457a3e3ecd tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Volume 4f0dbd98-d450-42f7-aceb-6ddc36b4c1ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f0dbd98-d450-42f7-aceb-6ddc36b4c1ae', 'volume_size': 1} Sep 28 17:10:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-dc774829-7821-4c1c-b683-be457a3e3ecd tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-dc774829-7821-4c1c-b683-be457a3e3ecd tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-dc774829-7821-4c1c-b683-be457a3e3ecd tempest-VolumeRetypeWithoutMigrationTest-7377594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1959223700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f0dbd98-d450-42f7-aceb-6ddc36b4c1ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b731315fe2a4461b2d834f7eb0cee5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:52Z,use_quota=True,user_id='8ac070af225d4e03a982f13648411d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9356e4b-8e16-4ba7-aef6-5a93ca5759a7),volume_type_id=b9356e4b-8e16-4ba7-aef6-5a93ca5759a7)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:10:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-dc774829-7821-4c1c-b683-be457a3e3ecd tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Creating volume 4f0dbd98-d450-42f7-aceb-6ddc36b4c1ae {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:10:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-dc774829-7821-4c1c-b683-be457a3e3ecd tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-dc774829-7821-4c1c-b683-be457a3e3ecd tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-dc774829-7821-4c1c-b683-be457a3e3ecd tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-dc774829-7821-4c1c-b683-be457a3e3ecd tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-dc774829-7821-4c1c-b683-be457a3e3ecd tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-dc774829-7821-4c1c-b683-be457a3e3ecd tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:10:52 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-dc774829-7821-4c1c-b683-be457a3e3ecd tempest-VolumeRetypeWithoutMigrationTest-7377594 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:10:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-dc774829-7821-4c1c-b683-be457a3e3ecd tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4f0dbd98-d450-42f7-aceb-6ddc36b4c1ae 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:52 devstack sudo[90693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4f0dbd98-d450-42f7-aceb-6ddc36b4c1ae 1073741824 Sep 28 17:10:52 devstack sudo[90693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:52 devstack sudo[90693]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-dc774829-7821-4c1c-b683-be457a3e3ecd tempest-VolumeRetypeWithoutMigrationTest-7377594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4f0dbd98-d450-42f7-aceb-6ddc36b4c1ae 1073741824" returned: 0 in 0.871s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-dc774829-7821-4c1c-b683-be457a3e3ecd tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4f0dbd98-d450-42f7-aceb-6ddc36b4c1ae {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:53 devstack sudo[90701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4f0dbd98-d450-42f7-aceb-6ddc36b4c1ae Sep 28 17:10:53 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:53 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-dc774829-7821-4c1c-b683-be457a3e3ecd tempest-VolumeRetypeWithoutMigrationTest-7377594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4f0dbd98-d450-42f7-aceb-6ddc36b4c1ae" returned: 0 in 0.443s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:53 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-dc774829-7821-4c1c-b683-be457a3e3ecd tempest-VolumeRetypeWithoutMigrationTest-7377594 None] <== create_volume: return (1386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:10:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-dc774829-7821-4c1c-b683-be457a3e3ecd tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dc774829-7821-4c1c-b683-be457a3e3ecd tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22b274eb-62a5-4cff-a4fd-52296ada8fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f0dbd98-d450-42f7-aceb-6ddc36b4c1ae', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dc774829-7821-4c1c-b683-be457a3e3ecd tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7829e836-a873-40e9-aab3-28f651ba43c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:53 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-dc774829-7821-4c1c-b683-be457a3e3ecd tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Volume volume-4f0dbd98-d450-42f7-aceb-6ddc36b4c1ae (4f0dbd98-d450-42f7-aceb-6ddc36b4c1ae): created successfully Sep 28 17:10:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dc774829-7821-4c1c-b683-be457a3e3ecd tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7829e836-a873-40e9-aab3-28f651ba43c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dc774829-7821-4c1c-b683-be457a3e3ecd tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Flow 'volume_create_manager' (f66a10a6-2321-416c-88cd-362144e3b91e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:53 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-dc774829-7821-4c1c-b683-be457a3e3ecd tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Created volume successfully. Sep 28 17:10:54 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_lhzm9kk3devstack@QuobyteHD /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3cfc0419-bd09-43b0-84a2-d93c3ed707e8" returned: 0 in 3.607s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:54 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_lhzm9kk3devstack@QuobyteHD, size 112.00 MB, duration 3.61 sec, destination /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3cfc0419-bd09-43b0-84a2-d93c3ed707e8 {{(pid=86917) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:10:54 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Converted 112.00 MB image at 31.00 MB/s Sep 28 17:10:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3cfc0419-bd09-43b0-84a2-d93c3ed707e8 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:54 devstack sudo[90704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3cfc0419-bd09-43b0-84a2-d93c3ed707e8 1G Sep 28 17:10:54 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a3f14fd1-23cf-49f3-902b-427e874c367f tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a3f14fd1-23cf-49f3-902b-427e874c367f tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:54 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a3f14fd1-23cf-49f3-902b-427e874c367f tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:54 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a3f14fd1-23cf-49f3-902b-427e874c367f tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a3f14fd1-23cf-49f3-902b-427e874c367f tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a3f14fd1-23cf-49f3-902b-427e874c367f tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:54 devstack sudo[90710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:10:54 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:54 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3cfc0419-bd09-43b0-84a2-d93c3ed707e8 1G" returned: 0 in 0.754s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:54 devstack cinder-volume[86917]: DEBUG cinder.volume.volume_utils [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Downloaded image 19d24755-5fa8-4e1d-aef6-b5fdde452855 ((None, [{'url': 'file:///opt/stack/data/glance/images/19d24755-5fa8-4e1d-aef6-b5fdde452855', 'metadata': {}}])) to volume 3cfc0419-bd09-43b0-84a2-d93c3ed707e8 successfully. {{(pid=86917) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:10:54 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Temporary image 19d24755-5fa8-4e1d-aef6-b5fdde452855 for user e56c2c9a8d4f4b85adc91cb1a1777784 is deleted. {{(pid=86917) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:10:54 devstack cinder-volume[86917]: DEBUG cinder.volume.volume_utils [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Marking volume 3cfc0419-bd09-43b0-84a2-d93c3ed707e8 as bootable. {{(pid=86917) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:10:54 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Copying metadata from image 19d24755-5fa8-4e1d-aef6-b5fdde452855 to 3cfc0419-bd09-43b0-84a2-d93c3ed707e8. {{(pid=86917) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:10:54 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Creating volume glance metadata for volume 3cfc0419-bd09-43b0-84a2-d93c3ed707e8 backed by image 19d24755-5fa8-4e1d-aef6-b5fdde452855 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '19d24755-5fa8-4e1d-aef6-b5fdde452855', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86917) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:10:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a40a63-5040-4c61-8a69-e5b400d0da4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cfc0419-bd09-43b0-84a2-d93c3ed707e8', 'volume_size': 1, 'image_id': '19d24755-5fa8-4e1d-aef6-b5fdde452855', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19d24755-5fa8-4e1d-aef6-b5fdde452855', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '307b831956a2452b912f3a0d37f5ee84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '19d24755-5fa8-4e1d-aef6-b5fdde452855', 'created_at': datetime.datetime(2026, 9, 28, 15, 0, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 0, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19d24755-5fa8-4e1d-aef6-b5fdde452855/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (896693c6-95b4-4ae4-9b93-76f6d3955e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:55 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Volume volume-3cfc0419-bd09-43b0-84a2-d93c3ed707e8 (3cfc0419-bd09-43b0-84a2-d93c3ed707e8): created successfully Sep 28 17:10:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (896693c6-95b4-4ae4-9b93-76f6d3955e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Flow 'volume_create_manager' (fef0aad3-efa9-4f94-954d-cd953e9f419e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:55 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-97c32e5c-a613-4ec9-8944-ab1e5269d7db tempest-ServerActionsTestOtherA-1979217729 None] Created volume successfully. Sep 28 17:10:55 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a3f14fd1-23cf-49f3-902b-427e874c367f tempest-VolumeRetypeWithoutMigrationTest-7377594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.512s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:55 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-a3f14fd1-23cf-49f3-902b-427e874c367f tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:55 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-a3f14fd1-23cf-49f3-902b-427e874c367f tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Retype volume completed successfully. Sep 28 17:10:56 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0241f00c-bf34-42cc-94f9-51a592a3b207 tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Acquiring lock "cinder-4f0dbd98-d450-42f7-aceb-6ddc36b4c1ae-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:56 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0241f00c-bf34-42cc-94f9-51a592a3b207 tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Lock "cinder-4f0dbd98-d450-42f7-aceb-6ddc36b4c1ae-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:56 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0241f00c-bf34-42cc-94f9-51a592a3b207 tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Acquiring lock "cinder-quobyte-4f0dbd98-d450-42f7-aceb-6ddc36b4c1ae" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:56 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0241f00c-bf34-42cc-94f9-51a592a3b207 tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Lock "cinder-quobyte-4f0dbd98-d450-42f7-aceb-6ddc36b4c1ae" acquired by "delete_volume" :: waited 0.027s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:56 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54028f3-14da-4742-af71-196fe25b8175]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0241f00c-bf34-42cc-94f9-51a592a3b207 tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4f0dbd98-d450-42f7-aceb-6ddc36b4c1ae {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:56 devstack sudo[90715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4f0dbd98-d450-42f7-aceb-6ddc36b4c1ae Sep 28 17:10:56 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:57 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0241f00c-bf34-42cc-94f9-51a592a3b207 tempest-VolumeRetypeWithoutMigrationTest-7377594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4f0dbd98-d450-42f7-aceb-6ddc36b4c1ae" returned: 0 in 1.054s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0241f00c-bf34-42cc-94f9-51a592a3b207 tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4f0dbd98-d450-42f7-aceb-6ddc36b4c1ae {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:57 devstack sudo[90721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4f0dbd98-d450-42f7-aceb-6ddc36b4c1ae Sep 28 17:10:57 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:58 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0241f00c-bf34-42cc-94f9-51a592a3b207 tempest-VolumeRetypeWithoutMigrationTest-7377594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4f0dbd98-d450-42f7-aceb-6ddc36b4c1ae" returned: 0 in 0.599s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:58 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0241f00c-bf34-42cc-94f9-51a592a3b207 tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Lock "cinder-quobyte-4f0dbd98-d450-42f7-aceb-6ddc36b4c1ae" released by "delete_volume" :: held 1.755s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:58 devstack cinder-volume[86917]: WARNING cinder.quota [None req-0241f00c-bf34-42cc-94f9-51a592a3b207 tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:10:58 devstack cinder-volume[86917]: WARNING cinder.quota [None req-0241f00c-bf34-42cc-94f9-51a592a3b207 tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:10:58 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-0241f00c-bf34-42cc-94f9-51a592a3b207 tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Created reservations ['8519da52-91d4-447c-a47f-32972c923b5e', '1aee1399-9f38-4e20-9c48-deb6d11b202a', '5df21a47-3163-4047-ba9a-f5ad0b8c3e3e', '0c70edb7-9515-4bc8-ad4d-3ca2fac954fa'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0241f00c-bf34-42cc-94f9-51a592a3b207 tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0241f00c-bf34-42cc-94f9-51a592a3b207 tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:58 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0241f00c-bf34-42cc-94f9-51a592a3b207 tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:58 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0241f00c-bf34-42cc-94f9-51a592a3b207 tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0241f00c-bf34-42cc-94f9-51a592a3b207 tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0241f00c-bf34-42cc-94f9-51a592a3b207 tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:58 devstack sudo[90727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:10:58 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:59 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0241f00c-bf34-42cc-94f9-51a592a3b207 tempest-VolumeRetypeWithoutMigrationTest-7377594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.676s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:59 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-0241f00c-bf34-42cc-94f9-51a592a3b207 tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:59 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-0241f00c-bf34-42cc-94f9-51a592a3b207 tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Deleted volume successfully. Sep 28 17:10:59 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0241f00c-bf34-42cc-94f9-51a592a3b207 tempest-VolumeRetypeWithoutMigrationTest-7377594 None] Lock "cinder-4f0dbd98-d450-42f7-aceb-6ddc36b4c1ae-delete_volume" released by "delete_volume" :: held 2.875s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-ff6a8998-7db7-4b73-a33c-980886e9756c req-30f1a7d0-4409-4e75-ae46-d87eeefe162d tempest-ServerActionsTestOtherA-1979217729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-ff6a8998-7db7-4b73-a33c-980886e9756c req-30f1a7d0-4409-4e75-ae46-d87eeefe162d tempest-ServerActionsTestOtherA-1979217729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-ff6a8998-7db7-4b73-a33c-980886e9756c req-30f1a7d0-4409-4e75-ae46-d87eeefe162d tempest-ServerActionsTestOtherA-1979217729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-ff6a8998-7db7-4b73-a33c-980886e9756c req-30f1a7d0-4409-4e75-ae46-d87eeefe162d tempest-ServerActionsTestOtherA-1979217729 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069', 'name': 'volume-3cfc0419-bd09-43b0-84a2-d93c3ed707e8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf694f0a-af41-4d14-aa06-4e4a34b67a5b', 'enforce_multipath': True} {{(pid=86917) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:11:01 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-ff6a8998-7db7-4b73-a33c-980886e9756c req-30f1a7d0-4409-4e75-ae46-d87eeefe162d tempest-ServerActionsTestOtherA-1979217729 None] attachment_update completed successfully. Sep 28 17:11:11 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=30,cinder:INSERT=10,cinder:UPDATE=26 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:11:11 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=56,cinder:INSERT=15,cinder:UPDATE=43,cinder:DELETE=7 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:11:35 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-0cc1935d-2762-4c14-887c-c0ca3410f1d5 req-525c7aef-cfc2-4e80-85a0-25589f31ea75 tempest-ServerActionsTestOtherA-1979217729 None] Terminate volume connection completed successfully. Sep 28 17:11:35 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-0cc1935d-2762-4c14-887c-c0ca3410f1d5 req-525c7aef-cfc2-4e80-85a0-25589f31ea75 tempest-ServerActionsTestOtherA-1979217729 None] Deleting attachment bf694f0a-af41-4d14-aa06-4e4a34b67a5b. {{(pid=86917) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:11:43 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-02f579ec-772c-472a-9009-7152fc4e4c89 tempest-AbsoluteLimitsTests-1524153762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:11:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-02f579ec-772c-472a-9009-7152fc4e4c89 tempest-AbsoluteLimitsTests-1524153762 None] Flow 'volume_create_manager' (127c5bd8-08d8-4d95-ad02-a49c5e24808c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-02f579ec-772c-472a-9009-7152fc4e4c89 tempest-AbsoluteLimitsTests-1524153762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (121feb62-9c2d-43b3-a9a2-8b0be7df46e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-02f579ec-772c-472a-9009-7152fc4e4c89 tempest-AbsoluteLimitsTests-1524153762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (121feb62-9c2d-43b3-a9a2-8b0be7df46e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1243819811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9aa5e06-4ffa-483d-ad35-a90975eace45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eea414e82a24dc8a10666674b0f6e72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:43Z,use_quota=True,user_id='df0bb136c9fa4fa2abc1614c52767037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-02f579ec-772c-472a-9009-7152fc4e4c89 tempest-AbsoluteLimitsTests-1524153762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8ba167e-dda7-4f08-9fc1-f6cdfc069a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-02f579ec-772c-472a-9009-7152fc4e4c89 tempest-AbsoluteLimitsTests-1524153762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8ba167e-dda7-4f08-9fc1-f6cdfc069a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-02f579ec-772c-472a-9009-7152fc4e4c89 tempest-AbsoluteLimitsTests-1524153762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7dd4b3a-1080-4859-be43-122b7aa01f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-02f579ec-772c-472a-9009-7152fc4e4c89 tempest-AbsoluteLimitsTests-1524153762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7dd4b3a-1080-4859-be43-122b7aa01f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9aa5e06-4ffa-483d-ad35-a90975eace45', 'volume_name': 'volume-c9aa5e06-4ffa-483d-ad35-a90975eace45', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-02f579ec-772c-472a-9009-7152fc4e4c89 tempest-AbsoluteLimitsTests-1524153762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1780676f-b4e1-4e08-981d-3b68af1ad076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-02f579ec-772c-472a-9009-7152fc4e4c89 tempest-AbsoluteLimitsTests-1524153762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1780676f-b4e1-4e08-981d-3b68af1ad076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-02f579ec-772c-472a-9009-7152fc4e4c89 tempest-AbsoluteLimitsTests-1524153762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8146760f-89b6-4a79-bb31-0c996ad8de5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:43 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-02f579ec-772c-472a-9009-7152fc4e4c89 tempest-AbsoluteLimitsTests-1524153762 None] Volume c9aa5e06-4ffa-483d-ad35-a90975eace45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9aa5e06-4ffa-483d-ad35-a90975eace45', 'volume_size': 1} Sep 28 17:11:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-02f579ec-772c-472a-9009-7152fc4e4c89 tempest-AbsoluteLimitsTests-1524153762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-02f579ec-772c-472a-9009-7152fc4e4c89 tempest-AbsoluteLimitsTests-1524153762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:43 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-02f579ec-772c-472a-9009-7152fc4e4c89 tempest-AbsoluteLimitsTests-1524153762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1243819811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9aa5e06-4ffa-483d-ad35-a90975eace45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eea414e82a24dc8a10666674b0f6e72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:43Z,use_quota=True,user_id='df0bb136c9fa4fa2abc1614c52767037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:11:43 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-02f579ec-772c-472a-9009-7152fc4e4c89 tempest-AbsoluteLimitsTests-1524153762 None] Creating volume c9aa5e06-4ffa-483d-ad35-a90975eace45 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:11:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-02f579ec-772c-472a-9009-7152fc4e4c89 tempest-AbsoluteLimitsTests-1524153762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-02f579ec-772c-472a-9009-7152fc4e4c89 tempest-AbsoluteLimitsTests-1524153762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:43 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-02f579ec-772c-472a-9009-7152fc4e4c89 tempest-AbsoluteLimitsTests-1524153762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:43 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-02f579ec-772c-472a-9009-7152fc4e4c89 tempest-AbsoluteLimitsTests-1524153762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-02f579ec-772c-472a-9009-7152fc4e4c89 tempest-AbsoluteLimitsTests-1524153762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:43 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-02f579ec-772c-472a-9009-7152fc4e4c89 tempest-AbsoluteLimitsTests-1524153762 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:11:43 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-02f579ec-772c-472a-9009-7152fc4e4c89 tempest-AbsoluteLimitsTests-1524153762 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:11:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-02f579ec-772c-472a-9009-7152fc4e4c89 tempest-AbsoluteLimitsTests-1524153762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c9aa5e06-4ffa-483d-ad35-a90975eace45 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:43 devstack sudo[91539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c9aa5e06-4ffa-483d-ad35-a90975eace45 1073741824 Sep 28 17:11:43 devstack sudo[91539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:44 devstack sudo[91539]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-02f579ec-772c-472a-9009-7152fc4e4c89 tempest-AbsoluteLimitsTests-1524153762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c9aa5e06-4ffa-483d-ad35-a90975eace45 1073741824" returned: 0 in 1.352s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-02f579ec-772c-472a-9009-7152fc4e4c89 tempest-AbsoluteLimitsTests-1524153762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c9aa5e06-4ffa-483d-ad35-a90975eace45 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:45 devstack sudo[91605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c9aa5e06-4ffa-483d-ad35-a90975eace45 Sep 28 17:11:45 devstack sudo[91605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-0cc1935d-2762-4c14-887c-c0ca3410f1d5 req-0af6209a-fc56-422f-a194-b794eb8fb074 tempest-ServerActionsTestOtherA-1979217729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:45 devstack sudo[91605]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-02f579ec-772c-472a-9009-7152fc4e4c89 tempest-AbsoluteLimitsTests-1524153762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c9aa5e06-4ffa-483d-ad35-a90975eace45" returned: 0 in 0.551s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-02f579ec-772c-472a-9009-7152fc4e4c89 tempest-AbsoluteLimitsTests-1524153762 None] <== create_volume: return (2074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:11:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-02f579ec-772c-472a-9009-7152fc4e4c89 tempest-AbsoluteLimitsTests-1524153762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.078s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-0cc1935d-2762-4c14-887c-c0ca3410f1d5 req-0af6209a-fc56-422f-a194-b794eb8fb074 tempest-ServerActionsTestOtherA-1979217729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.398s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-02f579ec-772c-472a-9009-7152fc4e4c89 tempest-AbsoluteLimitsTests-1524153762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8146760f-89b6-4a79-bb31-0c996ad8de5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9aa5e06-4ffa-483d-ad35-a90975eace45', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-02f579ec-772c-472a-9009-7152fc4e4c89 tempest-AbsoluteLimitsTests-1524153762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdadc66e-330c-4539-95b5-6fb3d1728432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-0cc1935d-2762-4c14-887c-c0ca3410f1d5 req-0af6209a-fc56-422f-a194-b794eb8fb074 tempest-ServerActionsTestOtherA-1979217729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.054s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:45 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-02f579ec-772c-472a-9009-7152fc4e4c89 tempest-AbsoluteLimitsTests-1524153762 None] Volume volume-c9aa5e06-4ffa-483d-ad35-a90975eace45 (c9aa5e06-4ffa-483d-ad35-a90975eace45): created successfully Sep 28 17:11:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-02f579ec-772c-472a-9009-7152fc4e4c89 tempest-AbsoluteLimitsTests-1524153762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdadc66e-330c-4539-95b5-6fb3d1728432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-02f579ec-772c-472a-9009-7152fc4e4c89 tempest-AbsoluteLimitsTests-1524153762 None] Flow 'volume_create_manager' (127c5bd8-08d8-4d95-ad02-a49c5e24808c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:45 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-02f579ec-772c-472a-9009-7152fc4e4c89 tempest-AbsoluteLimitsTests-1524153762 None] Created volume successfully. Sep 28 17:11:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-0cc1935d-2762-4c14-887c-c0ca3410f1d5 req-0af6209a-fc56-422f-a194-b794eb8fb074 tempest-ServerActionsTestOtherA-1979217729 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069', 'name': 'volume-3cfc0419-bd09-43b0-84a2-d93c3ed707e8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4bc259ee-1348-469c-b474-9543a84dcb7e', 'enforce_multipath': True} {{(pid=86917) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:11:45 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-0cc1935d-2762-4c14-887c-c0ca3410f1d5 req-0af6209a-fc56-422f-a194-b794eb8fb074 tempest-ServerActionsTestOtherA-1979217729 None] attachment_update completed successfully. Sep 28 17:11:47 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f9727dcb-ee5c-47f2-970c-3ce1e6a84ca8 tempest-AbsoluteLimitsTests-1524153762 None] Acquiring lock "cinder-c9aa5e06-4ffa-483d-ad35-a90975eace45-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:47 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f9727dcb-ee5c-47f2-970c-3ce1e6a84ca8 tempest-AbsoluteLimitsTests-1524153762 None] Lock "cinder-c9aa5e06-4ffa-483d-ad35-a90975eace45-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:47 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f9727dcb-ee5c-47f2-970c-3ce1e6a84ca8 tempest-AbsoluteLimitsTests-1524153762 None] Acquiring lock "cinder-quobyte-c9aa5e06-4ffa-483d-ad35-a90975eace45" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:47 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f9727dcb-ee5c-47f2-970c-3ce1e6a84ca8 tempest-AbsoluteLimitsTests-1524153762 None] Lock "cinder-quobyte-c9aa5e06-4ffa-483d-ad35-a90975eace45" acquired by "delete_volume" :: waited 0.061s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:47 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[93236dfa-3c4a-462b-a692-f5cf0fcf377b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f9727dcb-ee5c-47f2-970c-3ce1e6a84ca8 tempest-AbsoluteLimitsTests-1524153762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c9aa5e06-4ffa-483d-ad35-a90975eace45 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:48 devstack sudo[91890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c9aa5e06-4ffa-483d-ad35-a90975eace45 Sep 28 17:11:48 devstack sudo[91890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:48 devstack sudo[91890]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f9727dcb-ee5c-47f2-970c-3ce1e6a84ca8 tempest-AbsoluteLimitsTests-1524153762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c9aa5e06-4ffa-483d-ad35-a90975eace45" returned: 0 in 0.618s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f9727dcb-ee5c-47f2-970c-3ce1e6a84ca8 tempest-AbsoluteLimitsTests-1524153762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c9aa5e06-4ffa-483d-ad35-a90975eace45 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:48 devstack sudo[92108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c9aa5e06-4ffa-483d-ad35-a90975eace45 Sep 28 17:11:48 devstack sudo[92108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:48 devstack sudo[92108]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f9727dcb-ee5c-47f2-970c-3ce1e6a84ca8 tempest-AbsoluteLimitsTests-1524153762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c9aa5e06-4ffa-483d-ad35-a90975eace45" returned: 0 in 0.451s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:48 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f9727dcb-ee5c-47f2-970c-3ce1e6a84ca8 tempest-AbsoluteLimitsTests-1524153762 None] Lock "cinder-quobyte-c9aa5e06-4ffa-483d-ad35-a90975eace45" released by "delete_volume" :: held 1.174s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:49 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-f9727dcb-ee5c-47f2-970c-3ce1e6a84ca8 tempest-AbsoluteLimitsTests-1524153762 None] Created reservations ['c3467456-d842-4bf8-a9eb-d5fbe1d7f286', 'eb74f9e7-0eae-400f-bb0f-92e5d96c4e4e', '34a726e5-065e-440a-8ce2-c4d9f95fd60f', '089d4300-b12e-409c-99ba-15f257e46d2b'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f9727dcb-ee5c-47f2-970c-3ce1e6a84ca8 tempest-AbsoluteLimitsTests-1524153762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f9727dcb-ee5c-47f2-970c-3ce1e6a84ca8 tempest-AbsoluteLimitsTests-1524153762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f9727dcb-ee5c-47f2-970c-3ce1e6a84ca8 tempest-AbsoluteLimitsTests-1524153762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f9727dcb-ee5c-47f2-970c-3ce1e6a84ca8 tempest-AbsoluteLimitsTests-1524153762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f9727dcb-ee5c-47f2-970c-3ce1e6a84ca8 tempest-AbsoluteLimitsTests-1524153762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f9727dcb-ee5c-47f2-970c-3ce1e6a84ca8 tempest-AbsoluteLimitsTests-1524153762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:49 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6faa3446-734b-4646-a567-4a9d8cf8d793 tempest-AttachVolumeShelveTestJSON-1861052735 None] Acquiring lock "cinder-9fd558c6-b374-4aa5-9d48-20f9d48f3b7f-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:11:49 devstack sudo[92131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:11:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:49 devstack sudo[92131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:49 devstack sudo[92136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:11:49 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6faa3446-734b-4646-a567-4a9d8cf8d793 tempest-AttachVolumeShelveTestJSON-1861052735 None] Lock "cinder-9fd558c6-b374-4aa5-9d48-20f9d48f3b7f-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:49 devstack sudo[92136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:49 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6faa3446-734b-4646-a567-4a9d8cf8d793 tempest-AttachVolumeShelveTestJSON-1861052735 None] Acquiring lock "cinder-quobyte-9fd558c6-b374-4aa5-9d48-20f9d48f3b7f" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:49 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6faa3446-734b-4646-a567-4a9d8cf8d793 tempest-AttachVolumeShelveTestJSON-1861052735 None] Lock "cinder-quobyte-9fd558c6-b374-4aa5-9d48-20f9d48f3b7f" acquired by "delete_volume" :: waited 0.025s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:49 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[261a18d3-9910-483a-a785-be471c8e3e49]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6faa3446-734b-4646-a567-4a9d8cf8d793 tempest-AttachVolumeShelveTestJSON-1861052735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-9fd558c6-b374-4aa5-9d48-20f9d48f3b7f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:49 devstack sudo[92136]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.604s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:49 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:50 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager._thread_info {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:11:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread count: 28 {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:11:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread info: [<_MainThread(MainThread, started 132915553284224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:11:50 devstack sudo[92138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-9fd558c6-b374-4aa5-9d48-20f9d48f3b7f Sep 28 17:11:50 devstack sudo[92138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:50 devstack sudo[92131]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f9727dcb-ee5c-47f2-970c-3ce1e6a84ca8 tempest-AbsoluteLimitsTests-1524153762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.913s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:50 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-f9727dcb-ee5c-47f2-970c-3ce1e6a84ca8 tempest-AbsoluteLimitsTests-1524153762 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:50 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-f9727dcb-ee5c-47f2-970c-3ce1e6a84ca8 tempest-AbsoluteLimitsTests-1524153762 None] Deleted volume successfully. Sep 28 17:11:50 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f9727dcb-ee5c-47f2-970c-3ce1e6a84ca8 tempest-AbsoluteLimitsTests-1524153762 None] Lock "cinder-c9aa5e06-4ffa-483d-ad35-a90975eace45-delete_volume" released by "delete_volume" :: held 2.700s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:50 devstack sudo[92138]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6faa3446-734b-4646-a567-4a9d8cf8d793 tempest-AttachVolumeShelveTestJSON-1861052735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-9fd558c6-b374-4aa5-9d48-20f9d48f3b7f" returned: 0 in 1.264s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6faa3446-734b-4646-a567-4a9d8cf8d793 tempest-AttachVolumeShelveTestJSON-1861052735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-9fd558c6-b374-4aa5-9d48-20f9d48f3b7f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:50 devstack sudo[92170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-9fd558c6-b374-4aa5-9d48-20f9d48f3b7f Sep 28 17:11:50 devstack sudo[92170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:51 devstack sudo[92170]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6faa3446-734b-4646-a567-4a9d8cf8d793 tempest-AttachVolumeShelveTestJSON-1861052735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-9fd558c6-b374-4aa5-9d48-20f9d48f3b7f" returned: 0 in 0.635s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:51 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6faa3446-734b-4646-a567-4a9d8cf8d793 tempest-AttachVolumeShelveTestJSON-1861052735 None] Lock "cinder-quobyte-9fd558c6-b374-4aa5-9d48-20f9d48f3b7f" released by "delete_volume" :: held 2.031s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:51 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-6faa3446-734b-4646-a567-4a9d8cf8d793 tempest-AttachVolumeShelveTestJSON-1861052735 None] Created reservations ['844b8bc2-fbd9-4e42-8edb-c23891924cc8', '7509d084-0b6a-4080-a998-0491db0cda92', 'fe155603-4525-4c64-8526-c921d873717a', 'e7c9cf97-06ac-471b-b60b-90c37595f8ea'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6faa3446-734b-4646-a567-4a9d8cf8d793 tempest-AttachVolumeShelveTestJSON-1861052735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6faa3446-734b-4646-a567-4a9d8cf8d793 tempest-AttachVolumeShelveTestJSON-1861052735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6faa3446-734b-4646-a567-4a9d8cf8d793 tempest-AttachVolumeShelveTestJSON-1861052735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6faa3446-734b-4646-a567-4a9d8cf8d793 tempest-AttachVolumeShelveTestJSON-1861052735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6faa3446-734b-4646-a567-4a9d8cf8d793 tempest-AttachVolumeShelveTestJSON-1861052735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6faa3446-734b-4646-a567-4a9d8cf8d793 tempest-AttachVolumeShelveTestJSON-1861052735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:52 devstack sudo[92185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:11:52 devstack sudo[92185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:53 devstack sudo[92185]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6faa3446-734b-4646-a567-4a9d8cf8d793 tempest-AttachVolumeShelveTestJSON-1861052735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 1.025s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:53 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-6faa3446-734b-4646-a567-4a9d8cf8d793 tempest-AttachVolumeShelveTestJSON-1861052735 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:53 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-6faa3446-734b-4646-a567-4a9d8cf8d793 tempest-AttachVolumeShelveTestJSON-1861052735 None] Deleted volume successfully. Sep 28 17:11:53 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6faa3446-734b-4646-a567-4a9d8cf8d793 tempest-AttachVolumeShelveTestJSON-1861052735 None] Lock "cinder-9fd558c6-b374-4aa5-9d48-20f9d48f3b7f-delete_volume" released by "delete_volume" :: held 4.041s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:02 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=24,cinder:UPDATE=23,cinder:DELETE=2,cinder:INSERT=4 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:12:03 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=15,cinder:UPDATE=18,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:12:09 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b159d09-ae72-4682-843f-a823722baea8 tempest-VolumesDeleteCascade-44747889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2b159d09-ae72-4682-843f-a823722baea8 tempest-VolumesDeleteCascade-44747889 None] Flow 'volume_create_manager' (1610f039-87c6-469e-9621-2cd5f3adbcbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2b159d09-ae72-4682-843f-a823722baea8 tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9461605e-f948-40c5-a95d-30a524d02fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2b159d09-ae72-4682-843f-a823722baea8 tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9461605e-f948-40c5-a95d-30a524d02fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-91696302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d1a1511f1444f299332ba23d462013a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:09Z,use_quota=True,user_id='c1142f48d0b5403c8cb2992111efde1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2b159d09-ae72-4682-843f-a823722baea8 tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b46690dd-cfcf-43a3-8f32-bdc340f13f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2b159d09-ae72-4682-843f-a823722baea8 tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b46690dd-cfcf-43a3-8f32-bdc340f13f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2b159d09-ae72-4682-843f-a823722baea8 tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24146c97-b945-4073-acf2-2d96d201d4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2b159d09-ae72-4682-843f-a823722baea8 tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24146c97-b945-4073-acf2-2d96d201d4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc', 'volume_name': 'volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2b159d09-ae72-4682-843f-a823722baea8 tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5293838e-74ff-492a-987c-61c153745d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2b159d09-ae72-4682-843f-a823722baea8 tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5293838e-74ff-492a-987c-61c153745d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2b159d09-ae72-4682-843f-a823722baea8 tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b4d663b-bd4d-41f3-ba25-7886428468f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:09 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-2b159d09-ae72-4682-843f-a823722baea8 tempest-VolumesDeleteCascade-44747889 None] Volume 3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc', 'volume_size': 1} Sep 28 17:12:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2b159d09-ae72-4682-843f-a823722baea8 tempest-VolumesDeleteCascade-44747889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2b159d09-ae72-4682-843f-a823722baea8 tempest-VolumesDeleteCascade-44747889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-2b159d09-ae72-4682-843f-a823722baea8 tempest-VolumesDeleteCascade-44747889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-91696302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d1a1511f1444f299332ba23d462013a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:09Z,use_quota=True,user_id='c1142f48d0b5403c8cb2992111efde1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-2b159d09-ae72-4682-843f-a823722baea8 tempest-VolumesDeleteCascade-44747889 None] Creating volume 3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2b159d09-ae72-4682-843f-a823722baea8 tempest-VolumesDeleteCascade-44747889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2b159d09-ae72-4682-843f-a823722baea8 tempest-VolumesDeleteCascade-44747889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-2b159d09-ae72-4682-843f-a823722baea8 tempest-VolumesDeleteCascade-44747889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-2b159d09-ae72-4682-843f-a823722baea8 tempest-VolumesDeleteCascade-44747889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2b159d09-ae72-4682-843f-a823722baea8 tempest-VolumesDeleteCascade-44747889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-2b159d09-ae72-4682-843f-a823722baea8 tempest-VolumesDeleteCascade-44747889 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:09 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-2b159d09-ae72-4682-843f-a823722baea8 tempest-VolumesDeleteCascade-44747889 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:12:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2b159d09-ae72-4682-843f-a823722baea8 tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:09 devstack sudo[92284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc 1073741824 Sep 28 17:12:09 devstack sudo[92284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:11 devstack sudo[92284]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2b159d09-ae72-4682-843f-a823722baea8 tempest-VolumesDeleteCascade-44747889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc 1073741824" returned: 0 in 1.434s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2b159d09-ae72-4682-843f-a823722baea8 tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:11 devstack sudo[92341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc Sep 28 17:12:11 devstack sudo[92341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:11 devstack sudo[92341]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2b159d09-ae72-4682-843f-a823722baea8 tempest-VolumesDeleteCascade-44747889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc" returned: 0 in 0.768s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-2b159d09-ae72-4682-843f-a823722baea8 tempest-VolumesDeleteCascade-44747889 None] <== create_volume: return (2329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2b159d09-ae72-4682-843f-a823722baea8 tempest-VolumesDeleteCascade-44747889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.343s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2b159d09-ae72-4682-843f-a823722baea8 tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b4d663b-bd4d-41f3-ba25-7886428468f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2b159d09-ae72-4682-843f-a823722baea8 tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f772fa5-9f51-4825-8efd-7d3455b29e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:12 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-2b159d09-ae72-4682-843f-a823722baea8 tempest-VolumesDeleteCascade-44747889 None] Volume volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc (3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc): created successfully Sep 28 17:12:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2b159d09-ae72-4682-843f-a823722baea8 tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f772fa5-9f51-4825-8efd-7d3455b29e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2b159d09-ae72-4682-843f-a823722baea8 tempest-VolumesDeleteCascade-44747889 None] Flow 'volume_create_manager' (1610f039-87c6-469e-9621-2cd5f3adbcbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:12 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-2b159d09-ae72-4682-843f-a823722baea8 tempest-VolumesDeleteCascade-44747889 None] Created volume successfully. Sep 28 17:12:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-cdf11322-5b14-4afa-9692-9f7cd76b1364 tempest-VolumesDeleteCascade-44747889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-cdf11322-5b14-4afa-9692-9f7cd76b1364 tempest-VolumesDeleteCascade-44747889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:13 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-cdf11322-5b14-4afa-9692-9f7cd76b1364 tempest-VolumesDeleteCascade-44747889 None] Creating offline snapshot 0fdafae7-c523-44df-8141-1a6dbf60d525 of volume 3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:12:13 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05e3057-b6a7-4c7c-811f-8fc456fd6e29]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-cdf11322-5b14-4afa-9692-9f7cd76b1364 tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:13 devstack sudo[92405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc Sep 28 17:12:13 devstack sudo[92405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:14 devstack sudo[92405]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-cdf11322-5b14-4afa-9692-9f7cd76b1364 tempest-VolumesDeleteCascade-44747889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc" returned: 0 in 0.914s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-cdf11322-5b14-4afa-9692-9f7cd76b1364 tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.0fdafae7-c523-44df-8141-1a6dbf60d525 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:14 devstack sudo[92410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.0fdafae7-c523-44df-8141-1a6dbf60d525 1G Sep 28 17:12:14 devstack sudo[92410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:14 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-db3e42f3-a7b7-446a-9e13-830d93da7bd3 tempest-ServerRescueNegativeTestJSON-1997199596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-db3e42f3-a7b7-446a-9e13-830d93da7bd3 tempest-ServerRescueNegativeTestJSON-1997199596 None] Flow 'volume_create_manager' (20f0fdd3-95db-48f9-a0d3-8e604de45302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-db3e42f3-a7b7-446a-9e13-830d93da7bd3 tempest-ServerRescueNegativeTestJSON-1997199596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e29988-1f35-4c75-9544-8589f712a057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-db3e42f3-a7b7-446a-9e13-830d93da7bd3 tempest-ServerRescueNegativeTestJSON-1997199596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e29988-1f35-4c75-9544-8589f712a057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-605066426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ca8c30-8724-4537-8faf-ecef8fa66b1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e447c315c4524741979ddc8242c04110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:15Z,use_quota=True,user_id='2821e2b316fb4f7e863aaa2f1ffa7a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-db3e42f3-a7b7-446a-9e13-830d93da7bd3 tempest-ServerRescueNegativeTestJSON-1997199596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a6b101-bc90-4595-b749-1b0643ca5cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-db3e42f3-a7b7-446a-9e13-830d93da7bd3 tempest-ServerRescueNegativeTestJSON-1997199596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a6b101-bc90-4595-b749-1b0643ca5cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-db3e42f3-a7b7-446a-9e13-830d93da7bd3 tempest-ServerRescueNegativeTestJSON-1997199596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e76d609-d791-447d-be93-7ed24fb9a8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-db3e42f3-a7b7-446a-9e13-830d93da7bd3 tempest-ServerRescueNegativeTestJSON-1997199596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e76d609-d791-447d-be93-7ed24fb9a8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63ca8c30-8724-4537-8faf-ecef8fa66b1b', 'volume_name': 'volume-63ca8c30-8724-4537-8faf-ecef8fa66b1b', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-db3e42f3-a7b7-446a-9e13-830d93da7bd3 tempest-ServerRescueNegativeTestJSON-1997199596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0382e10-88a4-4629-b126-15fadc4462fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-db3e42f3-a7b7-446a-9e13-830d93da7bd3 tempest-ServerRescueNegativeTestJSON-1997199596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0382e10-88a4-4629-b126-15fadc4462fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-db3e42f3-a7b7-446a-9e13-830d93da7bd3 tempest-ServerRescueNegativeTestJSON-1997199596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313b1a9c-f8d2-4b27-bd75-281c3599d8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:14 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-db3e42f3-a7b7-446a-9e13-830d93da7bd3 tempest-ServerRescueNegativeTestJSON-1997199596 None] Volume 63ca8c30-8724-4537-8faf-ecef8fa66b1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63ca8c30-8724-4537-8faf-ecef8fa66b1b', 'volume_size': 1} Sep 28 17:12:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-db3e42f3-a7b7-446a-9e13-830d93da7bd3 tempest-ServerRescueNegativeTestJSON-1997199596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:15 devstack sudo[92410]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-cdf11322-5b14-4afa-9692-9f7cd76b1364 tempest-VolumesDeleteCascade-44747889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.0fdafae7-c523-44df-8141-1a6dbf60d525 1G" returned: 0 in 0.930s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-cdf11322-5b14-4afa-9692-9f7cd76b1364 tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.0fdafae7-c523-44df-8141-1a6dbf60d525 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:15 devstack sudo[92415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.0fdafae7-c523-44df-8141-1a6dbf60d525 Sep 28 17:12:15 devstack sudo[92415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:15 devstack sudo[92415]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-cdf11322-5b14-4afa-9692-9f7cd76b1364 tempest-VolumesDeleteCascade-44747889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.0fdafae7-c523-44df-8141-1a6dbf60d525" returned: 0 in 0.523s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:15 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-cdf11322-5b14-4afa-9692-9f7cd76b1364 tempest-VolumesDeleteCascade-44747889 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.0fdafae7-c523-44df-8141-1a6dbf60d525 is being set with open permissions: ugo+rw Sep 28 17:12:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-cdf11322-5b14-4afa-9692-9f7cd76b1364 tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.0fdafae7-c523-44df-8141-1a6dbf60d525 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:16 devstack sudo[92420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.0fdafae7-c523-44df-8141-1a6dbf60d525 Sep 28 17:12:16 devstack sudo[92420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:16 devstack sudo[92420]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-cdf11322-5b14-4afa-9692-9f7cd76b1364 tempest-VolumesDeleteCascade-44747889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.0fdafae7-c523-44df-8141-1a6dbf60d525" returned: 0 in 0.513s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-cdf11322-5b14-4afa-9692-9f7cd76b1364 tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:16 devstack sudo[92423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.info Sep 28 17:12:16 devstack sudo[92423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:16 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [req-869795db-ece0-400a-97da-eff23db6af80 req-4e668f93-fd42-4edc-9e23-5b99552b464e tempest-VolumesGetTestJSON-2000601041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-869795db-ece0-400a-97da-eff23db6af80 req-4e668f93-fd42-4edc-9e23-5b99552b464e tempest-VolumesGetTestJSON-2000601041 None] Flow 'volume_create_manager' (e9b0f9b0-4d4b-4528-803c-cb6e6154c677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-869795db-ece0-400a-97da-eff23db6af80 req-4e668f93-fd42-4edc-9e23-5b99552b464e tempest-VolumesGetTestJSON-2000601041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e724df52-1110-43fc-a1a3-f197c2362f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-869795db-ece0-400a-97da-eff23db6af80 req-4e668f93-fd42-4edc-9e23-5b99552b464e tempest-VolumesGetTestJSON-2000601041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e724df52-1110-43fc-a1a3-f197c2362f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-539728495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c73b95ba-c6d2-40eb-8da8-f835f11b0d72,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='43314c0d0422471ab48f4455e3d1319a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:17Z,use_quota=True,user_id='66c4192d82054a9b935c335071f4966b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-869795db-ece0-400a-97da-eff23db6af80 req-4e668f93-fd42-4edc-9e23-5b99552b464e tempest-VolumesGetTestJSON-2000601041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9586d21d-5639-4c18-be27-040d53b3750c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-869795db-ece0-400a-97da-eff23db6af80 req-4e668f93-fd42-4edc-9e23-5b99552b464e tempest-VolumesGetTestJSON-2000601041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9586d21d-5639-4c18-be27-040d53b3750c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-869795db-ece0-400a-97da-eff23db6af80 req-4e668f93-fd42-4edc-9e23-5b99552b464e tempest-VolumesGetTestJSON-2000601041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (332a8920-2808-43d4-ac52-a8700fa089d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-869795db-ece0-400a-97da-eff23db6af80 req-4e668f93-fd42-4edc-9e23-5b99552b464e tempest-VolumesGetTestJSON-2000601041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (332a8920-2808-43d4-ac52-a8700fa089d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c73b95ba-c6d2-40eb-8da8-f835f11b0d72', 'volume_name': 'volume-c73b95ba-c6d2-40eb-8da8-f835f11b0d72', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-869795db-ece0-400a-97da-eff23db6af80 req-4e668f93-fd42-4edc-9e23-5b99552b464e tempest-VolumesGetTestJSON-2000601041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90311166-6c99-4f5b-9a54-d791b49b553f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-869795db-ece0-400a-97da-eff23db6af80 req-4e668f93-fd42-4edc-9e23-5b99552b464e tempest-VolumesGetTestJSON-2000601041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90311166-6c99-4f5b-9a54-d791b49b553f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-869795db-ece0-400a-97da-eff23db6af80 req-4e668f93-fd42-4edc-9e23-5b99552b464e tempest-VolumesGetTestJSON-2000601041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (565f4750-7375-44e8-b55e-33ab933dba77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:17 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [req-869795db-ece0-400a-97da-eff23db6af80 req-4e668f93-fd42-4edc-9e23-5b99552b464e tempest-VolumesGetTestJSON-2000601041 None] Volume c73b95ba-c6d2-40eb-8da8-f835f11b0d72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c73b95ba-c6d2-40eb-8da8-f835f11b0d72', 'volume_size': 1} Sep 28 17:12:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-869795db-ece0-400a-97da-eff23db6af80 req-4e668f93-fd42-4edc-9e23-5b99552b464e tempest-VolumesGetTestJSON-2000601041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:17 devstack sudo[92423]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-cdf11322-5b14-4afa-9692-9f7cd76b1364 tempest-VolumesDeleteCascade-44747889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.info" returned: 0 in 0.627s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:17 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-cdf11322-5b14-4afa-9692-9f7cd76b1364 tempest-VolumesDeleteCascade-44747889 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.info is being set with open permissions: ugo+rw Sep 28 17:12:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-cdf11322-5b14-4afa-9692-9f7cd76b1364 tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:17 devstack sudo[92432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.info Sep 28 17:12:17 devstack sudo[92432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:17 devstack sudo[92432]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-cdf11322-5b14-4afa-9692-9f7cd76b1364 tempest-VolumesDeleteCascade-44747889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.info" returned: 0 in 0.338s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-cdf11322-5b14-4afa-9692-9f7cd76b1364 tempest-VolumesDeleteCascade-44747889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.112s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-db3e42f3-a7b7-446a-9e13-830d93da7bd3 tempest-ServerRescueNegativeTestJSON-1997199596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.724s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:17 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-db3e42f3-a7b7-446a-9e13-830d93da7bd3 tempest-ServerRescueNegativeTestJSON-1997199596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-605066426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ca8c30-8724-4537-8faf-ecef8fa66b1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e447c315c4524741979ddc8242c04110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:15Z,use_quota=True,user_id='2821e2b316fb4f7e863aaa2f1ffa7a36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:17 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-db3e42f3-a7b7-446a-9e13-830d93da7bd3 tempest-ServerRescueNegativeTestJSON-1997199596 None] Creating volume 63ca8c30-8724-4537-8faf-ecef8fa66b1b {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-db3e42f3-a7b7-446a-9e13-830d93da7bd3 tempest-ServerRescueNegativeTestJSON-1997199596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-db3e42f3-a7b7-446a-9e13-830d93da7bd3 tempest-ServerRescueNegativeTestJSON-1997199596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:17 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-db3e42f3-a7b7-446a-9e13-830d93da7bd3 tempest-ServerRescueNegativeTestJSON-1997199596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:17 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-db3e42f3-a7b7-446a-9e13-830d93da7bd3 tempest-ServerRescueNegativeTestJSON-1997199596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-db3e42f3-a7b7-446a-9e13-830d93da7bd3 tempest-ServerRescueNegativeTestJSON-1997199596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:17 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-db3e42f3-a7b7-446a-9e13-830d93da7bd3 tempest-ServerRescueNegativeTestJSON-1997199596 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:17 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-db3e42f3-a7b7-446a-9e13-830d93da7bd3 tempest-ServerRescueNegativeTestJSON-1997199596 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:12:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-db3e42f3-a7b7-446a-9e13-830d93da7bd3 tempest-ServerRescueNegativeTestJSON-1997199596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-63ca8c30-8724-4537-8faf-ecef8fa66b1b 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:17 devstack sudo[92435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-63ca8c30-8724-4537-8faf-ecef8fa66b1b 1073741824 Sep 28 17:12:17 devstack sudo[92435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:17 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-cdf11322-5b14-4afa-9692-9f7cd76b1364 tempest-VolumesDeleteCascade-44747889 None] Create snapshot completed successfully Sep 28 17:12:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-251f0ede-1fae-4a9f-9159-caa135a9463e tempest-VolumesDeleteCascade-44747889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:18 devstack sudo[92435]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-db3e42f3-a7b7-446a-9e13-830d93da7bd3 tempest-ServerRescueNegativeTestJSON-1997199596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-63ca8c30-8724-4537-8faf-ecef8fa66b1b 1073741824" returned: 0 in 0.757s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-db3e42f3-a7b7-446a-9e13-830d93da7bd3 tempest-ServerRescueNegativeTestJSON-1997199596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-63ca8c30-8724-4537-8faf-ecef8fa66b1b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:18 devstack sudo[92441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-63ca8c30-8724-4537-8faf-ecef8fa66b1b Sep 28 17:12:18 devstack sudo[92441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:18 devstack sudo[92441]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-db3e42f3-a7b7-446a-9e13-830d93da7bd3 tempest-ServerRescueNegativeTestJSON-1997199596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-63ca8c30-8724-4537-8faf-ecef8fa66b1b" returned: 0 in 0.321s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-db3e42f3-a7b7-446a-9e13-830d93da7bd3 tempest-ServerRescueNegativeTestJSON-1997199596 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-db3e42f3-a7b7-446a-9e13-830d93da7bd3 tempest-ServerRescueNegativeTestJSON-1997199596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-869795db-ece0-400a-97da-eff23db6af80 req-4e668f93-fd42-4edc-9e23-5b99552b464e tempest-VolumesGetTestJSON-2000601041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.778s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [req-869795db-ece0-400a-97da-eff23db6af80 req-4e668f93-fd42-4edc-9e23-5b99552b464e tempest-VolumesGetTestJSON-2000601041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-539728495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c73b95ba-c6d2-40eb-8da8-f835f11b0d72,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='43314c0d0422471ab48f4455e3d1319a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:17Z,use_quota=True,user_id='66c4192d82054a9b935c335071f4966b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [req-869795db-ece0-400a-97da-eff23db6af80 req-4e668f93-fd42-4edc-9e23-5b99552b464e tempest-VolumesGetTestJSON-2000601041 None] Creating volume c73b95ba-c6d2-40eb-8da8-f835f11b0d72 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-869795db-ece0-400a-97da-eff23db6af80 req-4e668f93-fd42-4edc-9e23-5b99552b464e tempest-VolumesGetTestJSON-2000601041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-869795db-ece0-400a-97da-eff23db6af80 req-4e668f93-fd42-4edc-9e23-5b99552b464e tempest-VolumesGetTestJSON-2000601041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [req-869795db-ece0-400a-97da-eff23db6af80 req-4e668f93-fd42-4edc-9e23-5b99552b464e tempest-VolumesGetTestJSON-2000601041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [req-869795db-ece0-400a-97da-eff23db6af80 req-4e668f93-fd42-4edc-9e23-5b99552b464e tempest-VolumesGetTestJSON-2000601041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-869795db-ece0-400a-97da-eff23db6af80 req-4e668f93-fd42-4edc-9e23-5b99552b464e tempest-VolumesGetTestJSON-2000601041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [req-869795db-ece0-400a-97da-eff23db6af80 req-4e668f93-fd42-4edc-9e23-5b99552b464e tempest-VolumesGetTestJSON-2000601041 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:18 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [req-869795db-ece0-400a-97da-eff23db6af80 req-4e668f93-fd42-4edc-9e23-5b99552b464e tempest-VolumesGetTestJSON-2000601041 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:12:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-869795db-ece0-400a-97da-eff23db6af80 req-4e668f93-fd42-4edc-9e23-5b99552b464e tempest-VolumesGetTestJSON-2000601041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c73b95ba-c6d2-40eb-8da8-f835f11b0d72 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-db3e42f3-a7b7-446a-9e13-830d93da7bd3 tempest-ServerRescueNegativeTestJSON-1997199596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313b1a9c-f8d2-4b27-bd75-281c3599d8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63ca8c30-8724-4537-8faf-ecef8fa66b1b', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:18 devstack sudo[92444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c73b95ba-c6d2-40eb-8da8-f835f11b0d72 1073741824 Sep 28 17:12:18 devstack sudo[92444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-db3e42f3-a7b7-446a-9e13-830d93da7bd3 tempest-ServerRescueNegativeTestJSON-1997199596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad0b60b-8479-46cc-9d3a-3f4baaf85819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:18 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-db3e42f3-a7b7-446a-9e13-830d93da7bd3 tempest-ServerRescueNegativeTestJSON-1997199596 None] Volume volume-63ca8c30-8724-4537-8faf-ecef8fa66b1b (63ca8c30-8724-4537-8faf-ecef8fa66b1b): created successfully Sep 28 17:12:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-db3e42f3-a7b7-446a-9e13-830d93da7bd3 tempest-ServerRescueNegativeTestJSON-1997199596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad0b60b-8479-46cc-9d3a-3f4baaf85819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-db3e42f3-a7b7-446a-9e13-830d93da7bd3 tempest-ServerRescueNegativeTestJSON-1997199596 None] Flow 'volume_create_manager' (20f0fdd3-95db-48f9-a0d3-8e604de45302) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:18 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-db3e42f3-a7b7-446a-9e13-830d93da7bd3 tempest-ServerRescueNegativeTestJSON-1997199596 None] Created volume successfully. Sep 28 17:12:19 devstack sudo[92444]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-869795db-ece0-400a-97da-eff23db6af80 req-4e668f93-fd42-4edc-9e23-5b99552b464e tempest-VolumesGetTestJSON-2000601041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c73b95ba-c6d2-40eb-8da8-f835f11b0d72 1073741824" returned: 0 in 1.084s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-869795db-ece0-400a-97da-eff23db6af80 req-4e668f93-fd42-4edc-9e23-5b99552b464e tempest-VolumesGetTestJSON-2000601041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c73b95ba-c6d2-40eb-8da8-f835f11b0d72 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:20 devstack sudo[92459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c73b95ba-c6d2-40eb-8da8-f835f11b0d72 Sep 28 17:12:20 devstack sudo[92459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:20 devstack sudo[92459]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-869795db-ece0-400a-97da-eff23db6af80 req-4e668f93-fd42-4edc-9e23-5b99552b464e tempest-VolumesGetTestJSON-2000601041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c73b95ba-c6d2-40eb-8da8-f835f11b0d72" returned: 0 in 0.765s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [req-869795db-ece0-400a-97da-eff23db6af80 req-4e668f93-fd42-4edc-9e23-5b99552b464e tempest-VolumesGetTestJSON-2000601041 None] <== create_volume: return (1942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-869795db-ece0-400a-97da-eff23db6af80 req-4e668f93-fd42-4edc-9e23-5b99552b464e tempest-VolumesGetTestJSON-2000601041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.947s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-251f0ede-1fae-4a9f-9159-caa135a9463e tempest-VolumesDeleteCascade-44747889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.385s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-251f0ede-1fae-4a9f-9159-caa135a9463e tempest-VolumesDeleteCascade-44747889 None] Creating offline snapshot cd937ca2-1b2d-4fbd-ba57-caedce069c7c of volume 3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:12:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-869795db-ece0-400a-97da-eff23db6af80 req-4e668f93-fd42-4edc-9e23-5b99552b464e tempest-VolumesGetTestJSON-2000601041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (565f4750-7375-44e8-b55e-33ab933dba77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c73b95ba-c6d2-40eb-8da8-f835f11b0d72', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-869795db-ece0-400a-97da-eff23db6af80 req-4e668f93-fd42-4edc-9e23-5b99552b464e tempest-VolumesGetTestJSON-2000601041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1788d43-138f-4e8c-b649-f666744eca8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:20 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ff7650-0b6f-4275-9a9c-db862d81c5fa]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-251f0ede-1fae-4a9f-9159-caa135a9463e tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.0fdafae7-c523-44df-8141-1a6dbf60d525 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:21 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [req-869795db-ece0-400a-97da-eff23db6af80 req-4e668f93-fd42-4edc-9e23-5b99552b464e tempest-VolumesGetTestJSON-2000601041 None] Volume volume-c73b95ba-c6d2-40eb-8da8-f835f11b0d72 (c73b95ba-c6d2-40eb-8da8-f835f11b0d72): created successfully Sep 28 17:12:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-869795db-ece0-400a-97da-eff23db6af80 req-4e668f93-fd42-4edc-9e23-5b99552b464e tempest-VolumesGetTestJSON-2000601041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1788d43-138f-4e8c-b649-f666744eca8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-869795db-ece0-400a-97da-eff23db6af80 req-4e668f93-fd42-4edc-9e23-5b99552b464e tempest-VolumesGetTestJSON-2000601041 None] Flow 'volume_create_manager' (e9b0f9b0-4d4b-4528-803c-cb6e6154c677) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:21 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-869795db-ece0-400a-97da-eff23db6af80 req-4e668f93-fd42-4edc-9e23-5b99552b464e tempest-VolumesGetTestJSON-2000601041 None] Created volume successfully. Sep 28 17:12:21 devstack sudo[92462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.0fdafae7-c523-44df-8141-1a6dbf60d525 Sep 28 17:12:21 devstack sudo[92462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:21 devstack sudo[92462]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-251f0ede-1fae-4a9f-9159-caa135a9463e tempest-VolumesDeleteCascade-44747889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.0fdafae7-c523-44df-8141-1a6dbf60d525" returned: 0 in 0.891s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:21 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-251f0ede-1fae-4a9f-9159-caa135a9463e tempest-VolumesDeleteCascade-44747889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:12:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-251f0ede-1fae-4a9f-9159-caa135a9463e tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.0fdafae7-c523-44df-8141-1a6dbf60d525,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.cd937ca2-1b2d-4fbd-ba57-caedce069c7c 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:21 devstack sudo[92467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.0fdafae7-c523-44df-8141-1a6dbf60d525,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.cd937ca2-1b2d-4fbd-ba57-caedce069c7c 1G Sep 28 17:12:21 devstack sudo[92467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:22 devstack cinder-volume[86917]: DEBUG cinder.coordination [req-ea38214f-7516-4831-81c8-26bdbdaf2f3c req-a80ef1ab-880b-4df9-b0bb-4a48ac01d959 tempest-VolumesGetTestJSON-2000601041 None] Acquiring lock "cinder-c73b95ba-c6d2-40eb-8da8-f835f11b0d72-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:22 devstack cinder-volume[86917]: DEBUG cinder.coordination [req-ea38214f-7516-4831-81c8-26bdbdaf2f3c req-a80ef1ab-880b-4df9-b0bb-4a48ac01d959 tempest-VolumesGetTestJSON-2000601041 None] Lock "cinder-c73b95ba-c6d2-40eb-8da8-f835f11b0d72-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:22 devstack cinder-volume[86917]: DEBUG cinder.coordination [req-ea38214f-7516-4831-81c8-26bdbdaf2f3c req-a80ef1ab-880b-4df9-b0bb-4a48ac01d959 tempest-VolumesGetTestJSON-2000601041 None] Acquiring lock "cinder-quobyte-c73b95ba-c6d2-40eb-8da8-f835f11b0d72" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:22 devstack cinder-volume[86917]: DEBUG cinder.coordination [req-ea38214f-7516-4831-81c8-26bdbdaf2f3c req-a80ef1ab-880b-4df9-b0bb-4a48ac01d959 tempest-VolumesGetTestJSON-2000601041 None] Lock "cinder-quobyte-c73b95ba-c6d2-40eb-8da8-f835f11b0d72" acquired by "delete_volume" :: waited 0.051s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:22 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ece36e-a033-48bf-a464-2521ef0c791a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-ea38214f-7516-4831-81c8-26bdbdaf2f3c req-a80ef1ab-880b-4df9-b0bb-4a48ac01d959 tempest-VolumesGetTestJSON-2000601041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c73b95ba-c6d2-40eb-8da8-f835f11b0d72 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:23 devstack sudo[92467]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-251f0ede-1fae-4a9f-9159-caa135a9463e tempest-VolumesDeleteCascade-44747889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.0fdafae7-c523-44df-8141-1a6dbf60d525,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.cd937ca2-1b2d-4fbd-ba57-caedce069c7c 1G" returned: 0 in 1.258s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-251f0ede-1fae-4a9f-9159-caa135a9463e tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.0fdafae7-c523-44df-8141-1a6dbf60d525 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.cd937ca2-1b2d-4fbd-ba57-caedce069c7c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:23 devstack sudo[92495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.0fdafae7-c523-44df-8141-1a6dbf60d525 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.cd937ca2-1b2d-4fbd-ba57-caedce069c7c Sep 28 17:12:23 devstack sudo[92495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:23 devstack sudo[92493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c73b95ba-c6d2-40eb-8da8-f835f11b0d72 Sep 28 17:12:23 devstack sudo[92493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:23 devstack sudo[92495]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:23 devstack sudo[92493]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-ea38214f-7516-4831-81c8-26bdbdaf2f3c req-a80ef1ab-880b-4df9-b0bb-4a48ac01d959 tempest-VolumesGetTestJSON-2000601041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c73b95ba-c6d2-40eb-8da8-f835f11b0d72" returned: 0 in 0.645s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-251f0ede-1fae-4a9f-9159-caa135a9463e tempest-VolumesDeleteCascade-44747889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.0fdafae7-c523-44df-8141-1a6dbf60d525 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.cd937ca2-1b2d-4fbd-ba57-caedce069c7c" returned: 0 in 0.476s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-ea38214f-7516-4831-81c8-26bdbdaf2f3c req-a80ef1ab-880b-4df9-b0bb-4a48ac01d959 tempest-VolumesGetTestJSON-2000601041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c73b95ba-c6d2-40eb-8da8-f835f11b0d72 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:23 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-251f0ede-1fae-4a9f-9159-caa135a9463e tempest-VolumesDeleteCascade-44747889 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.cd937ca2-1b2d-4fbd-ba57-caedce069c7c is being set with open permissions: ugo+rw Sep 28 17:12:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-251f0ede-1fae-4a9f-9159-caa135a9463e tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.cd937ca2-1b2d-4fbd-ba57-caedce069c7c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:23 devstack sudo[92512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c73b95ba-c6d2-40eb-8da8-f835f11b0d72 Sep 28 17:12:23 devstack sudo[92512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:23 devstack sudo[92513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.cd937ca2-1b2d-4fbd-ba57-caedce069c7c Sep 28 17:12:23 devstack sudo[92513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:24 devstack sudo[92513]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-251f0ede-1fae-4a9f-9159-caa135a9463e tempest-VolumesDeleteCascade-44747889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.cd937ca2-1b2d-4fbd-ba57-caedce069c7c" returned: 0 in 0.452s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:24 devstack sudo[92512]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-251f0ede-1fae-4a9f-9159-caa135a9463e tempest-VolumesDeleteCascade-44747889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.374s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-ea38214f-7516-4831-81c8-26bdbdaf2f3c req-a80ef1ab-880b-4df9-b0bb-4a48ac01d959 tempest-VolumesGetTestJSON-2000601041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c73b95ba-c6d2-40eb-8da8-f835f11b0d72" returned: 0 in 0.555s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [req-ea38214f-7516-4831-81c8-26bdbdaf2f3c req-a80ef1ab-880b-4df9-b0bb-4a48ac01d959 tempest-VolumesGetTestJSON-2000601041 None] Lock "cinder-quobyte-c73b95ba-c6d2-40eb-8da8-f835f11b0d72" released by "delete_volume" :: held 1.319s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:24 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-251f0ede-1fae-4a9f-9159-caa135a9463e tempest-VolumesDeleteCascade-44747889 None] Create snapshot completed successfully Sep 28 17:12:24 devstack cinder-volume[86917]: DEBUG cinder.quota [req-ea38214f-7516-4831-81c8-26bdbdaf2f3c req-a80ef1ab-880b-4df9-b0bb-4a48ac01d959 tempest-VolumesGetTestJSON-2000601041 None] Created reservations ['71be8955-dacc-488c-85b6-8aec553a707f', '29a88b44-12e1-4bda-b4d4-09dffad3f3ca', 'd4b585ff-95f5-4036-b551-efd94b29eccb', '8ff317fa-e480-429d-a3ca-0b24c1673cd9'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-ea38214f-7516-4831-81c8-26bdbdaf2f3c req-a80ef1ab-880b-4df9-b0bb-4a48ac01d959 tempest-VolumesGetTestJSON-2000601041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-ea38214f-7516-4831-81c8-26bdbdaf2f3c req-a80ef1ab-880b-4df9-b0bb-4a48ac01d959 tempest-VolumesGetTestJSON-2000601041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [req-ea38214f-7516-4831-81c8-26bdbdaf2f3c req-a80ef1ab-880b-4df9-b0bb-4a48ac01d959 tempest-VolumesGetTestJSON-2000601041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [req-ea38214f-7516-4831-81c8-26bdbdaf2f3c req-a80ef1ab-880b-4df9-b0bb-4a48ac01d959 tempest-VolumesGetTestJSON-2000601041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-ea38214f-7516-4831-81c8-26bdbdaf2f3c req-a80ef1ab-880b-4df9-b0bb-4a48ac01d959 tempest-VolumesGetTestJSON-2000601041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-ea38214f-7516-4831-81c8-26bdbdaf2f3c req-a80ef1ab-880b-4df9-b0bb-4a48ac01d959 tempest-VolumesGetTestJSON-2000601041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:24 devstack sudo[92530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:12:24 devstack sudo[92530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:24 devstack sudo[92530]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-ea38214f-7516-4831-81c8-26bdbdaf2f3c req-a80ef1ab-880b-4df9-b0bb-4a48ac01d959 tempest-VolumesGetTestJSON-2000601041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.347s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:24 devstack cinder-volume[86917]: DEBUG cinder.manager [req-ea38214f-7516-4831-81c8-26bdbdaf2f3c req-a80ef1ab-880b-4df9-b0bb-4a48ac01d959 tempest-VolumesGetTestJSON-2000601041 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:24 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-ea38214f-7516-4831-81c8-26bdbdaf2f3c req-a80ef1ab-880b-4df9-b0bb-4a48ac01d959 tempest-VolumesGetTestJSON-2000601041 None] Deleted volume successfully. Sep 28 17:12:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [req-ea38214f-7516-4831-81c8-26bdbdaf2f3c req-a80ef1ab-880b-4df9-b0bb-4a48ac01d959 tempest-VolumesGetTestJSON-2000601041 None] Lock "cinder-c73b95ba-c6d2-40eb-8da8-f835f11b0d72-delete_volume" released by "delete_volume" :: held 2.218s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:25 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Acquiring lock "cinder-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:25 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Lock "cinder-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Performing cascade delete. {{(pid=86917) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 17:12:25 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Acquiring lock "cinder-0fdafae7-c523-44df-8141-1a6dbf60d525-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:25 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Lock "cinder-0fdafae7-c523-44df-8141-1a6dbf60d525-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:25 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Acquiring lock "cinder-quobyte-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:25 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Lock "cinder-quobyte-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:25 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Acquiring lock "cinder-quobyte-0fdafae7-c523-44df-8141-1a6dbf60d525" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:25 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Lock "cinder-quobyte-0fdafae7-c523-44df-8141-1a6dbf60d525" acquired by "_delete_snapshot" :: waited 0.068s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:25 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Deleting offline snapshot 0fdafae7-c523-44df-8141-1a6dbf60d525 of volume 3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:12:25 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] snapshot_file for this snap is: volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.0fdafae7-c523-44df-8141-1a6dbf60d525 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:12:25 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1fc16e-d26b-472a-879a-e4a3271f71b8]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.0fdafae7-c523-44df-8141-1a6dbf60d525 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:25 devstack sudo[92559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.0fdafae7-c523-44df-8141-1a6dbf60d525 Sep 28 17:12:25 devstack sudo[92559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:26 devstack sudo[92559]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.0fdafae7-c523-44df-8141-1a6dbf60d525" returned: 0 in 0.659s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:26 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:12:26 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40ce94b-5b9e-4518-b536-eeb3c0d920c7]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:26 devstack sudo[92564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc Sep 28 17:12:26 devstack sudo[92564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:27 devstack sudo[92564]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc" returned: 0 in 0.877s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:27 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[72581272-067f-4277-ab2f-955bec0d6ede]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.cd937ca2-1b2d-4fbd-ba57-caedce069c7c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:27 devstack sudo[92570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.cd937ca2-1b2d-4fbd-ba57-caedce069c7c Sep 28 17:12:27 devstack sudo[92570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:27 devstack sudo[92570]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.cd937ca2-1b2d-4fbd-ba57-caedce069c7c" returned: 0 in 0.789s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:27 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:12:28 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f89dbd-2131-4a29-872d-4bc10656eb8f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.0fdafae7-c523-44df-8141-1a6dbf60d525 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:28 devstack sudo[92575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.0fdafae7-c523-44df-8141-1a6dbf60d525 Sep 28 17:12:28 devstack sudo[92575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:29 devstack sudo[92575]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.0fdafae7-c523-44df-8141-1a6dbf60d525" returned: 0 in 1.073s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:12:29 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c4ca78-3897-4fd6-9fd2-1f67a1f0e200]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:29 devstack sudo[92583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc Sep 28 17:12:29 devstack sudo[92583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:29 devstack sudo[92583]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc" returned: 0 in 0.862s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.0fdafae7-c523-44df-8141-1a6dbf60d525 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:30 devstack sudo[92629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.0fdafae7-c523-44df-8141-1a6dbf60d525 Sep 28 17:12:30 devstack sudo[92629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:30 devstack sudo[92629]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.0fdafae7-c523-44df-8141-1a6dbf60d525" returned: 0 in 0.934s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.0fdafae7-c523-44df-8141-1a6dbf60d525 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:30 devstack sudo[92640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.0fdafae7-c523-44df-8141-1a6dbf60d525 Sep 28 17:12:30 devstack sudo[92640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:31 devstack sudo[92640]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.0fdafae7-c523-44df-8141-1a6dbf60d525" returned: 0 in 0.476s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.cd937ca2-1b2d-4fbd-ba57-caedce069c7c -F qcow2 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:31 devstack sudo[92656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.cd937ca2-1b2d-4fbd-ba57-caedce069c7c -F qcow2 Sep 28 17:12:31 devstack sudo[92656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:31 devstack sudo[92656]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.cd937ca2-1b2d-4fbd-ba57-caedce069c7c -F qcow2" returned: 0 in 0.584s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Lock "cinder-quobyte-0fdafae7-c523-44df-8141-1a6dbf60d525" released by "_delete_snapshot" :: held 6.660s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Lock "cinder-quobyte-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc" released by "delete_snapshot" :: held 6.744s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:32 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Created reservations ['10851c78-d166-4c7d-8438-264e860d35ad', 'ae60a7e2-f369-483d-b137-60d00978825a', '91099d88-57da-44df-b7af-3409f9a9b948', 'e71f6830-68d2-4e03-8dbf-2fbab3351efe'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:32 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Delete snapshot completed successfully. Sep 28 17:12:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Lock "cinder-0fdafae7-c523-44df-8141-1a6dbf60d525-delete_snapshot" released by "delete_snapshot" :: held 7.147s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Acquiring lock "cinder-cd937ca2-1b2d-4fbd-ba57-caedce069c7c-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Lock "cinder-cd937ca2-1b2d-4fbd-ba57-caedce069c7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Acquiring lock "cinder-quobyte-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Lock "cinder-quobyte-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Acquiring lock "cinder-quobyte-cd937ca2-1b2d-4fbd-ba57-caedce069c7c" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Lock "cinder-quobyte-cd937ca2-1b2d-4fbd-ba57-caedce069c7c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Deleting offline snapshot cd937ca2-1b2d-4fbd-ba57-caedce069c7c of volume 3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:12:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] snapshot_file for this snap is: volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.cd937ca2-1b2d-4fbd-ba57-caedce069c7c {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:12:32 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f642c6f-6df8-468f-941e-6db3191f489e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.cd937ca2-1b2d-4fbd-ba57-caedce069c7c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:32 devstack sudo[92683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.cd937ca2-1b2d-4fbd-ba57-caedce069c7c Sep 28 17:12:32 devstack sudo[92683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:33 devstack sudo[92683]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.cd937ca2-1b2d-4fbd-ba57-caedce069c7c" returned: 0 in 0.621s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:33 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:12:33 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7ade3d-f52a-49c6-a215-a73b2422e43f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:33 devstack sudo[92699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc Sep 28 17:12:33 devstack sudo[92699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:33 devstack sudo[92699]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc" returned: 0 in 0.628s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.cd937ca2-1b2d-4fbd-ba57-caedce069c7c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:33 devstack sudo[92705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.cd937ca2-1b2d-4fbd-ba57-caedce069c7c Sep 28 17:12:33 devstack sudo[92705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:34 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ffced514-38fd-40c3-996a-624854238dd6 tempest-BackendsCapabilitiesAdminTestsJSON-130867051 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1098976135254, 'free_capacity_gb': 1775.1098976135254, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86917) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 17:12:34 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-96b79286-c783-40bf-a364-bb57c2272eb2 tempest-BackendsCapabilitiesAdminTestsJSON-130867051 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1098976135254, 'free_capacity_gb': 1775.1098976135254, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86917) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 17:12:34 devstack sudo[92705]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.cd937ca2-1b2d-4fbd-ba57-caedce069c7c" returned: 0 in 0.657s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.cd937ca2-1b2d-4fbd-ba57-caedce069c7c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:34 devstack sudo[92710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.cd937ca2-1b2d-4fbd-ba57-caedce069c7c Sep 28 17:12:34 devstack sudo[92710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:35 devstack sudo[92710]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc.cd937ca2-1b2d-4fbd-ba57-caedce069c7c" returned: 0 in 0.470s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:35 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1a2e8692-f04a-475f-9ae3-8e8a3120ae9e tempest-ServerRescueNegativeTestJSON-1997199596 None] Acquiring lock "cinder-63ca8c30-8724-4537-8faf-ecef8fa66b1b-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:35 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Lock "cinder-quobyte-cd937ca2-1b2d-4fbd-ba57-caedce069c7c" released by "_delete_snapshot" :: held 2.633s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:35 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1a2e8692-f04a-475f-9ae3-8e8a3120ae9e tempest-ServerRescueNegativeTestJSON-1997199596 None] Lock "cinder-63ca8c30-8724-4537-8faf-ecef8fa66b1b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:35 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Lock "cinder-quobyte-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc" released by "delete_snapshot" :: held 2.689s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:35 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1a2e8692-f04a-475f-9ae3-8e8a3120ae9e tempest-ServerRescueNegativeTestJSON-1997199596 None] Acquiring lock "cinder-quobyte-63ca8c30-8724-4537-8faf-ecef8fa66b1b" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:35 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1a2e8692-f04a-475f-9ae3-8e8a3120ae9e tempest-ServerRescueNegativeTestJSON-1997199596 None] Lock "cinder-quobyte-63ca8c30-8724-4537-8faf-ecef8fa66b1b" acquired by "delete_volume" :: waited 0.038s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:35 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Created reservations ['f8b8f7bc-20ea-4bad-ad8f-46acb7be23cc', 'f4af4a93-9b2b-4149-9d5c-ff70b405cafa', '8e09c108-620a-4932-bc3c-68a05eeb6e8e', '0186e16a-57e2-445d-941e-36a09d7ea049'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:35 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5694d6-4823-46da-8491-82ed03061fe0]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1a2e8692-f04a-475f-9ae3-8e8a3120ae9e tempest-ServerRescueNegativeTestJSON-1997199596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-63ca8c30-8724-4537-8faf-ecef8fa66b1b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:35 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Delete snapshot completed successfully. Sep 28 17:12:35 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Lock "cinder-cd937ca2-1b2d-4fbd-ba57-caedce069c7c-delete_snapshot" released by "delete_snapshot" :: held 3.071s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:35 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Snapshots deleted, issuing volume delete {{(pid=86917) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 17:12:35 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Acquiring lock "cinder-quobyte-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:35 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Lock "cinder-quobyte-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc" acquired by "delete_volume" :: waited 0.042s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:35 devstack sudo[92714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-63ca8c30-8724-4537-8faf-ecef8fa66b1b Sep 28 17:12:35 devstack sudo[92714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:35 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5bbd1d-0d98-4b63-9441-44e487e91c54]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:35 devstack sudo[92716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc Sep 28 17:12:35 devstack sudo[92716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:36 devstack sudo[92714]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1a2e8692-f04a-475f-9ae3-8e8a3120ae9e tempest-ServerRescueNegativeTestJSON-1997199596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-63ca8c30-8724-4537-8faf-ecef8fa66b1b" returned: 0 in 0.686s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1a2e8692-f04a-475f-9ae3-8e8a3120ae9e tempest-ServerRescueNegativeTestJSON-1997199596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-63ca8c30-8724-4537-8faf-ecef8fa66b1b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:36 devstack sudo[92721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-63ca8c30-8724-4537-8faf-ecef8fa66b1b Sep 28 17:12:36 devstack sudo[92721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:36 devstack sudo[92716]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc" returned: 0 in 0.677s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:36 devstack sudo[92726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc Sep 28 17:12:36 devstack sudo[92726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:36 devstack sudo[92721]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1a2e8692-f04a-475f-9ae3-8e8a3120ae9e tempest-ServerRescueNegativeTestJSON-1997199596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-63ca8c30-8724-4537-8faf-ecef8fa66b1b" returned: 0 in 0.533s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:36 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1a2e8692-f04a-475f-9ae3-8e8a3120ae9e tempest-ServerRescueNegativeTestJSON-1997199596 None] Lock "cinder-quobyte-63ca8c30-8724-4537-8faf-ecef8fa66b1b" released by "delete_volume" :: held 1.323s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:36 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-1a2e8692-f04a-475f-9ae3-8e8a3120ae9e tempest-ServerRescueNegativeTestJSON-1997199596 None] Created reservations ['31327d34-3554-42a1-86ae-0a479c056553', 'fe93c674-e45f-4e71-9f7f-1fb49d46f804', 'cf8e00f7-bdac-4470-9c0f-b41396152bbd', '5db21c1e-a521-45d6-8acd-c0dc94d0ceca'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1a2e8692-f04a-475f-9ae3-8e8a3120ae9e tempest-ServerRescueNegativeTestJSON-1997199596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1a2e8692-f04a-475f-9ae3-8e8a3120ae9e tempest-ServerRescueNegativeTestJSON-1997199596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:36 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-1a2e8692-f04a-475f-9ae3-8e8a3120ae9e tempest-ServerRescueNegativeTestJSON-1997199596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:36 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-1a2e8692-f04a-475f-9ae3-8e8a3120ae9e tempest-ServerRescueNegativeTestJSON-1997199596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1a2e8692-f04a-475f-9ae3-8e8a3120ae9e tempest-ServerRescueNegativeTestJSON-1997199596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1a2e8692-f04a-475f-9ae3-8e8a3120ae9e tempest-ServerRescueNegativeTestJSON-1997199596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:37 devstack sudo[92730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:12:37 devstack sudo[92726]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:37 devstack sudo[92730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc" returned: 0 in 0.710s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:37 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Lock "cinder-quobyte-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc" released by "delete_volume" :: held 1.549s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:37 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Created reservations ['023a1ae9-5ddb-4acc-9fed-465d5fa31cb2', '3a70eaa8-9208-4f7e-ab78-acc1e549d61d', '52b82668-22c6-4fed-9354-fb4ec0ad5deb', 'a929abfe-739a-4973-a0d6-506ef192a8f0'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:37 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:37 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:37 devstack sudo[92730]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1a2e8692-f04a-475f-9ae3-8e8a3120ae9e tempest-ServerRescueNegativeTestJSON-1997199596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.611s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:37 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-1a2e8692-f04a-475f-9ae3-8e8a3120ae9e tempest-ServerRescueNegativeTestJSON-1997199596 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:37 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-1a2e8692-f04a-475f-9ae3-8e8a3120ae9e tempest-ServerRescueNegativeTestJSON-1997199596 None] Deleted volume successfully. Sep 28 17:12:37 devstack sudo[92733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:12:37 devstack sudo[92733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:37 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1a2e8692-f04a-475f-9ae3-8e8a3120ae9e tempest-ServerRescueNegativeTestJSON-1997199596 None] Lock "cinder-63ca8c30-8724-4537-8faf-ecef8fa66b1b-delete_volume" released by "delete_volume" :: held 2.510s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:38 devstack sudo[92733]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.792s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:38 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:38 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Deleted volume successfully. Sep 28 17:12:38 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2cf8d2ca-9e73-4515-a416-1d292524d92c tempest-VolumesDeleteCascade-44747889 None] Lock "cinder-3f81961e-ebc5-4b5f-a3c1-98dabe1d7bcc-delete_volume" released by "delete_volume" :: held 13.321s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:40 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-debf3a92-b53f-45da-9316-1a9969ca3bac tempest-VolumesDeleteCascade-44747889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-debf3a92-b53f-45da-9316-1a9969ca3bac tempest-VolumesDeleteCascade-44747889 None] Flow 'volume_create_manager' (42c63ad2-4b65-4833-ac3e-db78c95d5bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-debf3a92-b53f-45da-9316-1a9969ca3bac tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d6bd68-c450-409d-9647-2df66ba55b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-debf3a92-b53f-45da-9316-1a9969ca3bac tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d6bd68-c450-409d-9647-2df66ba55b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-493005115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9667fd-fcd7-481c-ab25-3cf6b97467a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d1a1511f1444f299332ba23d462013a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:40Z,use_quota=True,user_id='c1142f48d0b5403c8cb2992111efde1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-debf3a92-b53f-45da-9316-1a9969ca3bac tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b487cd2-22e0-45a6-bcbc-9c726eff4477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-debf3a92-b53f-45da-9316-1a9969ca3bac tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b487cd2-22e0-45a6-bcbc-9c726eff4477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-debf3a92-b53f-45da-9316-1a9969ca3bac tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31ad6bb0-32b4-41ed-812a-0a067e5c0f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-debf3a92-b53f-45da-9316-1a9969ca3bac tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31ad6bb0-32b4-41ed-812a-0a067e5c0f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac9667fd-fcd7-481c-ab25-3cf6b97467a2', 'volume_name': 'volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-debf3a92-b53f-45da-9316-1a9969ca3bac tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ecaf26a-8fb2-48db-9aa5-5b88117aa892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-debf3a92-b53f-45da-9316-1a9969ca3bac tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ecaf26a-8fb2-48db-9aa5-5b88117aa892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-debf3a92-b53f-45da-9316-1a9969ca3bac tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737514d1-8eab-43fa-b400-609d9fd044f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:40 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-debf3a92-b53f-45da-9316-1a9969ca3bac tempest-VolumesDeleteCascade-44747889 None] Volume ac9667fd-fcd7-481c-ab25-3cf6b97467a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2', 'volume_size': 1} Sep 28 17:12:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-debf3a92-b53f-45da-9316-1a9969ca3bac tempest-VolumesDeleteCascade-44747889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-debf3a92-b53f-45da-9316-1a9969ca3bac tempest-VolumesDeleteCascade-44747889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:40 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-debf3a92-b53f-45da-9316-1a9969ca3bac tempest-VolumesDeleteCascade-44747889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-493005115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9667fd-fcd7-481c-ab25-3cf6b97467a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d1a1511f1444f299332ba23d462013a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:40Z,use_quota=True,user_id='c1142f48d0b5403c8cb2992111efde1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:40 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-debf3a92-b53f-45da-9316-1a9969ca3bac tempest-VolumesDeleteCascade-44747889 None] Creating volume ac9667fd-fcd7-481c-ab25-3cf6b97467a2 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-debf3a92-b53f-45da-9316-1a9969ca3bac tempest-VolumesDeleteCascade-44747889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-debf3a92-b53f-45da-9316-1a9969ca3bac tempest-VolumesDeleteCascade-44747889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:40 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-debf3a92-b53f-45da-9316-1a9969ca3bac tempest-VolumesDeleteCascade-44747889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:40 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-debf3a92-b53f-45da-9316-1a9969ca3bac tempest-VolumesDeleteCascade-44747889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-debf3a92-b53f-45da-9316-1a9969ca3bac tempest-VolumesDeleteCascade-44747889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:40 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-debf3a92-b53f-45da-9316-1a9969ca3bac tempest-VolumesDeleteCascade-44747889 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:40 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-debf3a92-b53f-45da-9316-1a9969ca3bac tempest-VolumesDeleteCascade-44747889 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:12:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-debf3a92-b53f-45da-9316-1a9969ca3bac tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:40 devstack sudo[92768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2 1073741824 Sep 28 17:12:40 devstack sudo[92768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:41 devstack sudo[92768]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-debf3a92-b53f-45da-9316-1a9969ca3bac tempest-VolumesDeleteCascade-44747889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2 1073741824" returned: 0 in 0.850s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-debf3a92-b53f-45da-9316-1a9969ca3bac tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:41 devstack sudo[92776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2 Sep 28 17:12:41 devstack sudo[92776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:41 devstack sudo[92776]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-debf3a92-b53f-45da-9316-1a9969ca3bac tempest-VolumesDeleteCascade-44747889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2" returned: 0 in 0.402s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:41 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-debf3a92-b53f-45da-9316-1a9969ca3bac tempest-VolumesDeleteCascade-44747889 None] <== create_volume: return (1329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-debf3a92-b53f-45da-9316-1a9969ca3bac tempest-VolumesDeleteCascade-44747889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:41 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-debf3a92-b53f-45da-9316-1a9969ca3bac tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737514d1-8eab-43fa-b400-609d9fd044f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:41 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-debf3a92-b53f-45da-9316-1a9969ca3bac tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8afaaea1-425b-48ff-a0d5-82caca4b1d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:41 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-debf3a92-b53f-45da-9316-1a9969ca3bac tempest-VolumesDeleteCascade-44747889 None] Volume volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2 (ac9667fd-fcd7-481c-ab25-3cf6b97467a2): created successfully Sep 28 17:12:41 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-debf3a92-b53f-45da-9316-1a9969ca3bac tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8afaaea1-425b-48ff-a0d5-82caca4b1d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:41 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-debf3a92-b53f-45da-9316-1a9969ca3bac tempest-VolumesDeleteCascade-44747889 None] Flow 'volume_create_manager' (42c63ad2-4b65-4833-ac3e-db78c95d5bd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:41 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-debf3a92-b53f-45da-9316-1a9969ca3bac tempest-VolumesDeleteCascade-44747889 None] Created volume successfully. Sep 28 17:12:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e1e7d980-d305-4319-93a9-c4ed7f2c690e tempest-VolumesDeleteCascade-44747889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e1e7d980-d305-4319-93a9-c4ed7f2c690e tempest-VolumesDeleteCascade-44747889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:42 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-e1e7d980-d305-4319-93a9-c4ed7f2c690e tempest-VolumesDeleteCascade-44747889 None] Creating offline snapshot c09cc355-9b32-4f2c-9dfa-b9a11dc3a125 of volume ac9667fd-fcd7-481c-ab25-3cf6b97467a2 {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:12:42 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e561b83-3815-4047-aedc-009f2c74a04e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e1e7d980-d305-4319-93a9-c4ed7f2c690e tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:43 devstack sudo[92784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2 Sep 28 17:12:43 devstack sudo[92784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:43 devstack sudo[92784]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e1e7d980-d305-4319-93a9-c4ed7f2c690e tempest-VolumesDeleteCascade-44747889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2" returned: 0 in 0.664s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e1e7d980-d305-4319-93a9-c4ed7f2c690e tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2.c09cc355-9b32-4f2c-9dfa-b9a11dc3a125 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:43 devstack sudo[92810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2.c09cc355-9b32-4f2c-9dfa-b9a11dc3a125 1G Sep 28 17:12:43 devstack sudo[92810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:44 devstack sudo[92810]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e1e7d980-d305-4319-93a9-c4ed7f2c690e tempest-VolumesDeleteCascade-44747889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2.c09cc355-9b32-4f2c-9dfa-b9a11dc3a125 1G" returned: 0 in 0.708s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e1e7d980-d305-4319-93a9-c4ed7f2c690e tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2.c09cc355-9b32-4f2c-9dfa-b9a11dc3a125 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:44 devstack sudo[92816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2.c09cc355-9b32-4f2c-9dfa-b9a11dc3a125 Sep 28 17:12:44 devstack sudo[92816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:44 devstack sudo[92816]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e1e7d980-d305-4319-93a9-c4ed7f2c690e tempest-VolumesDeleteCascade-44747889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2.c09cc355-9b32-4f2c-9dfa-b9a11dc3a125" returned: 0 in 0.387s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:44 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-e1e7d980-d305-4319-93a9-c4ed7f2c690e tempest-VolumesDeleteCascade-44747889 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2.c09cc355-9b32-4f2c-9dfa-b9a11dc3a125 is being set with open permissions: ugo+rw Sep 28 17:12:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e1e7d980-d305-4319-93a9-c4ed7f2c690e tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2.c09cc355-9b32-4f2c-9dfa-b9a11dc3a125 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:44 devstack sudo[92821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2.c09cc355-9b32-4f2c-9dfa-b9a11dc3a125 Sep 28 17:12:44 devstack sudo[92821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:45 devstack sudo[92821]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e1e7d980-d305-4319-93a9-c4ed7f2c690e tempest-VolumesDeleteCascade-44747889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2.c09cc355-9b32-4f2c-9dfa-b9a11dc3a125" returned: 0 in 0.396s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e1e7d980-d305-4319-93a9-c4ed7f2c690e tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:45 devstack sudo[92824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2.info Sep 28 17:12:45 devstack sudo[92824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:45 devstack sudo[92824]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e1e7d980-d305-4319-93a9-c4ed7f2c690e tempest-VolumesDeleteCascade-44747889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2.info" returned: 0 in 0.469s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:45 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-e1e7d980-d305-4319-93a9-c4ed7f2c690e tempest-VolumesDeleteCascade-44747889 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2.info is being set with open permissions: ugo+rw Sep 28 17:12:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e1e7d980-d305-4319-93a9-c4ed7f2c690e tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:45 devstack sudo[92831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2.info Sep 28 17:12:45 devstack sudo[92831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:45 devstack sudo[92831]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e1e7d980-d305-4319-93a9-c4ed7f2c690e tempest-VolumesDeleteCascade-44747889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2.info" returned: 0 in 0.332s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e1e7d980-d305-4319-93a9-c4ed7f2c690e tempest-VolumesDeleteCascade-44747889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.123s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:46 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-e1e7d980-d305-4319-93a9-c4ed7f2c690e tempest-VolumesDeleteCascade-44747889 None] Create snapshot completed successfully Sep 28 17:12:48 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Flow 'volume_create_manager' (f6f6faab-5317-4e67-b471-3a5f73e2e3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4104aaa1-b74c-46f2-9363-53a9922cd238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4104aaa1-b74c-46f2-9363-53a9922cd238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1351485863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d1a1511f1444f299332ba23d462013a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c09cc355-9b32-4f2c-9dfa-b9a11dc3a125,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:48Z,use_quota=True,user_id='c1142f48d0b5403c8cb2992111efde1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e32e705-cf05-4b2d-b041-2ae9ad686c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e32e705-cf05-4b2d-b041-2ae9ad686c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (400b54f4-2d0a-4ce4-b77d-555998041d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (400b54f4-2d0a-4ce4-b77d-555998041d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13', 'volume_name': 'volume-ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13', 'volume_size': 1, 'snapshot_id': 'c09cc355-9b32-4f2c-9dfa-b9a11dc3a125'}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb532eb-ede1-4d12-abb6-890d9bb557de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb532eb-ede1-4d12-abb6-890d9bb557de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc9bfa81-2710-47a1-91ae-49a1d48616f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:48 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Volume ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13', 'volume_size': 1, 'snapshot_id': 'c09cc355-9b32-4f2c-9dfa-b9a11dc3a125'} Sep 28 17:12:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:48 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Acquiring lock "cinder-quobyte-c09cc355-9b32-4f2c-9dfa-b9a11dc3a125-ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13" by "_create_volume_from_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:48 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Lock "cinder-quobyte-c09cc355-9b32-4f2c-9dfa-b9a11dc3a125-ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:48 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Creating volume ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13 from snapshot c09cc355-9b32-4f2c-9dfa-b9a11dc3a125 {{(pid=86917) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:12:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:48 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:48 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:48 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:48 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Acquiring lock "cinder-quobyte-ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13" by "_copy_volume_from_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:48 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Lock "cinder-quobyte-ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:48 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] snapshot: c09cc355-9b32-4f2c-9dfa-b9a11dc3a125, volume: ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13, {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:12:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:48 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:48 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:48 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d83b803-953a-4db8-a249-0e9f077da282]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2.c09cc355-9b32-4f2c-9dfa-b9a11dc3a125 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:48 devstack sudo[92864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2.c09cc355-9b32-4f2c-9dfa-b9a11dc3a125 Sep 28 17:12:48 devstack sudo[92864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:49 devstack sudo[92864]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2.c09cc355-9b32-4f2c-9dfa-b9a11dc3a125" returned: 0 in 0.580s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:12:49 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edc08e7-85b9-43fb-bae8-a140bd6e7bdd]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:12:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:49 devstack sudo[92869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2 Sep 28 17:12:49 devstack sudo[92869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:49 devstack sudo[92871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:12:49 devstack sudo[92871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:49 devstack sudo[92871]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.390s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:49 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager._thread_info {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:12:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread count: 28 {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:12:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread info: [<_MainThread(MainThread, started 132915553284224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:12:49 devstack sudo[92869]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2" returned: 0 in 0.662s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2 {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:12:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Creating direct copy from snapshot {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:12:49 devstack cinder-volume[86917]: DEBUG cinder.utils [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Path /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13 not found in is_blk_device check {{(pid=86917) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:12:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:49 devstack sudo[92879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13 Sep 28 17:12:49 devstack sudo[92879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:50 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-965630ea-4258-480d-8f8f-780e1228351e req-8f20ba6d-7acf-4ac3-9e64-4e2dca6e186c tempest-ServerActionsTestOtherA-1979217729 None] Terminate volume connection completed successfully. Sep 28 17:12:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-965630ea-4258-480d-8f8f-780e1228351e req-8f20ba6d-7acf-4ac3-9e64-4e2dca6e186c tempest-ServerActionsTestOtherA-1979217729 None] Deleting attachment 4bc259ee-1348-469c-b474-9543a84dcb7e. {{(pid=86917) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:12:51 devstack cinder-volume[86917]: DEBUG cinder.coordination [req-965630ea-4258-480d-8f8f-780e1228351e req-4fe6c0b7-ea9d-4043-8eb9-e46c9dca543d tempest-ServerActionsTestOtherA-1979217729 None] Acquiring lock "cinder-3cfc0419-bd09-43b0-84a2-d93c3ed707e8-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:51 devstack cinder-volume[86917]: DEBUG cinder.coordination [req-965630ea-4258-480d-8f8f-780e1228351e req-4fe6c0b7-ea9d-4043-8eb9-e46c9dca543d tempest-ServerActionsTestOtherA-1979217729 None] Lock "cinder-3cfc0419-bd09-43b0-84a2-d93c3ed707e8-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:51 devstack cinder-volume[86917]: DEBUG cinder.coordination [req-965630ea-4258-480d-8f8f-780e1228351e req-4fe6c0b7-ea9d-4043-8eb9-e46c9dca543d tempest-ServerActionsTestOtherA-1979217729 None] Acquiring lock "cinder-quobyte-3cfc0419-bd09-43b0-84a2-d93c3ed707e8" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:51 devstack cinder-volume[86917]: DEBUG cinder.coordination [req-965630ea-4258-480d-8f8f-780e1228351e req-4fe6c0b7-ea9d-4043-8eb9-e46c9dca543d tempest-ServerActionsTestOtherA-1979217729 None] Lock "cinder-quobyte-3cfc0419-bd09-43b0-84a2-d93c3ed707e8" acquired by "delete_volume" :: waited 0.046s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:51 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25cfee7-cf3a-4e36-9af7-73a24a26a041]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-965630ea-4258-480d-8f8f-780e1228351e req-4fe6c0b7-ea9d-4043-8eb9-e46c9dca543d tempest-ServerActionsTestOtherA-1979217729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3cfc0419-bd09-43b0-84a2-d93c3ed707e8 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:52 devstack sudo[92907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3cfc0419-bd09-43b0-84a2-d93c3ed707e8 Sep 28 17:12:52 devstack sudo[92907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:52 devstack sudo[92907]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-965630ea-4258-480d-8f8f-780e1228351e req-4fe6c0b7-ea9d-4043-8eb9-e46c9dca543d tempest-ServerActionsTestOtherA-1979217729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3cfc0419-bd09-43b0-84a2-d93c3ed707e8" returned: 0 in 1.251s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-965630ea-4258-480d-8f8f-780e1228351e req-4fe6c0b7-ea9d-4043-8eb9-e46c9dca543d tempest-ServerActionsTestOtherA-1979217729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3cfc0419-bd09-43b0-84a2-d93c3ed707e8 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:52 devstack sudo[92913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3cfc0419-bd09-43b0-84a2-d93c3ed707e8 Sep 28 17:12:52 devstack sudo[92913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:53 devstack sudo[92913]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-965630ea-4258-480d-8f8f-780e1228351e req-4fe6c0b7-ea9d-4043-8eb9-e46c9dca543d tempest-ServerActionsTestOtherA-1979217729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3cfc0419-bd09-43b0-84a2-d93c3ed707e8" returned: 0 in 0.464s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:53 devstack cinder-volume[86917]: DEBUG cinder.coordination [req-965630ea-4258-480d-8f8f-780e1228351e req-4fe6c0b7-ea9d-4043-8eb9-e46c9dca543d tempest-ServerActionsTestOtherA-1979217729 None] Lock "cinder-quobyte-3cfc0419-bd09-43b0-84a2-d93c3ed707e8" released by "delete_volume" :: held 1.861s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:53 devstack cinder-volume[86917]: DEBUG cinder.quota [req-965630ea-4258-480d-8f8f-780e1228351e req-4fe6c0b7-ea9d-4043-8eb9-e46c9dca543d tempest-ServerActionsTestOtherA-1979217729 None] Created reservations ['0d8082cb-c7da-4696-9b56-03079ca37abb', '2cf5ce79-5283-49d3-811f-a6ab3c1b4ea6', '0fc1bbb7-f62e-40c3-84f0-15912943492e', '453a39d0-bd11-4036-a08d-b3ab6fc51437'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-965630ea-4258-480d-8f8f-780e1228351e req-4fe6c0b7-ea9d-4043-8eb9-e46c9dca543d tempest-ServerActionsTestOtherA-1979217729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-965630ea-4258-480d-8f8f-780e1228351e req-4fe6c0b7-ea9d-4043-8eb9-e46c9dca543d tempest-ServerActionsTestOtherA-1979217729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:53 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [req-965630ea-4258-480d-8f8f-780e1228351e req-4fe6c0b7-ea9d-4043-8eb9-e46c9dca543d tempest-ServerActionsTestOtherA-1979217729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:53 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [req-965630ea-4258-480d-8f8f-780e1228351e req-4fe6c0b7-ea9d-4043-8eb9-e46c9dca543d tempest-ServerActionsTestOtherA-1979217729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-965630ea-4258-480d-8f8f-780e1228351e req-4fe6c0b7-ea9d-4043-8eb9-e46c9dca543d tempest-ServerActionsTestOtherA-1979217729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-965630ea-4258-480d-8f8f-780e1228351e req-4fe6c0b7-ea9d-4043-8eb9-e46c9dca543d tempest-ServerActionsTestOtherA-1979217729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:53 devstack sudo[92916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:12:53 devstack sudo[92916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:54 devstack sudo[92916]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-965630ea-4258-480d-8f8f-780e1228351e req-4fe6c0b7-ea9d-4043-8eb9-e46c9dca543d tempest-ServerActionsTestOtherA-1979217729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.547s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:54 devstack cinder-volume[86917]: DEBUG cinder.manager [req-965630ea-4258-480d-8f8f-780e1228351e req-4fe6c0b7-ea9d-4043-8eb9-e46c9dca543d tempest-ServerActionsTestOtherA-1979217729 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:54 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-965630ea-4258-480d-8f8f-780e1228351e req-4fe6c0b7-ea9d-4043-8eb9-e46c9dca543d tempest-ServerActionsTestOtherA-1979217729 None] Deleted volume successfully. Sep 28 17:12:54 devstack cinder-volume[86917]: DEBUG cinder.coordination [req-965630ea-4258-480d-8f8f-780e1228351e req-4fe6c0b7-ea9d-4043-8eb9-e46c9dca543d tempest-ServerActionsTestOtherA-1979217729 None] Lock "cinder-3cfc0419-bd09-43b0-84a2-d93c3ed707e8-delete_volume" released by "delete_volume" :: held 2.951s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:55 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fb86dd59-9e86-4c84-9b98-31163f35b621 tempest-ServerActionsTestOtherA-1979217729 None] Acquiring lock "cinder-dc22351f-4995-410e-9a2d-6b8377a22234-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:55 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fb86dd59-9e86-4c84-9b98-31163f35b621 tempest-ServerActionsTestOtherA-1979217729 None] Lock "cinder-dc22351f-4995-410e-9a2d-6b8377a22234-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:55 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fb86dd59-9e86-4c84-9b98-31163f35b621 tempest-ServerActionsTestOtherA-1979217729 None] Acquiring lock "cinder-quobyte-dc22351f-4995-410e-9a2d-6b8377a22234" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:55 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fb86dd59-9e86-4c84-9b98-31163f35b621 tempest-ServerActionsTestOtherA-1979217729 None] Lock "cinder-quobyte-dc22351f-4995-410e-9a2d-6b8377a22234" acquired by "delete_volume" :: waited 0.041s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:55 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d553b261-c1e6-4dba-8203-30d9c34f700a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fb86dd59-9e86-4c84-9b98-31163f35b621 tempest-ServerActionsTestOtherA-1979217729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc22351f-4995-410e-9a2d-6b8377a22234 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:55 devstack sudo[92920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc22351f-4995-410e-9a2d-6b8377a22234 Sep 28 17:12:55 devstack sudo[92920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:56 devstack sudo[92920]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fb86dd59-9e86-4c84-9b98-31163f35b621 tempest-ServerActionsTestOtherA-1979217729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc22351f-4995-410e-9a2d-6b8377a22234" returned: 0 in 1.234s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fb86dd59-9e86-4c84-9b98-31163f35b621 tempest-ServerActionsTestOtherA-1979217729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc22351f-4995-410e-9a2d-6b8377a22234 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:56 devstack sudo[92925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc22351f-4995-410e-9a2d-6b8377a22234 Sep 28 17:12:56 devstack sudo[92925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:57 devstack sudo[92925]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fb86dd59-9e86-4c84-9b98-31163f35b621 tempest-ServerActionsTestOtherA-1979217729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc22351f-4995-410e-9a2d-6b8377a22234" returned: 0 in 0.770s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:57 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fb86dd59-9e86-4c84-9b98-31163f35b621 tempest-ServerActionsTestOtherA-1979217729 None] Lock "cinder-quobyte-dc22351f-4995-410e-9a2d-6b8377a22234" released by "delete_volume" :: held 2.145s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:57 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-fb86dd59-9e86-4c84-9b98-31163f35b621 tempest-ServerActionsTestOtherA-1979217729 None] Created reservations ['e0309c04-0d5b-4741-9933-e187b45252d1', 'e5df4fd4-3b62-4710-b35a-3a914b8ead64', '70192c9b-7cdc-4838-9506-83ce638c28bc', 'a1ea0b78-b00b-467c-bfe7-5fd14f23744e'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-fb86dd59-9e86-4c84-9b98-31163f35b621 tempest-ServerActionsTestOtherA-1979217729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-fb86dd59-9e86-4c84-9b98-31163f35b621 tempest-ServerActionsTestOtherA-1979217729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:57 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-fb86dd59-9e86-4c84-9b98-31163f35b621 tempest-ServerActionsTestOtherA-1979217729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:57 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-fb86dd59-9e86-4c84-9b98-31163f35b621 tempest-ServerActionsTestOtherA-1979217729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-fb86dd59-9e86-4c84-9b98-31163f35b621 tempest-ServerActionsTestOtherA-1979217729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fb86dd59-9e86-4c84-9b98-31163f35b621 tempest-ServerActionsTestOtherA-1979217729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:58 devstack sudo[92928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:12:58 devstack sudo[92928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:58 devstack sudo[92928]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fb86dd59-9e86-4c84-9b98-31163f35b621 tempest-ServerActionsTestOtherA-1979217729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.808s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:58 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-fb86dd59-9e86-4c84-9b98-31163f35b621 tempest-ServerActionsTestOtherA-1979217729 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:58 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-fb86dd59-9e86-4c84-9b98-31163f35b621 tempest-ServerActionsTestOtherA-1979217729 None] Deleted volume successfully. Sep 28 17:12:58 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fb86dd59-9e86-4c84-9b98-31163f35b621 tempest-ServerActionsTestOtherA-1979217729 None] Lock "cinder-dc22351f-4995-410e-9a2d-6b8377a22234-delete_volume" released by "delete_volume" :: held 3.856s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:00 devstack sudo[92879]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13" returned: 0 in 10.756s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:00 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Image conversion details: src /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2, size 1024.00 MB, duration 10.76 sec, destination /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13 {{(pid=86917) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:13:00 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Converted 1024.00 MB image at 95.19 MB/s Sep 28 17:13:00 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13 is being set with open permissions: ugo+rw Sep 28 17:13:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:00 devstack sudo[92955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13 Sep 28 17:13:00 devstack sudo[92955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:01 devstack sudo[92955]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13" returned: 0 in 0.483s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:01 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Lock "cinder-quobyte-ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13" released by "_copy_volume_from_snapshot" :: held 12.662s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:01 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Lock "cinder-quobyte-c09cc355-9b32-4f2c-9dfa-b9a11dc3a125-ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13" released by "_create_volume_from_snapshot" :: held 12.795s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.816s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc9bfa81-2710-47a1-91ae-49a1d48616f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13', 'volume_size': 1, 'snapshot_id': 'c09cc355-9b32-4f2c-9dfa-b9a11dc3a125'}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6946d7e6-81be-4447-ad9f-2ff84e84663b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:01 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Volume volume-ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13 (ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13): created successfully Sep 28 17:13:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6946d7e6-81be-4447-ad9f-2ff84e84663b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Flow 'volume_create_manager' (f6f6faab-5317-4e67-b471-3a5f73e2e3cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:01 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-ff2d67f1-a99b-4ff2-bfc3-5c8ed1d301aa tempest-VolumesDeleteCascade-44747889 None] Created volume successfully. Sep 28 17:13:02 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Acquiring lock "cinder-ac9667fd-fcd7-481c-ab25-3cf6b97467a2-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:02 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Lock "cinder-ac9667fd-fcd7-481c-ab25-3cf6b97467a2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:02 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=55,cinder:UPDATE=74,cinder:INSERT=19,cinder:DELETE=9 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:13:02 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Performing cascade delete. {{(pid=86917) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 17:13:02 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Acquiring lock "cinder-c09cc355-9b32-4f2c-9dfa-b9a11dc3a125-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:02 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Lock "cinder-c09cc355-9b32-4f2c-9dfa-b9a11dc3a125-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:02 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Acquiring lock "cinder-quobyte-ac9667fd-fcd7-481c-ab25-3cf6b97467a2" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:02 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Lock "cinder-quobyte-ac9667fd-fcd7-481c-ab25-3cf6b97467a2" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:02 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Acquiring lock "cinder-quobyte-c09cc355-9b32-4f2c-9dfa-b9a11dc3a125" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:02 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Lock "cinder-quobyte-c09cc355-9b32-4f2c-9dfa-b9a11dc3a125" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:02 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Deleting offline snapshot c09cc355-9b32-4f2c-9dfa-b9a11dc3a125 of volume ac9667fd-fcd7-481c-ab25-3cf6b97467a2 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:13:02 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] snapshot_file for this snap is: volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2.c09cc355-9b32-4f2c-9dfa-b9a11dc3a125 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:13:02 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b5f7fd-19b9-4539-90ae-94faac4f0130]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2.c09cc355-9b32-4f2c-9dfa-b9a11dc3a125 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:02 devstack sudo[92965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2.c09cc355-9b32-4f2c-9dfa-b9a11dc3a125 Sep 28 17:13:02 devstack sudo[92965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:03 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-e2bfac2f-4199-450e-9a66-7859712d0b7a tempest-GroupsV320Test-725056941 None] Group tempest-GroupsV320Test-Group-1414767708: creating Sep 28 17:13:03 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-e2bfac2f-4199-450e-9a66-7859712d0b7a tempest-GroupsV320Test-725056941 None] Group tempest-GroupsV320Test-Group-1414767708: created successfully Sep 28 17:13:03 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-e2bfac2f-4199-450e-9a66-7859712d0b7a tempest-GroupsV320Test-725056941 None] Create group completed successfully. Sep 28 17:13:03 devstack sudo[92965]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2.c09cc355-9b32-4f2c-9dfa-b9a11dc3a125" returned: 0 in 0.878s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:03 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:13:03 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37a235a-ed2b-48fd-b2d8-45d5f03ef868]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:03 devstack sudo[92970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2 Sep 28 17:13:03 devstack sudo[92970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:04 devstack sudo[92970]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2" returned: 0 in 0.729s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2.c09cc355-9b32-4f2c-9dfa-b9a11dc3a125 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:04 devstack sudo[92978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2.c09cc355-9b32-4f2c-9dfa-b9a11dc3a125 Sep 28 17:13:04 devstack sudo[92978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:04 devstack sudo[92978]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2.c09cc355-9b32-4f2c-9dfa-b9a11dc3a125" returned: 0 in 0.539s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2.c09cc355-9b32-4f2c-9dfa-b9a11dc3a125 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:04 devstack sudo[92984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2.c09cc355-9b32-4f2c-9dfa-b9a11dc3a125 Sep 28 17:13:04 devstack sudo[92984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:05 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:UPDATE=69,cinder:SELECT=66,cinder:INSERT=16,cinder:DELETE=4 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:13:05 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-2bfec01b-78dd-420c-99e6-f0cbbbd81fe4 tempest-GroupsV320Test-725056941 None] Created reservations ['d891adcd-3182-4cd9-a4a7-f16db854e50a'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:05 devstack sudo[92984]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2.c09cc355-9b32-4f2c-9dfa-b9a11dc3a125" returned: 0 in 0.460s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:05 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Lock "cinder-quobyte-c09cc355-9b32-4f2c-9dfa-b9a11dc3a125" released by "_delete_snapshot" :: held 2.786s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:05 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Lock "cinder-quobyte-ac9667fd-fcd7-481c-ab25-3cf6b97467a2" released by "delete_snapshot" :: held 2.830s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2bfec01b-78dd-420c-99e6-f0cbbbd81fe4 tempest-GroupsV320Test-725056941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2bfec01b-78dd-420c-99e6-f0cbbbd81fe4 tempest-GroupsV320Test-725056941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-2bfec01b-78dd-420c-99e6-f0cbbbd81fe4 tempest-GroupsV320Test-725056941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-2bfec01b-78dd-420c-99e6-f0cbbbd81fe4 tempest-GroupsV320Test-725056941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2bfec01b-78dd-420c-99e6-f0cbbbd81fe4 tempest-GroupsV320Test-725056941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2bfec01b-78dd-420c-99e6-f0cbbbd81fe4 tempest-GroupsV320Test-725056941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:05 devstack sudo[92987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:13:05 devstack sudo[92987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:05 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Created reservations ['b0762dbe-72a9-458f-848a-10a28f519aba', '90355463-1637-4505-bcee-71a30750d010', '129e4684-966f-4d07-aa3d-cbcde170373a', '0d41bc61-a3a5-4267-aaf7-5de4f6a4097e'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:05 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Delete snapshot completed successfully. Sep 28 17:13:05 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Lock "cinder-c09cc355-9b32-4f2c-9dfa-b9a11dc3a125-delete_snapshot" released by "delete_snapshot" :: held 3.225s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Snapshots deleted, issuing volume delete {{(pid=86917) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 17:13:05 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Acquiring lock "cinder-quobyte-ac9667fd-fcd7-481c-ab25-3cf6b97467a2" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:05 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Lock "cinder-quobyte-ac9667fd-fcd7-481c-ab25-3cf6b97467a2" acquired by "delete_volume" :: waited 0.042s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:05 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba4ebdf-ef13-411e-a11b-3fa3e3405f7a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:05 devstack sudo[92987]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2bfec01b-78dd-420c-99e6-f0cbbbd81fe4 tempest-GroupsV320Test-725056941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.453s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:05 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-2bfec01b-78dd-420c-99e6-f0cbbbd81fe4 tempest-GroupsV320Test-725056941 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:05 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-2bfec01b-78dd-420c-99e6-f0cbbbd81fe4 tempest-GroupsV320Test-725056941 None] Delete group completed successfully. Sep 28 17:13:05 devstack sudo[92990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2 Sep 28 17:13:05 devstack sudo[92990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:06 devstack sudo[92990]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2" returned: 0 in 0.644s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:06 devstack sudo[92995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2 Sep 28 17:13:06 devstack sudo[92995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:06 devstack sudo[92995]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ac9667fd-fcd7-481c-ab25-3cf6b97467a2" returned: 0 in 0.490s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:06 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Lock "cinder-quobyte-ac9667fd-fcd7-481c-ab25-3cf6b97467a2" released by "delete_volume" :: held 1.291s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:07 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Created reservations ['948541bb-c33d-4f18-ab79-cb03547ac888', 'bb9335e7-341a-4aee-a6ba-efd3af5de526', '5873ce26-0d63-4fe2-a417-9613bed8d8c0', '09e18325-8a38-43c1-b801-c3b8713cdb1c'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:07 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:07 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:07 devstack sudo[92998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:13:07 devstack sudo[92998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:07 devstack sudo[92998]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.359s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:07 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:07 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Deleted volume successfully. Sep 28 17:13:07 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d154e59e-4392-4f06-a541-31225a84f256 tempest-VolumesDeleteCascade-44747889 None] Lock "cinder-ac9667fd-fcd7-481c-ab25-3cf6b97467a2-delete_volume" released by "delete_volume" :: held 5.373s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:08 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-28bac882-7f60-4149-8679-915aa8bb186c tempest-VolumesDeleteCascade-44747889 None] Acquiring lock "cinder-ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:08 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-28bac882-7f60-4149-8679-915aa8bb186c tempest-VolumesDeleteCascade-44747889 None] Lock "cinder-ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:08 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-28bac882-7f60-4149-8679-915aa8bb186c tempest-VolumesDeleteCascade-44747889 None] Acquiring lock "cinder-quobyte-ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:08 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-28bac882-7f60-4149-8679-915aa8bb186c tempest-VolumesDeleteCascade-44747889 None] Lock "cinder-quobyte-ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13" acquired by "delete_volume" :: waited 0.021s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:08 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e212b551-aac7-4c37-b696-3722feb7fd26]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-28bac882-7f60-4149-8679-915aa8bb186c tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:08 devstack sudo[93001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13 Sep 28 17:13:08 devstack sudo[93001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:09 devstack sudo[93001]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-28bac882-7f60-4149-8679-915aa8bb186c tempest-VolumesDeleteCascade-44747889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13" returned: 0 in 0.561s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-28bac882-7f60-4149-8679-915aa8bb186c tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:09 devstack sudo[93006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13 Sep 28 17:13:09 devstack sudo[93006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:09 devstack sudo[93006]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-28bac882-7f60-4149-8679-915aa8bb186c tempest-VolumesDeleteCascade-44747889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13" returned: 0 in 0.438s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:09 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-28bac882-7f60-4149-8679-915aa8bb186c tempest-VolumesDeleteCascade-44747889 None] Lock "cinder-quobyte-ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13" released by "delete_volume" :: held 1.079s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:09 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-28bac882-7f60-4149-8679-915aa8bb186c tempest-VolumesDeleteCascade-44747889 None] Created reservations ['6aa1c4c0-a5d9-4368-ab3a-c413be16bad5', '4ea83202-73c3-40a5-bbb0-020ec737f67b', '16a42f67-31e6-4580-a45e-450ad0b7713a', 'f81f62bf-87cf-4494-a67b-495149f97ba8'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-28bac882-7f60-4149-8679-915aa8bb186c tempest-VolumesDeleteCascade-44747889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-28bac882-7f60-4149-8679-915aa8bb186c tempest-VolumesDeleteCascade-44747889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-28bac882-7f60-4149-8679-915aa8bb186c tempest-VolumesDeleteCascade-44747889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-28bac882-7f60-4149-8679-915aa8bb186c tempest-VolumesDeleteCascade-44747889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-28bac882-7f60-4149-8679-915aa8bb186c tempest-VolumesDeleteCascade-44747889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-28bac882-7f60-4149-8679-915aa8bb186c tempest-VolumesDeleteCascade-44747889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:09 devstack sudo[93010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:13:09 devstack sudo[93010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:10 devstack sudo[93010]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-28bac882-7f60-4149-8679-915aa8bb186c tempest-VolumesDeleteCascade-44747889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.364s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:10 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-28bac882-7f60-4149-8679-915aa8bb186c tempest-VolumesDeleteCascade-44747889 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:10 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-28bac882-7f60-4149-8679-915aa8bb186c tempest-VolumesDeleteCascade-44747889 None] Deleted volume successfully. Sep 28 17:13:10 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-28bac882-7f60-4149-8679-915aa8bb186c tempest-VolumesDeleteCascade-44747889 None] Lock "cinder-ba2d0e55-44a6-4d7e-bb13-dd6cf7ccbb13-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:19 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=23,cinder:UPDATE=28,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:13:20 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:INSERT=7,cinder:SELECT=16,cinder:UPDATE=20,cinder:DELETE=1 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:13:23 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-aceeac9f-c288-4dc5-8228-a121b83852ba tempest-VolumesTransfersTest-1598187101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-aceeac9f-c288-4dc5-8228-a121b83852ba tempest-VolumesTransfersTest-1598187101 None] Flow 'volume_create_manager' (85695edc-ce25-4963-ad64-36ebb760df22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-aceeac9f-c288-4dc5-8228-a121b83852ba tempest-VolumesTransfersTest-1598187101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f86d55d-647f-44e9-a4a9-834de1fd8ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-aceeac9f-c288-4dc5-8228-a121b83852ba tempest-VolumesTransfersTest-1598187101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f86d55d-647f-44e9-a4a9-834de1fd8ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1439409138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa2b3ea4-3b16-42ca-9b8d-5e6943302084,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7caee405c8ef43a59028d7bf62390795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:23Z,use_quota=True,user_id='49834117cbb5420b9221dadec54f8eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-aceeac9f-c288-4dc5-8228-a121b83852ba tempest-VolumesTransfersTest-1598187101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e14d4a-0a15-443f-bd87-002d1b9faa83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-aceeac9f-c288-4dc5-8228-a121b83852ba tempest-VolumesTransfersTest-1598187101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e14d4a-0a15-443f-bd87-002d1b9faa83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-aceeac9f-c288-4dc5-8228-a121b83852ba tempest-VolumesTransfersTest-1598187101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dabe28c1-509b-4caa-b815-2b3f8a395634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-aceeac9f-c288-4dc5-8228-a121b83852ba tempest-VolumesTransfersTest-1598187101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dabe28c1-509b-4caa-b815-2b3f8a395634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa2b3ea4-3b16-42ca-9b8d-5e6943302084', 'volume_name': 'volume-aa2b3ea4-3b16-42ca-9b8d-5e6943302084', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-aceeac9f-c288-4dc5-8228-a121b83852ba tempest-VolumesTransfersTest-1598187101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4765c12-90d6-4d82-b8b1-914510ead3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-aceeac9f-c288-4dc5-8228-a121b83852ba tempest-VolumesTransfersTest-1598187101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4765c12-90d6-4d82-b8b1-914510ead3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-aceeac9f-c288-4dc5-8228-a121b83852ba tempest-VolumesTransfersTest-1598187101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48ebc6a2-227a-4630-944b-d7ccb5d9ab18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:23 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-aceeac9f-c288-4dc5-8228-a121b83852ba tempest-VolumesTransfersTest-1598187101 None] Volume aa2b3ea4-3b16-42ca-9b8d-5e6943302084: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa2b3ea4-3b16-42ca-9b8d-5e6943302084', 'volume_size': 1} Sep 28 17:13:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-aceeac9f-c288-4dc5-8228-a121b83852ba tempest-VolumesTransfersTest-1598187101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-aceeac9f-c288-4dc5-8228-a121b83852ba tempest-VolumesTransfersTest-1598187101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:23 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-aceeac9f-c288-4dc5-8228-a121b83852ba tempest-VolumesTransfersTest-1598187101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1439409138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa2b3ea4-3b16-42ca-9b8d-5e6943302084,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7caee405c8ef43a59028d7bf62390795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:23Z,use_quota=True,user_id='49834117cbb5420b9221dadec54f8eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:23 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-aceeac9f-c288-4dc5-8228-a121b83852ba tempest-VolumesTransfersTest-1598187101 None] Creating volume aa2b3ea4-3b16-42ca-9b8d-5e6943302084 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-aceeac9f-c288-4dc5-8228-a121b83852ba tempest-VolumesTransfersTest-1598187101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-aceeac9f-c288-4dc5-8228-a121b83852ba tempest-VolumesTransfersTest-1598187101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:23 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-aceeac9f-c288-4dc5-8228-a121b83852ba tempest-VolumesTransfersTest-1598187101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:23 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-aceeac9f-c288-4dc5-8228-a121b83852ba tempest-VolumesTransfersTest-1598187101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-aceeac9f-c288-4dc5-8228-a121b83852ba tempest-VolumesTransfersTest-1598187101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:23 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-aceeac9f-c288-4dc5-8228-a121b83852ba tempest-VolumesTransfersTest-1598187101 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:23 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-aceeac9f-c288-4dc5-8228-a121b83852ba tempest-VolumesTransfersTest-1598187101 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:13:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-aceeac9f-c288-4dc5-8228-a121b83852ba tempest-VolumesTransfersTest-1598187101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aa2b3ea4-3b16-42ca-9b8d-5e6943302084 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:23 devstack sudo[93058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aa2b3ea4-3b16-42ca-9b8d-5e6943302084 1073741824 Sep 28 17:13:23 devstack sudo[93058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:24 devstack sudo[93058]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-aceeac9f-c288-4dc5-8228-a121b83852ba tempest-VolumesTransfersTest-1598187101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aa2b3ea4-3b16-42ca-9b8d-5e6943302084 1073741824" returned: 0 in 0.734s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-aceeac9f-c288-4dc5-8228-a121b83852ba tempest-VolumesTransfersTest-1598187101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aa2b3ea4-3b16-42ca-9b8d-5e6943302084 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:24 devstack sudo[93064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aa2b3ea4-3b16-42ca-9b8d-5e6943302084 Sep 28 17:13:24 devstack sudo[93064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:25 devstack sudo[93064]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-aceeac9f-c288-4dc5-8228-a121b83852ba tempest-VolumesTransfersTest-1598187101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aa2b3ea4-3b16-42ca-9b8d-5e6943302084" returned: 0 in 0.552s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:25 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-aceeac9f-c288-4dc5-8228-a121b83852ba tempest-VolumesTransfersTest-1598187101 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-aceeac9f-c288-4dc5-8228-a121b83852ba tempest-VolumesTransfersTest-1598187101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-aceeac9f-c288-4dc5-8228-a121b83852ba tempest-VolumesTransfersTest-1598187101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48ebc6a2-227a-4630-944b-d7ccb5d9ab18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa2b3ea4-3b16-42ca-9b8d-5e6943302084', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-aceeac9f-c288-4dc5-8228-a121b83852ba tempest-VolumesTransfersTest-1598187101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f7d61ca-afa1-456c-9190-818f02296fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:25 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-aceeac9f-c288-4dc5-8228-a121b83852ba tempest-VolumesTransfersTest-1598187101 None] Volume volume-aa2b3ea4-3b16-42ca-9b8d-5e6943302084 (aa2b3ea4-3b16-42ca-9b8d-5e6943302084): created successfully Sep 28 17:13:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-aceeac9f-c288-4dc5-8228-a121b83852ba tempest-VolumesTransfersTest-1598187101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f7d61ca-afa1-456c-9190-818f02296fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-aceeac9f-c288-4dc5-8228-a121b83852ba tempest-VolumesTransfersTest-1598187101 None] Flow 'volume_create_manager' (85695edc-ce25-4963-ad64-36ebb760df22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:25 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-aceeac9f-c288-4dc5-8228-a121b83852ba tempest-VolumesTransfersTest-1598187101 None] Created volume successfully. Sep 28 17:13:27 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-3bd26a11-27bd-4c6b-bbac-5cd72c070137 tempest-VolumesTransfersTest-2014334445 None] Transfer volume completed successfully. Sep 28 17:13:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c41cfa2b-2e07-4303-bdad-cd1830eeaf20 tempest-VolumesTransfersTest-312142092 None] Acquiring lock "cinder-aa2b3ea4-3b16-42ca-9b8d-5e6943302084-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c41cfa2b-2e07-4303-bdad-cd1830eeaf20 tempest-VolumesTransfersTest-312142092 None] Lock "cinder-aa2b3ea4-3b16-42ca-9b8d-5e6943302084-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c41cfa2b-2e07-4303-bdad-cd1830eeaf20 tempest-VolumesTransfersTest-312142092 None] Acquiring lock "cinder-quobyte-aa2b3ea4-3b16-42ca-9b8d-5e6943302084" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c41cfa2b-2e07-4303-bdad-cd1830eeaf20 tempest-VolumesTransfersTest-312142092 None] Lock "cinder-quobyte-aa2b3ea4-3b16-42ca-9b8d-5e6943302084" acquired by "delete_volume" :: waited 0.034s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:28 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac726e7-710e-4df2-a5e3-06a5015441cb]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c41cfa2b-2e07-4303-bdad-cd1830eeaf20 tempest-VolumesTransfersTest-312142092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aa2b3ea4-3b16-42ca-9b8d-5e6943302084 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:28 devstack sudo[93068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aa2b3ea4-3b16-42ca-9b8d-5e6943302084 Sep 28 17:13:28 devstack sudo[93068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:28 devstack sudo[93068]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c41cfa2b-2e07-4303-bdad-cd1830eeaf20 tempest-VolumesTransfersTest-312142092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aa2b3ea4-3b16-42ca-9b8d-5e6943302084" returned: 0 in 0.733s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c41cfa2b-2e07-4303-bdad-cd1830eeaf20 tempest-VolumesTransfersTest-312142092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aa2b3ea4-3b16-42ca-9b8d-5e6943302084 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:28 devstack sudo[93078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aa2b3ea4-3b16-42ca-9b8d-5e6943302084 Sep 28 17:13:28 devstack sudo[93078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:29 devstack sudo[93078]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c41cfa2b-2e07-4303-bdad-cd1830eeaf20 tempest-VolumesTransfersTest-312142092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aa2b3ea4-3b16-42ca-9b8d-5e6943302084" returned: 0 in 0.343s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c41cfa2b-2e07-4303-bdad-cd1830eeaf20 tempest-VolumesTransfersTest-312142092 None] Lock "cinder-quobyte-aa2b3ea4-3b16-42ca-9b8d-5e6943302084" released by "delete_volume" :: held 1.140s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:29 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-c41cfa2b-2e07-4303-bdad-cd1830eeaf20 tempest-VolumesTransfersTest-312142092 None] Created reservations ['96f9b787-e217-4e82-bf83-11d553dac359', '5caeeee1-c31a-4bbb-ba2f-c590348d9088', '425805b1-729e-4874-a9b5-fa1447ca9661', 'bf5c4a49-61c7-431c-86ca-f0909a1363af'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c41cfa2b-2e07-4303-bdad-cd1830eeaf20 tempest-VolumesTransfersTest-312142092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c41cfa2b-2e07-4303-bdad-cd1830eeaf20 tempest-VolumesTransfersTest-312142092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c41cfa2b-2e07-4303-bdad-cd1830eeaf20 tempest-VolumesTransfersTest-312142092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c41cfa2b-2e07-4303-bdad-cd1830eeaf20 tempest-VolumesTransfersTest-312142092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c41cfa2b-2e07-4303-bdad-cd1830eeaf20 tempest-VolumesTransfersTest-312142092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c41cfa2b-2e07-4303-bdad-cd1830eeaf20 tempest-VolumesTransfersTest-312142092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:29 devstack sudo[93081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:13:29 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:29 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c41cfa2b-2e07-4303-bdad-cd1830eeaf20 tempest-VolumesTransfersTest-312142092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.403s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:29 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-c41cfa2b-2e07-4303-bdad-cd1830eeaf20 tempest-VolumesTransfersTest-312142092 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:29 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-c41cfa2b-2e07-4303-bdad-cd1830eeaf20 tempest-VolumesTransfersTest-312142092 None] Deleted volume successfully. Sep 28 17:13:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c41cfa2b-2e07-4303-bdad-cd1830eeaf20 tempest-VolumesTransfersTest-312142092 None] Lock "cinder-aa2b3ea4-3b16-42ca-9b8d-5e6943302084-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:31 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ddb216a-f4c4-4799-b4d1-a789e1873032 tempest-VolumesTransfersTest-1598187101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:31 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9ddb216a-f4c4-4799-b4d1-a789e1873032 tempest-VolumesTransfersTest-1598187101 None] Flow 'volume_create_manager' (ca82f65b-04be-48b9-94f9-9e2d978eb05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:31 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9ddb216a-f4c4-4799-b4d1-a789e1873032 tempest-VolumesTransfersTest-1598187101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc756d2-c61c-417c-a98e-6e45cf89056e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:31 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9ddb216a-f4c4-4799-b4d1-a789e1873032 tempest-VolumesTransfersTest-1598187101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc756d2-c61c-417c-a98e-6e45cf89056e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-691095959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8314669c-604c-4b91-98a1-1e6087fed062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7caee405c8ef43a59028d7bf62390795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:31Z,use_quota=True,user_id='49834117cbb5420b9221dadec54f8eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:31 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9ddb216a-f4c4-4799-b4d1-a789e1873032 tempest-VolumesTransfersTest-1598187101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166ce1d1-5a49-4154-be94-6a9ee63ac09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:31 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9ddb216a-f4c4-4799-b4d1-a789e1873032 tempest-VolumesTransfersTest-1598187101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166ce1d1-5a49-4154-be94-6a9ee63ac09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:31 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9ddb216a-f4c4-4799-b4d1-a789e1873032 tempest-VolumesTransfersTest-1598187101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104b6383-b39e-49ee-a5e2-2c1706c43798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:31 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9ddb216a-f4c4-4799-b4d1-a789e1873032 tempest-VolumesTransfersTest-1598187101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104b6383-b39e-49ee-a5e2-2c1706c43798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8314669c-604c-4b91-98a1-1e6087fed062', 'volume_name': 'volume-8314669c-604c-4b91-98a1-1e6087fed062', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:31 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9ddb216a-f4c4-4799-b4d1-a789e1873032 tempest-VolumesTransfersTest-1598187101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c82a59-82a7-4225-8511-00b11843ac80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:31 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9ddb216a-f4c4-4799-b4d1-a789e1873032 tempest-VolumesTransfersTest-1598187101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c82a59-82a7-4225-8511-00b11843ac80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:31 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9ddb216a-f4c4-4799-b4d1-a789e1873032 tempest-VolumesTransfersTest-1598187101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eb7f59a-f02a-4cd4-841b-2b9aad5ced22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:31 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-9ddb216a-f4c4-4799-b4d1-a789e1873032 tempest-VolumesTransfersTest-1598187101 None] Volume 8314669c-604c-4b91-98a1-1e6087fed062: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8314669c-604c-4b91-98a1-1e6087fed062', 'volume_size': 1} Sep 28 17:13:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9ddb216a-f4c4-4799-b4d1-a789e1873032 tempest-VolumesTransfersTest-1598187101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9ddb216a-f4c4-4799-b4d1-a789e1873032 tempest-VolumesTransfersTest-1598187101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-9ddb216a-f4c4-4799-b4d1-a789e1873032 tempest-VolumesTransfersTest-1598187101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-691095959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8314669c-604c-4b91-98a1-1e6087fed062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7caee405c8ef43a59028d7bf62390795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:31Z,use_quota=True,user_id='49834117cbb5420b9221dadec54f8eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-9ddb216a-f4c4-4799-b4d1-a789e1873032 tempest-VolumesTransfersTest-1598187101 None] Creating volume 8314669c-604c-4b91-98a1-1e6087fed062 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9ddb216a-f4c4-4799-b4d1-a789e1873032 tempest-VolumesTransfersTest-1598187101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9ddb216a-f4c4-4799-b4d1-a789e1873032 tempest-VolumesTransfersTest-1598187101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-9ddb216a-f4c4-4799-b4d1-a789e1873032 tempest-VolumesTransfersTest-1598187101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-9ddb216a-f4c4-4799-b4d1-a789e1873032 tempest-VolumesTransfersTest-1598187101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9ddb216a-f4c4-4799-b4d1-a789e1873032 tempest-VolumesTransfersTest-1598187101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-9ddb216a-f4c4-4799-b4d1-a789e1873032 tempest-VolumesTransfersTest-1598187101 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:31 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-9ddb216a-f4c4-4799-b4d1-a789e1873032 tempest-VolumesTransfersTest-1598187101 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:13:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9ddb216a-f4c4-4799-b4d1-a789e1873032 tempest-VolumesTransfersTest-1598187101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8314669c-604c-4b91-98a1-1e6087fed062 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:31 devstack sudo[93087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8314669c-604c-4b91-98a1-1e6087fed062 1073741824 Sep 28 17:13:31 devstack sudo[93087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:32 devstack sudo[93087]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9ddb216a-f4c4-4799-b4d1-a789e1873032 tempest-VolumesTransfersTest-1598187101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8314669c-604c-4b91-98a1-1e6087fed062 1073741824" returned: 0 in 0.874s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9ddb216a-f4c4-4799-b4d1-a789e1873032 tempest-VolumesTransfersTest-1598187101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8314669c-604c-4b91-98a1-1e6087fed062 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:32 devstack sudo[93096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8314669c-604c-4b91-98a1-1e6087fed062 Sep 28 17:13:32 devstack sudo[93096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:32 devstack sudo[93096]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9ddb216a-f4c4-4799-b4d1-a789e1873032 tempest-VolumesTransfersTest-1598187101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8314669c-604c-4b91-98a1-1e6087fed062" returned: 0 in 0.432s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-9ddb216a-f4c4-4799-b4d1-a789e1873032 tempest-VolumesTransfersTest-1598187101 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9ddb216a-f4c4-4799-b4d1-a789e1873032 tempest-VolumesTransfersTest-1598187101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9ddb216a-f4c4-4799-b4d1-a789e1873032 tempest-VolumesTransfersTest-1598187101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eb7f59a-f02a-4cd4-841b-2b9aad5ced22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8314669c-604c-4b91-98a1-1e6087fed062', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9ddb216a-f4c4-4799-b4d1-a789e1873032 tempest-VolumesTransfersTest-1598187101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cb33855-dfe3-4d82-a87d-a52d7189b6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:32 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-9ddb216a-f4c4-4799-b4d1-a789e1873032 tempest-VolumesTransfersTest-1598187101 None] Volume volume-8314669c-604c-4b91-98a1-1e6087fed062 (8314669c-604c-4b91-98a1-1e6087fed062): created successfully Sep 28 17:13:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9ddb216a-f4c4-4799-b4d1-a789e1873032 tempest-VolumesTransfersTest-1598187101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cb33855-dfe3-4d82-a87d-a52d7189b6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9ddb216a-f4c4-4799-b4d1-a789e1873032 tempest-VolumesTransfersTest-1598187101 None] Flow 'volume_create_manager' (ca82f65b-04be-48b9-94f9-9e2d978eb05c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:32 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-9ddb216a-f4c4-4799-b4d1-a789e1873032 tempest-VolumesTransfersTest-1598187101 None] Created volume successfully. Sep 28 17:13:33 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d54dfbfe-cba9-40ef-9e3a-d225abd9ec86 tempest-VolumesTransfersTest-312142092 None] Acquiring lock "cinder-8314669c-604c-4b91-98a1-1e6087fed062-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:33 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d54dfbfe-cba9-40ef-9e3a-d225abd9ec86 tempest-VolumesTransfersTest-312142092 None] Lock "cinder-8314669c-604c-4b91-98a1-1e6087fed062-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:33 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d54dfbfe-cba9-40ef-9e3a-d225abd9ec86 tempest-VolumesTransfersTest-312142092 None] Acquiring lock "cinder-quobyte-8314669c-604c-4b91-98a1-1e6087fed062" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:33 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d54dfbfe-cba9-40ef-9e3a-d225abd9ec86 tempest-VolumesTransfersTest-312142092 None] Lock "cinder-quobyte-8314669c-604c-4b91-98a1-1e6087fed062" acquired by "delete_volume" :: waited 0.028s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:34 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8facb82d-d873-48dd-b3c1-eee02ac849c8]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d54dfbfe-cba9-40ef-9e3a-d225abd9ec86 tempest-VolumesTransfersTest-312142092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8314669c-604c-4b91-98a1-1e6087fed062 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:34 devstack sudo[93112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8314669c-604c-4b91-98a1-1e6087fed062 Sep 28 17:13:34 devstack sudo[93112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:34 devstack sudo[93112]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d54dfbfe-cba9-40ef-9e3a-d225abd9ec86 tempest-VolumesTransfersTest-312142092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8314669c-604c-4b91-98a1-1e6087fed062" returned: 0 in 0.635s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d54dfbfe-cba9-40ef-9e3a-d225abd9ec86 tempest-VolumesTransfersTest-312142092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8314669c-604c-4b91-98a1-1e6087fed062 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:34 devstack sudo[93118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8314669c-604c-4b91-98a1-1e6087fed062 Sep 28 17:13:34 devstack sudo[93118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:35 devstack sudo[93118]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d54dfbfe-cba9-40ef-9e3a-d225abd9ec86 tempest-VolumesTransfersTest-312142092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8314669c-604c-4b91-98a1-1e6087fed062" returned: 0 in 0.519s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:35 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d54dfbfe-cba9-40ef-9e3a-d225abd9ec86 tempest-VolumesTransfersTest-312142092 None] Lock "cinder-quobyte-8314669c-604c-4b91-98a1-1e6087fed062" released by "delete_volume" :: held 1.229s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:35 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-d54dfbfe-cba9-40ef-9e3a-d225abd9ec86 tempest-VolumesTransfersTest-312142092 None] Created reservations ['06f6aea2-13e1-488b-9471-5cb46e141fa8', 'f3f7d0bd-6c2a-4a90-940d-3d51780ed53e', '944ec361-8878-4b9b-ab15-b7fd1785b7a3', '66917c88-11bd-4672-89de-90bdaab543c8'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d54dfbfe-cba9-40ef-9e3a-d225abd9ec86 tempest-VolumesTransfersTest-312142092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d54dfbfe-cba9-40ef-9e3a-d225abd9ec86 tempest-VolumesTransfersTest-312142092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:35 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d54dfbfe-cba9-40ef-9e3a-d225abd9ec86 tempest-VolumesTransfersTest-312142092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:35 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d54dfbfe-cba9-40ef-9e3a-d225abd9ec86 tempest-VolumesTransfersTest-312142092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d54dfbfe-cba9-40ef-9e3a-d225abd9ec86 tempest-VolumesTransfersTest-312142092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d54dfbfe-cba9-40ef-9e3a-d225abd9ec86 tempest-VolumesTransfersTest-312142092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:35 devstack sudo[93122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:13:35 devstack sudo[93122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:35 devstack sudo[93122]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d54dfbfe-cba9-40ef-9e3a-d225abd9ec86 tempest-VolumesTransfersTest-312142092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.386s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:35 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-d54dfbfe-cba9-40ef-9e3a-d225abd9ec86 tempest-VolumesTransfersTest-312142092 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:35 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-d54dfbfe-cba9-40ef-9e3a-d225abd9ec86 tempest-VolumesTransfersTest-312142092 None] Deleted volume successfully. Sep 28 17:13:35 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d54dfbfe-cba9-40ef-9e3a-d225abd9ec86 tempest-VolumesTransfersTest-312142092 None] Lock "cinder-8314669c-604c-4b91-98a1-1e6087fed062-delete_volume" released by "delete_volume" :: held 2.060s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:41 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b1a48fd-6974-4f6e-9b20-d80969d027c8 tempest-VolumesServicesTestJSON-1085208517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:41 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b1a48fd-6974-4f6e-9b20-d80969d027c8 tempest-VolumesServicesTestJSON-1085208517 None] Flow 'volume_create_manager' (a9a86001-117b-4578-8a06-15d70f60d6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:41 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b1a48fd-6974-4f6e-9b20-d80969d027c8 tempest-VolumesServicesTestJSON-1085208517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afe2186b-239c-4f80-b095-64fa68e5a0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:41 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b1a48fd-6974-4f6e-9b20-d80969d027c8 tempest-VolumesServicesTestJSON-1085208517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afe2186b-239c-4f80-b095-64fa68e5a0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-799031407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96314b1a-8160-447b-8327-4e42d04eec74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='158b26c6030e49bd8adbe30415c0335e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:42Z,use_quota=True,user_id='9eafc75239264899924e36750f2116d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:41 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b1a48fd-6974-4f6e-9b20-d80969d027c8 tempest-VolumesServicesTestJSON-1085208517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6214a978-4f22-452b-a7aa-24326785adc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:41 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b1a48fd-6974-4f6e-9b20-d80969d027c8 tempest-VolumesServicesTestJSON-1085208517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6214a978-4f22-452b-a7aa-24326785adc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:41 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b1a48fd-6974-4f6e-9b20-d80969d027c8 tempest-VolumesServicesTestJSON-1085208517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d307e474-3f83-4f06-9a57-a54eab374c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:41 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b1a48fd-6974-4f6e-9b20-d80969d027c8 tempest-VolumesServicesTestJSON-1085208517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d307e474-3f83-4f06-9a57-a54eab374c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96314b1a-8160-447b-8327-4e42d04eec74', 'volume_name': 'volume-96314b1a-8160-447b-8327-4e42d04eec74', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:41 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b1a48fd-6974-4f6e-9b20-d80969d027c8 tempest-VolumesServicesTestJSON-1085208517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e399047-15dc-4f39-a90d-d45487bd957b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:41 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b1a48fd-6974-4f6e-9b20-d80969d027c8 tempest-VolumesServicesTestJSON-1085208517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e399047-15dc-4f39-a90d-d45487bd957b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:41 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b1a48fd-6974-4f6e-9b20-d80969d027c8 tempest-VolumesServicesTestJSON-1085208517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4df9c43-492d-4932-a224-2351b25bfe42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:41 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-6b1a48fd-6974-4f6e-9b20-d80969d027c8 tempest-VolumesServicesTestJSON-1085208517 None] Volume 96314b1a-8160-447b-8327-4e42d04eec74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96314b1a-8160-447b-8327-4e42d04eec74', 'volume_size': 1} Sep 28 17:13:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6b1a48fd-6974-4f6e-9b20-d80969d027c8 tempest-VolumesServicesTestJSON-1085208517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6b1a48fd-6974-4f6e-9b20-d80969d027c8 tempest-VolumesServicesTestJSON-1085208517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:41 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6b1a48fd-6974-4f6e-9b20-d80969d027c8 tempest-VolumesServicesTestJSON-1085208517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-799031407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96314b1a-8160-447b-8327-4e42d04eec74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='158b26c6030e49bd8adbe30415c0335e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:42Z,use_quota=True,user_id='9eafc75239264899924e36750f2116d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:41 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-6b1a48fd-6974-4f6e-9b20-d80969d027c8 tempest-VolumesServicesTestJSON-1085208517 None] Creating volume 96314b1a-8160-447b-8327-4e42d04eec74 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6b1a48fd-6974-4f6e-9b20-d80969d027c8 tempest-VolumesServicesTestJSON-1085208517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6b1a48fd-6974-4f6e-9b20-d80969d027c8 tempest-VolumesServicesTestJSON-1085208517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:41 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6b1a48fd-6974-4f6e-9b20-d80969d027c8 tempest-VolumesServicesTestJSON-1085208517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:41 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6b1a48fd-6974-4f6e-9b20-d80969d027c8 tempest-VolumesServicesTestJSON-1085208517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6b1a48fd-6974-4f6e-9b20-d80969d027c8 tempest-VolumesServicesTestJSON-1085208517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:41 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6b1a48fd-6974-4f6e-9b20-d80969d027c8 tempest-VolumesServicesTestJSON-1085208517 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:41 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-6b1a48fd-6974-4f6e-9b20-d80969d027c8 tempest-VolumesServicesTestJSON-1085208517 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:13:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b1a48fd-6974-4f6e-9b20-d80969d027c8 tempest-VolumesServicesTestJSON-1085208517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-96314b1a-8160-447b-8327-4e42d04eec74 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:41 devstack sudo[93208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-96314b1a-8160-447b-8327-4e42d04eec74 1073741824 Sep 28 17:13:41 devstack sudo[93208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:42 devstack sudo[93208]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b1a48fd-6974-4f6e-9b20-d80969d027c8 tempest-VolumesServicesTestJSON-1085208517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-96314b1a-8160-447b-8327-4e42d04eec74 1073741824" returned: 0 in 1.119s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b1a48fd-6974-4f6e-9b20-d80969d027c8 tempest-VolumesServicesTestJSON-1085208517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-96314b1a-8160-447b-8327-4e42d04eec74 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:43 devstack sudo[93215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-96314b1a-8160-447b-8327-4e42d04eec74 Sep 28 17:13:43 devstack sudo[93215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:43 devstack sudo[93215]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b1a48fd-6974-4f6e-9b20-d80969d027c8 tempest-VolumesServicesTestJSON-1085208517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-96314b1a-8160-447b-8327-4e42d04eec74" returned: 0 in 0.615s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:43 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6b1a48fd-6974-4f6e-9b20-d80969d027c8 tempest-VolumesServicesTestJSON-1085208517 None] <== create_volume: return (1872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6b1a48fd-6974-4f6e-9b20-d80969d027c8 tempest-VolumesServicesTestJSON-1085208517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b1a48fd-6974-4f6e-9b20-d80969d027c8 tempest-VolumesServicesTestJSON-1085208517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4df9c43-492d-4932-a224-2351b25bfe42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96314b1a-8160-447b-8327-4e42d04eec74', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b1a48fd-6974-4f6e-9b20-d80969d027c8 tempest-VolumesServicesTestJSON-1085208517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e480eb0f-f013-4e31-9e15-bc572b6e9498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:43 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-6b1a48fd-6974-4f6e-9b20-d80969d027c8 tempest-VolumesServicesTestJSON-1085208517 None] Volume volume-96314b1a-8160-447b-8327-4e42d04eec74 (96314b1a-8160-447b-8327-4e42d04eec74): created successfully Sep 28 17:13:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b1a48fd-6974-4f6e-9b20-d80969d027c8 tempest-VolumesServicesTestJSON-1085208517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e480eb0f-f013-4e31-9e15-bc572b6e9498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b1a48fd-6974-4f6e-9b20-d80969d027c8 tempest-VolumesServicesTestJSON-1085208517 None] Flow 'volume_create_manager' (a9a86001-117b-4578-8a06-15d70f60d6ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:43 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-6b1a48fd-6974-4f6e-9b20-d80969d027c8 tempest-VolumesServicesTestJSON-1085208517 None] Created volume successfully. Sep 28 17:13:45 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-7cc94e84-f03a-4023-8375-c456ada59054 tempest-VolumesServicesTestJSON-1085208517 None] Acquiring lock "cinder-96314b1a-8160-447b-8327-4e42d04eec74-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:45 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-7cc94e84-f03a-4023-8375-c456ada59054 tempest-VolumesServicesTestJSON-1085208517 None] Lock "cinder-96314b1a-8160-447b-8327-4e42d04eec74-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:45 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-7cc94e84-f03a-4023-8375-c456ada59054 tempest-VolumesServicesTestJSON-1085208517 None] Acquiring lock "cinder-quobyte-96314b1a-8160-447b-8327-4e42d04eec74" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:45 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-7cc94e84-f03a-4023-8375-c456ada59054 tempest-VolumesServicesTestJSON-1085208517 None] Lock "cinder-quobyte-96314b1a-8160-447b-8327-4e42d04eec74" acquired by "delete_volume" :: waited 0.026s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:45 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34074bd-6b35-4914-bc21-86914f0121d5]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7cc94e84-f03a-4023-8375-c456ada59054 tempest-VolumesServicesTestJSON-1085208517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-96314b1a-8160-447b-8327-4e42d04eec74 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:45 devstack sudo[93222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-96314b1a-8160-447b-8327-4e42d04eec74 Sep 28 17:13:45 devstack sudo[93222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:46 devstack sudo[93222]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7cc94e84-f03a-4023-8375-c456ada59054 tempest-VolumesServicesTestJSON-1085208517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-96314b1a-8160-447b-8327-4e42d04eec74" returned: 0 in 0.645s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7cc94e84-f03a-4023-8375-c456ada59054 tempest-VolumesServicesTestJSON-1085208517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-96314b1a-8160-447b-8327-4e42d04eec74 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:46 devstack sudo[93227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-96314b1a-8160-447b-8327-4e42d04eec74 Sep 28 17:13:46 devstack sudo[93227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:46 devstack sudo[93227]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7cc94e84-f03a-4023-8375-c456ada59054 tempest-VolumesServicesTestJSON-1085208517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-96314b1a-8160-447b-8327-4e42d04eec74" returned: 0 in 0.549s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:46 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-7cc94e84-f03a-4023-8375-c456ada59054 tempest-VolumesServicesTestJSON-1085208517 None] Lock "cinder-quobyte-96314b1a-8160-447b-8327-4e42d04eec74" released by "delete_volume" :: held 1.296s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:46 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-7cc94e84-f03a-4023-8375-c456ada59054 tempest-VolumesServicesTestJSON-1085208517 None] Created reservations ['4a3d85ea-bec2-4eb6-bfb6-ec640a49bf49', '6eba2140-92ca-475e-8c1e-80b7b537c081', 'd2a1d90e-7204-4660-b027-088f663905a3', '93bfa92e-169b-4c01-a2e8-b4e107dca446'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7cc94e84-f03a-4023-8375-c456ada59054 tempest-VolumesServicesTestJSON-1085208517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7cc94e84-f03a-4023-8375-c456ada59054 tempest-VolumesServicesTestJSON-1085208517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:46 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-7cc94e84-f03a-4023-8375-c456ada59054 tempest-VolumesServicesTestJSON-1085208517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:46 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-7cc94e84-f03a-4023-8375-c456ada59054 tempest-VolumesServicesTestJSON-1085208517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7cc94e84-f03a-4023-8375-c456ada59054 tempest-VolumesServicesTestJSON-1085208517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7cc94e84-f03a-4023-8375-c456ada59054 tempest-VolumesServicesTestJSON-1085208517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:46 devstack sudo[93230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:13:46 devstack sudo[93230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:47 devstack sudo[93230]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7cc94e84-f03a-4023-8375-c456ada59054 tempest-VolumesServicesTestJSON-1085208517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.397s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:47 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-7cc94e84-f03a-4023-8375-c456ada59054 tempest-VolumesServicesTestJSON-1085208517 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:47 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-7cc94e84-f03a-4023-8375-c456ada59054 tempest-VolumesServicesTestJSON-1085208517 None] Deleted volume successfully. Sep 28 17:13:47 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-7cc94e84-f03a-4023-8375-c456ada59054 tempest-VolumesServicesTestJSON-1085208517 None] Lock "cinder-96314b1a-8160-447b-8327-4e42d04eec74-delete_volume" released by "delete_volume" :: held 2.130s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:13:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:49 devstack sudo[93233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:13:49 devstack sudo[93233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:50 devstack sudo[93233]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.963s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:50 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:50 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager._thread_info {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:13:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread count: 28 {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:13:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread info: [<_MainThread(MainThread, started 132915553284224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:13:52 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3dcb3f3-5d1f-4087-b22e-998572a839c9 tempest-VolumesTransfersV355Test-165765734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c3dcb3f3-5d1f-4087-b22e-998572a839c9 tempest-VolumesTransfersV355Test-165765734 None] Flow 'volume_create_manager' (4ebcb47b-da0a-48e5-ba70-5ee8f3924b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c3dcb3f3-5d1f-4087-b22e-998572a839c9 tempest-VolumesTransfersV355Test-165765734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f94a884-2557-427e-bce7-f2a9a37af7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c3dcb3f3-5d1f-4087-b22e-998572a839c9 tempest-VolumesTransfersV355Test-165765734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f94a884-2557-427e-bce7-f2a9a37af7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-557453681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2d4cb8-a108-44a6-8355-b931bc2f89b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14149e1cd12f4cd688ac6d71585e92ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:53Z,use_quota=True,user_id='58d625a183444cceb8b9eba14b37030d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c3dcb3f3-5d1f-4087-b22e-998572a839c9 tempest-VolumesTransfersV355Test-165765734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c69847c4-4564-4bb6-8e8a-d7ca54e93b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c3dcb3f3-5d1f-4087-b22e-998572a839c9 tempest-VolumesTransfersV355Test-165765734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c69847c4-4564-4bb6-8e8a-d7ca54e93b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c3dcb3f3-5d1f-4087-b22e-998572a839c9 tempest-VolumesTransfersV355Test-165765734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e96cdfb-db6d-4e9b-bd78-7bdc37492236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c3dcb3f3-5d1f-4087-b22e-998572a839c9 tempest-VolumesTransfersV355Test-165765734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e96cdfb-db6d-4e9b-bd78-7bdc37492236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb2d4cb8-a108-44a6-8355-b931bc2f89b9', 'volume_name': 'volume-fb2d4cb8-a108-44a6-8355-b931bc2f89b9', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c3dcb3f3-5d1f-4087-b22e-998572a839c9 tempest-VolumesTransfersV355Test-165765734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6b3d804-63e8-41f0-b69c-43a6076916c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c3dcb3f3-5d1f-4087-b22e-998572a839c9 tempest-VolumesTransfersV355Test-165765734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6b3d804-63e8-41f0-b69c-43a6076916c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c3dcb3f3-5d1f-4087-b22e-998572a839c9 tempest-VolumesTransfersV355Test-165765734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d440fb79-ee4a-426b-91d9-80c9f83e84fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:52 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-c3dcb3f3-5d1f-4087-b22e-998572a839c9 tempest-VolumesTransfersV355Test-165765734 None] Volume fb2d4cb8-a108-44a6-8355-b931bc2f89b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb2d4cb8-a108-44a6-8355-b931bc2f89b9', 'volume_size': 1} Sep 28 17:13:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c3dcb3f3-5d1f-4087-b22e-998572a839c9 tempest-VolumesTransfersV355Test-165765734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c3dcb3f3-5d1f-4087-b22e-998572a839c9 tempest-VolumesTransfersV355Test-165765734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcb3f3-5d1f-4087-b22e-998572a839c9 tempest-VolumesTransfersV355Test-165765734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-557453681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2d4cb8-a108-44a6-8355-b931bc2f89b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14149e1cd12f4cd688ac6d71585e92ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:53Z,use_quota=True,user_id='58d625a183444cceb8b9eba14b37030d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-c3dcb3f3-5d1f-4087-b22e-998572a839c9 tempest-VolumesTransfersV355Test-165765734 None] Creating volume fb2d4cb8-a108-44a6-8355-b931bc2f89b9 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c3dcb3f3-5d1f-4087-b22e-998572a839c9 tempest-VolumesTransfersV355Test-165765734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c3dcb3f3-5d1f-4087-b22e-998572a839c9 tempest-VolumesTransfersV355Test-165765734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcb3f3-5d1f-4087-b22e-998572a839c9 tempest-VolumesTransfersV355Test-165765734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcb3f3-5d1f-4087-b22e-998572a839c9 tempest-VolumesTransfersV355Test-165765734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c3dcb3f3-5d1f-4087-b22e-998572a839c9 tempest-VolumesTransfersV355Test-165765734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcb3f3-5d1f-4087-b22e-998572a839c9 tempest-VolumesTransfersV355Test-165765734 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:52 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-c3dcb3f3-5d1f-4087-b22e-998572a839c9 tempest-VolumesTransfersV355Test-165765734 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:13:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c3dcb3f3-5d1f-4087-b22e-998572a839c9 tempest-VolumesTransfersV355Test-165765734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb2d4cb8-a108-44a6-8355-b931bc2f89b9 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:52 devstack sudo[93237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb2d4cb8-a108-44a6-8355-b931bc2f89b9 1073741824 Sep 28 17:13:52 devstack sudo[93237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:53 devstack sudo[93237]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c3dcb3f3-5d1f-4087-b22e-998572a839c9 tempest-VolumesTransfersV355Test-165765734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb2d4cb8-a108-44a6-8355-b931bc2f89b9 1073741824" returned: 0 in 0.844s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c3dcb3f3-5d1f-4087-b22e-998572a839c9 tempest-VolumesTransfersV355Test-165765734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb2d4cb8-a108-44a6-8355-b931bc2f89b9 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:53 devstack sudo[93243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb2d4cb8-a108-44a6-8355-b931bc2f89b9 Sep 28 17:13:53 devstack sudo[93243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:54 devstack sudo[93243]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c3dcb3f3-5d1f-4087-b22e-998572a839c9 tempest-VolumesTransfersV355Test-165765734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb2d4cb8-a108-44a6-8355-b931bc2f89b9" returned: 0 in 0.456s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:54 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c3dcb3f3-5d1f-4087-b22e-998572a839c9 tempest-VolumesTransfersV355Test-165765734 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c3dcb3f3-5d1f-4087-b22e-998572a839c9 tempest-VolumesTransfersV355Test-165765734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:54 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c3dcb3f3-5d1f-4087-b22e-998572a839c9 tempest-VolumesTransfersV355Test-165765734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d440fb79-ee4a-426b-91d9-80c9f83e84fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb2d4cb8-a108-44a6-8355-b931bc2f89b9', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:54 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c3dcb3f3-5d1f-4087-b22e-998572a839c9 tempest-VolumesTransfersV355Test-165765734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faf6d560-f294-4d5a-8d18-ddab5ab4f816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:54 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-c3dcb3f3-5d1f-4087-b22e-998572a839c9 tempest-VolumesTransfersV355Test-165765734 None] Volume volume-fb2d4cb8-a108-44a6-8355-b931bc2f89b9 (fb2d4cb8-a108-44a6-8355-b931bc2f89b9): created successfully Sep 28 17:13:54 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c3dcb3f3-5d1f-4087-b22e-998572a839c9 tempest-VolumesTransfersV355Test-165765734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faf6d560-f294-4d5a-8d18-ddab5ab4f816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:54 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c3dcb3f3-5d1f-4087-b22e-998572a839c9 tempest-VolumesTransfersV355Test-165765734 None] Flow 'volume_create_manager' (4ebcb47b-da0a-48e5-ba70-5ee8f3924b9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:54 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-c3dcb3f3-5d1f-4087-b22e-998572a839c9 tempest-VolumesTransfersV355Test-165765734 None] Created volume successfully. Sep 28 17:13:56 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-8c0eeb45-860f-4fdc-90fc-5b8481d11025 tempest-VolumesTransfersV355Test-1974501925 None] Transfer volume completed successfully. Sep 28 17:13:57 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ce75d0c5-ce54-4c9a-a25f-c73bc7b86b56 tempest-VolumesTransfersV355Test-418502237 None] Acquiring lock "cinder-fb2d4cb8-a108-44a6-8355-b931bc2f89b9-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:57 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ce75d0c5-ce54-4c9a-a25f-c73bc7b86b56 tempest-VolumesTransfersV355Test-418502237 None] Lock "cinder-fb2d4cb8-a108-44a6-8355-b931bc2f89b9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:57 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ce75d0c5-ce54-4c9a-a25f-c73bc7b86b56 tempest-VolumesTransfersV355Test-418502237 None] Acquiring lock "cinder-quobyte-fb2d4cb8-a108-44a6-8355-b931bc2f89b9" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:57 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ce75d0c5-ce54-4c9a-a25f-c73bc7b86b56 tempest-VolumesTransfersV355Test-418502237 None] Lock "cinder-quobyte-fb2d4cb8-a108-44a6-8355-b931bc2f89b9" acquired by "delete_volume" :: waited 0.025s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:57 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8567dad6-b34a-4ad6-92fe-66bc03d381f9]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ce75d0c5-ce54-4c9a-a25f-c73bc7b86b56 tempest-VolumesTransfersV355Test-418502237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb2d4cb8-a108-44a6-8355-b931bc2f89b9 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:58 devstack sudo[93310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb2d4cb8-a108-44a6-8355-b931bc2f89b9 Sep 28 17:13:58 devstack sudo[93310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:58 devstack sudo[93310]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ce75d0c5-ce54-4c9a-a25f-c73bc7b86b56 tempest-VolumesTransfersV355Test-418502237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb2d4cb8-a108-44a6-8355-b931bc2f89b9" returned: 0 in 0.484s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ce75d0c5-ce54-4c9a-a25f-c73bc7b86b56 tempest-VolumesTransfersV355Test-418502237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb2d4cb8-a108-44a6-8355-b931bc2f89b9 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:58 devstack sudo[93315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb2d4cb8-a108-44a6-8355-b931bc2f89b9 Sep 28 17:13:58 devstack sudo[93315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:58 devstack sudo[93315]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ce75d0c5-ce54-4c9a-a25f-c73bc7b86b56 tempest-VolumesTransfersV355Test-418502237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb2d4cb8-a108-44a6-8355-b931bc2f89b9" returned: 0 in 0.405s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:58 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ce75d0c5-ce54-4c9a-a25f-c73bc7b86b56 tempest-VolumesTransfersV355Test-418502237 None] Lock "cinder-quobyte-fb2d4cb8-a108-44a6-8355-b931bc2f89b9" released by "delete_volume" :: held 0.962s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:58 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-ce75d0c5-ce54-4c9a-a25f-c73bc7b86b56 tempest-VolumesTransfersV355Test-418502237 None] Created reservations ['dc69e8f0-f6c0-4f0e-bc7f-6878d6e8c313', '5f19c65b-305f-4276-a4e2-3e7e60fb0ce7', '2080918c-1462-453c-8eb2-49b2969beee8', 'b1bd672c-5da2-48cf-bc3a-ec7a4a774fe9'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ce75d0c5-ce54-4c9a-a25f-c73bc7b86b56 tempest-VolumesTransfersV355Test-418502237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ce75d0c5-ce54-4c9a-a25f-c73bc7b86b56 tempest-VolumesTransfersV355Test-418502237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:59 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ce75d0c5-ce54-4c9a-a25f-c73bc7b86b56 tempest-VolumesTransfersV355Test-418502237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:59 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ce75d0c5-ce54-4c9a-a25f-c73bc7b86b56 tempest-VolumesTransfersV355Test-418502237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ce75d0c5-ce54-4c9a-a25f-c73bc7b86b56 tempest-VolumesTransfersV355Test-418502237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ce75d0c5-ce54-4c9a-a25f-c73bc7b86b56 tempest-VolumesTransfersV355Test-418502237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:59 devstack sudo[93318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:13:59 devstack sudo[93318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:59 devstack sudo[93318]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ce75d0c5-ce54-4c9a-a25f-c73bc7b86b56 tempest-VolumesTransfersV355Test-418502237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.324s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:59 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-ce75d0c5-ce54-4c9a-a25f-c73bc7b86b56 tempest-VolumesTransfersV355Test-418502237 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:59 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-ce75d0c5-ce54-4c9a-a25f-c73bc7b86b56 tempest-VolumesTransfersV355Test-418502237 None] Deleted volume successfully. Sep 28 17:13:59 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ce75d0c5-ce54-4c9a-a25f-c73bc7b86b56 tempest-VolumesTransfersV355Test-418502237 None] Lock "cinder-fb2d4cb8-a108-44a6-8355-b931bc2f89b9-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:59 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-dec7e092-4d75-4c46-b67f-875a1e09c9f6 tempest-VolumeTypesAccessTest-1334319181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dec7e092-4d75-4c46-b67f-875a1e09c9f6 tempest-VolumeTypesAccessTest-1334319181 None] Flow 'volume_create_manager' (2a39c277-0b15-416e-af15-5ab3638c1dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dec7e092-4d75-4c46-b67f-875a1e09c9f6 tempest-VolumeTypesAccessTest-1334319181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8bbf774-a3bc-42e7-8b9b-d73a1e66a077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dec7e092-4d75-4c46-b67f-875a1e09c9f6 tempest-VolumeTypesAccessTest-1334319181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8bbf774-a3bc-42e7-8b9b-d73a1e66a077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1311901418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eebdf6c6-9afa-4b62-b0cb-6f58d24c28fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5bebce9179f4c5db1ccc9f3a0cd4dbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:00Z,use_quota=True,user_id='5990c477500e4ddcb53f8887caa42758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a72fe9-b2e6-4756-98ba-a8b478d1561f),volume_type_id=90a72fe9-b2e6-4756-98ba-a8b478d1561f)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dec7e092-4d75-4c46-b67f-875a1e09c9f6 tempest-VolumeTypesAccessTest-1334319181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d72546f-3d1c-4520-a4ff-a04a8cba7fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dec7e092-4d75-4c46-b67f-875a1e09c9f6 tempest-VolumeTypesAccessTest-1334319181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d72546f-3d1c-4520-a4ff-a04a8cba7fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dec7e092-4d75-4c46-b67f-875a1e09c9f6 tempest-VolumeTypesAccessTest-1334319181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad79e3cc-565f-4c3b-98a8-2de6ce17c3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dec7e092-4d75-4c46-b67f-875a1e09c9f6 tempest-VolumeTypesAccessTest-1334319181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad79e3cc-565f-4c3b-98a8-2de6ce17c3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eebdf6c6-9afa-4b62-b0cb-6f58d24c28fc', 'volume_name': 'volume-eebdf6c6-9afa-4b62-b0cb-6f58d24c28fc', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dec7e092-4d75-4c46-b67f-875a1e09c9f6 tempest-VolumeTypesAccessTest-1334319181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6092a86-37c4-47cd-abd2-58d1ccafc86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dec7e092-4d75-4c46-b67f-875a1e09c9f6 tempest-VolumeTypesAccessTest-1334319181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6092a86-37c4-47cd-abd2-58d1ccafc86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dec7e092-4d75-4c46-b67f-875a1e09c9f6 tempest-VolumeTypesAccessTest-1334319181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db2748f-89ec-4406-964a-5d3c76c6f952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:59 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-dec7e092-4d75-4c46-b67f-875a1e09c9f6 tempest-VolumeTypesAccessTest-1334319181 None] Volume eebdf6c6-9afa-4b62-b0cb-6f58d24c28fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eebdf6c6-9afa-4b62-b0cb-6f58d24c28fc', 'volume_size': 1} Sep 28 17:13:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-dec7e092-4d75-4c46-b67f-875a1e09c9f6 tempest-VolumeTypesAccessTest-1334319181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-dec7e092-4d75-4c46-b67f-875a1e09c9f6 tempest-VolumeTypesAccessTest-1334319181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:59 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-dec7e092-4d75-4c46-b67f-875a1e09c9f6 tempest-VolumeTypesAccessTest-1334319181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1311901418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eebdf6c6-9afa-4b62-b0cb-6f58d24c28fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5bebce9179f4c5db1ccc9f3a0cd4dbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:00Z,use_quota=True,user_id='5990c477500e4ddcb53f8887caa42758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a72fe9-b2e6-4756-98ba-a8b478d1561f),volume_type_id=90a72fe9-b2e6-4756-98ba-a8b478d1561f)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:59 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-dec7e092-4d75-4c46-b67f-875a1e09c9f6 tempest-VolumeTypesAccessTest-1334319181 None] Creating volume eebdf6c6-9afa-4b62-b0cb-6f58d24c28fc {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-dec7e092-4d75-4c46-b67f-875a1e09c9f6 tempest-VolumeTypesAccessTest-1334319181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-dec7e092-4d75-4c46-b67f-875a1e09c9f6 tempest-VolumeTypesAccessTest-1334319181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:59 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-dec7e092-4d75-4c46-b67f-875a1e09c9f6 tempest-VolumeTypesAccessTest-1334319181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:59 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-dec7e092-4d75-4c46-b67f-875a1e09c9f6 tempest-VolumeTypesAccessTest-1334319181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-dec7e092-4d75-4c46-b67f-875a1e09c9f6 tempest-VolumeTypesAccessTest-1334319181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:59 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-dec7e092-4d75-4c46-b67f-875a1e09c9f6 tempest-VolumeTypesAccessTest-1334319181 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:59 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-dec7e092-4d75-4c46-b67f-875a1e09c9f6 tempest-VolumeTypesAccessTest-1334319181 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:13:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-dec7e092-4d75-4c46-b67f-875a1e09c9f6 tempest-VolumeTypesAccessTest-1334319181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eebdf6c6-9afa-4b62-b0cb-6f58d24c28fc 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:59 devstack sudo[93321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eebdf6c6-9afa-4b62-b0cb-6f58d24c28fc 1073741824 Sep 28 17:13:59 devstack sudo[93321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:00 devstack sudo[93321]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-dec7e092-4d75-4c46-b67f-875a1e09c9f6 tempest-VolumeTypesAccessTest-1334319181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eebdf6c6-9afa-4b62-b0cb-6f58d24c28fc 1073741824" returned: 0 in 0.719s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-dec7e092-4d75-4c46-b67f-875a1e09c9f6 tempest-VolumeTypesAccessTest-1334319181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eebdf6c6-9afa-4b62-b0cb-6f58d24c28fc {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:00 devstack sudo[93328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eebdf6c6-9afa-4b62-b0cb-6f58d24c28fc Sep 28 17:14:00 devstack sudo[93328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:00 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-403597ef-9fca-4f3b-9687-8f32d53694da tempest-VolumesTransfersV355Test-165765734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-403597ef-9fca-4f3b-9687-8f32d53694da tempest-VolumesTransfersV355Test-165765734 None] Flow 'volume_create_manager' (b03369e8-0e64-4287-bf73-2cbaf1cd38ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-403597ef-9fca-4f3b-9687-8f32d53694da tempest-VolumesTransfersV355Test-165765734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a173bab-90de-4636-83f3-13a54052a046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-403597ef-9fca-4f3b-9687-8f32d53694da tempest-VolumesTransfersV355Test-165765734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a173bab-90de-4636-83f3-13a54052a046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1147861041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e25f9ae-25b1-4ebe-ab4d-825f1420d622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14149e1cd12f4cd688ac6d71585e92ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:01Z,use_quota=True,user_id='58d625a183444cceb8b9eba14b37030d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-403597ef-9fca-4f3b-9687-8f32d53694da tempest-VolumesTransfersV355Test-165765734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff39a6f0-7a5c-4cec-ad69-3c580b7a8f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-403597ef-9fca-4f3b-9687-8f32d53694da tempest-VolumesTransfersV355Test-165765734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff39a6f0-7a5c-4cec-ad69-3c580b7a8f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-403597ef-9fca-4f3b-9687-8f32d53694da tempest-VolumesTransfersV355Test-165765734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d2e892-166d-48e2-bf3f-8b30c4eb7a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-403597ef-9fca-4f3b-9687-8f32d53694da tempest-VolumesTransfersV355Test-165765734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d2e892-166d-48e2-bf3f-8b30c4eb7a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e25f9ae-25b1-4ebe-ab4d-825f1420d622', 'volume_name': 'volume-5e25f9ae-25b1-4ebe-ab4d-825f1420d622', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-403597ef-9fca-4f3b-9687-8f32d53694da tempest-VolumesTransfersV355Test-165765734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2df7834a-a006-4905-bdb9-5be1bf534095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-403597ef-9fca-4f3b-9687-8f32d53694da tempest-VolumesTransfersV355Test-165765734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2df7834a-a006-4905-bdb9-5be1bf534095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:01 devstack sudo[93328]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-403597ef-9fca-4f3b-9687-8f32d53694da tempest-VolumesTransfersV355Test-165765734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ec3185-ba17-4d9c-9c75-03ce56248c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:01 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-403597ef-9fca-4f3b-9687-8f32d53694da tempest-VolumesTransfersV355Test-165765734 None] Volume 5e25f9ae-25b1-4ebe-ab4d-825f1420d622: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e25f9ae-25b1-4ebe-ab4d-825f1420d622', 'volume_size': 1} Sep 28 17:14:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-403597ef-9fca-4f3b-9687-8f32d53694da tempest-VolumesTransfersV355Test-165765734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-dec7e092-4d75-4c46-b67f-875a1e09c9f6 tempest-VolumeTypesAccessTest-1334319181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eebdf6c6-9afa-4b62-b0cb-6f58d24c28fc" returned: 0 in 0.366s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:01 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-dec7e092-4d75-4c46-b67f-875a1e09c9f6 tempest-VolumeTypesAccessTest-1334319181 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-dec7e092-4d75-4c46-b67f-875a1e09c9f6 tempest-VolumeTypesAccessTest-1334319181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-403597ef-9fca-4f3b-9687-8f32d53694da tempest-VolumesTransfersV355Test-165765734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:01 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-403597ef-9fca-4f3b-9687-8f32d53694da tempest-VolumesTransfersV355Test-165765734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1147861041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e25f9ae-25b1-4ebe-ab4d-825f1420d622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14149e1cd12f4cd688ac6d71585e92ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:01Z,use_quota=True,user_id='58d625a183444cceb8b9eba14b37030d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:01 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-403597ef-9fca-4f3b-9687-8f32d53694da tempest-VolumesTransfersV355Test-165765734 None] Creating volume 5e25f9ae-25b1-4ebe-ab4d-825f1420d622 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-403597ef-9fca-4f3b-9687-8f32d53694da tempest-VolumesTransfersV355Test-165765734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-403597ef-9fca-4f3b-9687-8f32d53694da tempest-VolumesTransfersV355Test-165765734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:01 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-403597ef-9fca-4f3b-9687-8f32d53694da tempest-VolumesTransfersV355Test-165765734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:01 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-403597ef-9fca-4f3b-9687-8f32d53694da tempest-VolumesTransfersV355Test-165765734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-403597ef-9fca-4f3b-9687-8f32d53694da tempest-VolumesTransfersV355Test-165765734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:01 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-403597ef-9fca-4f3b-9687-8f32d53694da tempest-VolumesTransfersV355Test-165765734 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:01 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-403597ef-9fca-4f3b-9687-8f32d53694da tempest-VolumesTransfersV355Test-165765734 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:14:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-403597ef-9fca-4f3b-9687-8f32d53694da tempest-VolumesTransfersV355Test-165765734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5e25f9ae-25b1-4ebe-ab4d-825f1420d622 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dec7e092-4d75-4c46-b67f-875a1e09c9f6 tempest-VolumeTypesAccessTest-1334319181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db2748f-89ec-4406-964a-5d3c76c6f952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eebdf6c6-9afa-4b62-b0cb-6f58d24c28fc', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:01 devstack sudo[93331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5e25f9ae-25b1-4ebe-ab4d-825f1420d622 1073741824 Sep 28 17:14:01 devstack sudo[93331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dec7e092-4d75-4c46-b67f-875a1e09c9f6 tempest-VolumeTypesAccessTest-1334319181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eded46a-f928-4c00-82e1-da8aa6d4efde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:01 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-dec7e092-4d75-4c46-b67f-875a1e09c9f6 tempest-VolumeTypesAccessTest-1334319181 None] Volume volume-eebdf6c6-9afa-4b62-b0cb-6f58d24c28fc (eebdf6c6-9afa-4b62-b0cb-6f58d24c28fc): created successfully Sep 28 17:14:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dec7e092-4d75-4c46-b67f-875a1e09c9f6 tempest-VolumeTypesAccessTest-1334319181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eded46a-f928-4c00-82e1-da8aa6d4efde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dec7e092-4d75-4c46-b67f-875a1e09c9f6 tempest-VolumeTypesAccessTest-1334319181 None] Flow 'volume_create_manager' (2a39c277-0b15-416e-af15-5ab3638c1dea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:01 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-dec7e092-4d75-4c46-b67f-875a1e09c9f6 tempest-VolumeTypesAccessTest-1334319181 None] Created volume successfully. Sep 28 17:14:01 devstack sudo[93331]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-403597ef-9fca-4f3b-9687-8f32d53694da tempest-VolumesTransfersV355Test-165765734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5e25f9ae-25b1-4ebe-ab4d-825f1420d622 1073741824" returned: 0 in 0.592s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-403597ef-9fca-4f3b-9687-8f32d53694da tempest-VolumesTransfersV355Test-165765734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5e25f9ae-25b1-4ebe-ab4d-825f1420d622 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:01 devstack sudo[93337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5e25f9ae-25b1-4ebe-ab4d-825f1420d622 Sep 28 17:14:01 devstack sudo[93337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:02 devstack sudo[93337]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:02 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f8d91bef-c8d3-4f5f-b176-9137ef713144 tempest-VolumeTypesAccessTest-1334319181 None] Acquiring lock "cinder-eebdf6c6-9afa-4b62-b0cb-6f58d24c28fc-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-403597ef-9fca-4f3b-9687-8f32d53694da tempest-VolumesTransfersV355Test-165765734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5e25f9ae-25b1-4ebe-ab4d-825f1420d622" returned: 0 in 0.355s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:02 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-403597ef-9fca-4f3b-9687-8f32d53694da tempest-VolumesTransfersV355Test-165765734 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-403597ef-9fca-4f3b-9687-8f32d53694da tempest-VolumesTransfersV355Test-165765734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:02 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f8d91bef-c8d3-4f5f-b176-9137ef713144 tempest-VolumeTypesAccessTest-1334319181 None] Lock "cinder-eebdf6c6-9afa-4b62-b0cb-6f58d24c28fc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:02 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-403597ef-9fca-4f3b-9687-8f32d53694da tempest-VolumesTransfersV355Test-165765734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ec3185-ba17-4d9c-9c75-03ce56248c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e25f9ae-25b1-4ebe-ab4d-825f1420d622', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:02 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-403597ef-9fca-4f3b-9687-8f32d53694da tempest-VolumesTransfersV355Test-165765734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c61d6bfd-9a77-4548-9eb9-dd3377e270e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:02 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-403597ef-9fca-4f3b-9687-8f32d53694da tempest-VolumesTransfersV355Test-165765734 None] Volume volume-5e25f9ae-25b1-4ebe-ab4d-825f1420d622 (5e25f9ae-25b1-4ebe-ab4d-825f1420d622): created successfully Sep 28 17:14:02 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-403597ef-9fca-4f3b-9687-8f32d53694da tempest-VolumesTransfersV355Test-165765734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c61d6bfd-9a77-4548-9eb9-dd3377e270e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:02 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-403597ef-9fca-4f3b-9687-8f32d53694da tempest-VolumesTransfersV355Test-165765734 None] Flow 'volume_create_manager' (b03369e8-0e64-4287-bf73-2cbaf1cd38ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:02 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-403597ef-9fca-4f3b-9687-8f32d53694da tempest-VolumesTransfersV355Test-165765734 None] Created volume successfully. Sep 28 17:14:02 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f8d91bef-c8d3-4f5f-b176-9137ef713144 tempest-VolumeTypesAccessTest-1334319181 None] Acquiring lock "cinder-quobyte-eebdf6c6-9afa-4b62-b0cb-6f58d24c28fc" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:02 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f8d91bef-c8d3-4f5f-b176-9137ef713144 tempest-VolumeTypesAccessTest-1334319181 None] Lock "cinder-quobyte-eebdf6c6-9afa-4b62-b0cb-6f58d24c28fc" acquired by "delete_volume" :: waited 0.028s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:02 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba844184-5a58-424d-bbf7-f20f66f3a0e7]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f8d91bef-c8d3-4f5f-b176-9137ef713144 tempest-VolumeTypesAccessTest-1334319181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eebdf6c6-9afa-4b62-b0cb-6f58d24c28fc {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:02 devstack sudo[93340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eebdf6c6-9afa-4b62-b0cb-6f58d24c28fc Sep 28 17:14:02 devstack sudo[93340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:02 devstack sudo[93340]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f8d91bef-c8d3-4f5f-b176-9137ef713144 tempest-VolumeTypesAccessTest-1334319181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eebdf6c6-9afa-4b62-b0cb-6f58d24c28fc" returned: 0 in 0.495s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f8d91bef-c8d3-4f5f-b176-9137ef713144 tempest-VolumeTypesAccessTest-1334319181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eebdf6c6-9afa-4b62-b0cb-6f58d24c28fc {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:02 devstack sudo[93346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eebdf6c6-9afa-4b62-b0cb-6f58d24c28fc Sep 28 17:14:02 devstack sudo[93346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:03 devstack sudo[93346]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f8d91bef-c8d3-4f5f-b176-9137ef713144 tempest-VolumeTypesAccessTest-1334319181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eebdf6c6-9afa-4b62-b0cb-6f58d24c28fc" returned: 0 in 0.489s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:03 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f8d91bef-c8d3-4f5f-b176-9137ef713144 tempest-VolumeTypesAccessTest-1334319181 None] Lock "cinder-quobyte-eebdf6c6-9afa-4b62-b0cb-6f58d24c28fc" released by "delete_volume" :: held 1.057s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:03 devstack cinder-volume[86917]: WARNING cinder.quota [None req-f8d91bef-c8d3-4f5f-b176-9137ef713144 tempest-VolumeTypesAccessTest-1334319181 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-677702237 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-677702237, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:14:03 devstack cinder-volume[86917]: WARNING cinder.quota [None req-f8d91bef-c8d3-4f5f-b176-9137ef713144 tempest-VolumeTypesAccessTest-1334319181 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-677702237 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-677702237, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:14:03 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-f8d91bef-c8d3-4f5f-b176-9137ef713144 tempest-VolumeTypesAccessTest-1334319181 None] Created reservations ['165a03bb-40e5-495d-a17c-dcb7f71b6989', 'd9770a8c-6de2-4088-aa72-532a46b0c478', '41bf4856-e0f1-44ed-8c40-a8e68ffa22df', '28b9bd4d-faca-41a1-a6eb-2e6228c88f80'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f8d91bef-c8d3-4f5f-b176-9137ef713144 tempest-VolumeTypesAccessTest-1334319181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f8d91bef-c8d3-4f5f-b176-9137ef713144 tempest-VolumeTypesAccessTest-1334319181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:03 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f8d91bef-c8d3-4f5f-b176-9137ef713144 tempest-VolumeTypesAccessTest-1334319181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:03 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f8d91bef-c8d3-4f5f-b176-9137ef713144 tempest-VolumeTypesAccessTest-1334319181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f8d91bef-c8d3-4f5f-b176-9137ef713144 tempest-VolumeTypesAccessTest-1334319181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f8d91bef-c8d3-4f5f-b176-9137ef713144 tempest-VolumeTypesAccessTest-1334319181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:03 devstack sudo[93349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:14:03 devstack sudo[93349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:03 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-eb54e07c-ae3f-4130-b68b-504d44f425d4 tempest-VolumesTransfersV355Test-418502237 None] Acquiring lock "cinder-5e25f9ae-25b1-4ebe-ab4d-825f1420d622-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:03 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-eb54e07c-ae3f-4130-b68b-504d44f425d4 tempest-VolumesTransfersV355Test-418502237 None] Lock "cinder-5e25f9ae-25b1-4ebe-ab4d-825f1420d622-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:03 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-eb54e07c-ae3f-4130-b68b-504d44f425d4 tempest-VolumesTransfersV355Test-418502237 None] Acquiring lock "cinder-quobyte-5e25f9ae-25b1-4ebe-ab4d-825f1420d622" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:04 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-eb54e07c-ae3f-4130-b68b-504d44f425d4 tempest-VolumesTransfersV355Test-418502237 None] Lock "cinder-quobyte-5e25f9ae-25b1-4ebe-ab4d-825f1420d622" acquired by "delete_volume" :: waited 0.027s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:04 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[004203d5-3903-4159-9b0b-813c31bb1f78]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-eb54e07c-ae3f-4130-b68b-504d44f425d4 tempest-VolumesTransfersV355Test-418502237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5e25f9ae-25b1-4ebe-ab4d-825f1420d622 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:04 devstack sudo[93349]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f8d91bef-c8d3-4f5f-b176-9137ef713144 tempest-VolumeTypesAccessTest-1334319181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.524s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:04 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-f8d91bef-c8d3-4f5f-b176-9137ef713144 tempest-VolumeTypesAccessTest-1334319181 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:04 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-f8d91bef-c8d3-4f5f-b176-9137ef713144 tempest-VolumeTypesAccessTest-1334319181 None] Deleted volume successfully. Sep 28 17:14:04 devstack sudo[93351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5e25f9ae-25b1-4ebe-ab4d-825f1420d622 Sep 28 17:14:04 devstack sudo[93351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:04 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f8d91bef-c8d3-4f5f-b176-9137ef713144 tempest-VolumeTypesAccessTest-1334319181 None] Lock "cinder-eebdf6c6-9afa-4b62-b0cb-6f58d24c28fc-delete_volume" released by "delete_volume" :: held 2.095s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:04 devstack sudo[93351]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-eb54e07c-ae3f-4130-b68b-504d44f425d4 tempest-VolumesTransfersV355Test-418502237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5e25f9ae-25b1-4ebe-ab4d-825f1420d622" returned: 0 in 0.668s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-eb54e07c-ae3f-4130-b68b-504d44f425d4 tempest-VolumesTransfersV355Test-418502237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5e25f9ae-25b1-4ebe-ab4d-825f1420d622 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:04 devstack sudo[93357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5e25f9ae-25b1-4ebe-ab4d-825f1420d622 Sep 28 17:14:04 devstack sudo[93357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:05 devstack sudo[93357]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-eb54e07c-ae3f-4130-b68b-504d44f425d4 tempest-VolumesTransfersV355Test-418502237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5e25f9ae-25b1-4ebe-ab4d-825f1420d622" returned: 0 in 0.472s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:05 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-eb54e07c-ae3f-4130-b68b-504d44f425d4 tempest-VolumesTransfersV355Test-418502237 None] Lock "cinder-quobyte-5e25f9ae-25b1-4ebe-ab4d-825f1420d622" released by "delete_volume" :: held 1.237s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:05 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-eb54e07c-ae3f-4130-b68b-504d44f425d4 tempest-VolumesTransfersV355Test-418502237 None] Created reservations ['91f28615-1829-4e9a-9fd2-de248c17e3b5', '471d8b6a-7281-41f6-b8df-bbec7183efba', '7e3f5b2e-c65c-4c1f-b541-eaee49bea92c', '73c8d4c8-24ef-4741-bdac-7fa531a5e416'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-eb54e07c-ae3f-4130-b68b-504d44f425d4 tempest-VolumesTransfersV355Test-418502237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-eb54e07c-ae3f-4130-b68b-504d44f425d4 tempest-VolumesTransfersV355Test-418502237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-eb54e07c-ae3f-4130-b68b-504d44f425d4 tempest-VolumesTransfersV355Test-418502237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-eb54e07c-ae3f-4130-b68b-504d44f425d4 tempest-VolumesTransfersV355Test-418502237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-eb54e07c-ae3f-4130-b68b-504d44f425d4 tempest-VolumesTransfersV355Test-418502237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-eb54e07c-ae3f-4130-b68b-504d44f425d4 tempest-VolumesTransfersV355Test-418502237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:05 devstack sudo[93360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:14:05 devstack sudo[93360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:05 devstack sudo[93360]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-eb54e07c-ae3f-4130-b68b-504d44f425d4 tempest-VolumesTransfersV355Test-418502237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.352s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:05 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-eb54e07c-ae3f-4130-b68b-504d44f425d4 tempest-VolumesTransfersV355Test-418502237 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:05 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-eb54e07c-ae3f-4130-b68b-504d44f425d4 tempest-VolumesTransfersV355Test-418502237 None] Deleted volume successfully. Sep 28 17:14:05 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-eb54e07c-ae3f-4130-b68b-504d44f425d4 tempest-VolumesTransfersV355Test-418502237 None] Lock "cinder-5e25f9ae-25b1-4ebe-ab4d-825f1420d622-delete_volume" released by "delete_volume" :: held 2.003s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:07 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-d31307ad-9d94-4668-ae29-c3f2fd35f3a4 tempest-AttachVolumeTestJSON-1638983725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d31307ad-9d94-4668-ae29-c3f2fd35f3a4 tempest-AttachVolumeTestJSON-1638983725 None] Flow 'volume_create_manager' (cbe23953-a8d2-43b2-a163-d63e76618969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d31307ad-9d94-4668-ae29-c3f2fd35f3a4 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (906d29ed-335c-4ac8-9616-98f56cca2742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d31307ad-9d94-4668-ae29-c3f2fd35f3a4 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (906d29ed-335c-4ac8-9616-98f56cca2742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1829189788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3cb530-5362-49ee-a7dd-30369961399f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c850ba8a5859455b92b280cb91ab5945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:08Z,use_quota=True,user_id='519c735893a8461bb5ca0169f6a5168c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d31307ad-9d94-4668-ae29-c3f2fd35f3a4 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ff230c6-10a1-4233-b703-4c3471510a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d31307ad-9d94-4668-ae29-c3f2fd35f3a4 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ff230c6-10a1-4233-b703-4c3471510a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d31307ad-9d94-4668-ae29-c3f2fd35f3a4 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6989ec29-59fe-40c1-a1b3-07946cee0ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d31307ad-9d94-4668-ae29-c3f2fd35f3a4 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6989ec29-59fe-40c1-a1b3-07946cee0ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b3cb530-5362-49ee-a7dd-30369961399f', 'volume_name': 'volume-6b3cb530-5362-49ee-a7dd-30369961399f', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d31307ad-9d94-4668-ae29-c3f2fd35f3a4 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e46bb4-8dd8-4ec2-adef-03449cf694af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d31307ad-9d94-4668-ae29-c3f2fd35f3a4 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e46bb4-8dd8-4ec2-adef-03449cf694af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d31307ad-9d94-4668-ae29-c3f2fd35f3a4 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6300f12a-19ee-4228-aea5-68a041cba27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:07 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-d31307ad-9d94-4668-ae29-c3f2fd35f3a4 tempest-AttachVolumeTestJSON-1638983725 None] Volume 6b3cb530-5362-49ee-a7dd-30369961399f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b3cb530-5362-49ee-a7dd-30369961399f', 'volume_size': 1} Sep 28 17:14:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d31307ad-9d94-4668-ae29-c3f2fd35f3a4 tempest-AttachVolumeTestJSON-1638983725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d31307ad-9d94-4668-ae29-c3f2fd35f3a4 tempest-AttachVolumeTestJSON-1638983725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:07 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d31307ad-9d94-4668-ae29-c3f2fd35f3a4 tempest-AttachVolumeTestJSON-1638983725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1829189788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3cb530-5362-49ee-a7dd-30369961399f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c850ba8a5859455b92b280cb91ab5945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:08Z,use_quota=True,user_id='519c735893a8461bb5ca0169f6a5168c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:07 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-d31307ad-9d94-4668-ae29-c3f2fd35f3a4 tempest-AttachVolumeTestJSON-1638983725 None] Creating volume 6b3cb530-5362-49ee-a7dd-30369961399f {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d31307ad-9d94-4668-ae29-c3f2fd35f3a4 tempest-AttachVolumeTestJSON-1638983725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d31307ad-9d94-4668-ae29-c3f2fd35f3a4 tempest-AttachVolumeTestJSON-1638983725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:07 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d31307ad-9d94-4668-ae29-c3f2fd35f3a4 tempest-AttachVolumeTestJSON-1638983725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:07 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d31307ad-9d94-4668-ae29-c3f2fd35f3a4 tempest-AttachVolumeTestJSON-1638983725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d31307ad-9d94-4668-ae29-c3f2fd35f3a4 tempest-AttachVolumeTestJSON-1638983725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:07 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d31307ad-9d94-4668-ae29-c3f2fd35f3a4 tempest-AttachVolumeTestJSON-1638983725 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:07 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-d31307ad-9d94-4668-ae29-c3f2fd35f3a4 tempest-AttachVolumeTestJSON-1638983725 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:14:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d31307ad-9d94-4668-ae29-c3f2fd35f3a4 tempest-AttachVolumeTestJSON-1638983725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6b3cb530-5362-49ee-a7dd-30369961399f 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:07 devstack sudo[93379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6b3cb530-5362-49ee-a7dd-30369961399f 1073741824 Sep 28 17:14:07 devstack sudo[93379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:08 devstack sudo[93379]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d31307ad-9d94-4668-ae29-c3f2fd35f3a4 tempest-AttachVolumeTestJSON-1638983725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6b3cb530-5362-49ee-a7dd-30369961399f 1073741824" returned: 0 in 0.849s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d31307ad-9d94-4668-ae29-c3f2fd35f3a4 tempest-AttachVolumeTestJSON-1638983725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6b3cb530-5362-49ee-a7dd-30369961399f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:08 devstack sudo[93385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6b3cb530-5362-49ee-a7dd-30369961399f Sep 28 17:14:08 devstack sudo[93385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:09 devstack sudo[93385]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d31307ad-9d94-4668-ae29-c3f2fd35f3a4 tempest-AttachVolumeTestJSON-1638983725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6b3cb530-5362-49ee-a7dd-30369961399f" returned: 0 in 0.577s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d31307ad-9d94-4668-ae29-c3f2fd35f3a4 tempest-AttachVolumeTestJSON-1638983725 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d31307ad-9d94-4668-ae29-c3f2fd35f3a4 tempest-AttachVolumeTestJSON-1638983725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d31307ad-9d94-4668-ae29-c3f2fd35f3a4 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6300f12a-19ee-4228-aea5-68a041cba27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b3cb530-5362-49ee-a7dd-30369961399f', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d31307ad-9d94-4668-ae29-c3f2fd35f3a4 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc4f59b-3c66-4cf4-bd46-55db2ae735ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:09 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-d31307ad-9d94-4668-ae29-c3f2fd35f3a4 tempest-AttachVolumeTestJSON-1638983725 None] Volume volume-6b3cb530-5362-49ee-a7dd-30369961399f (6b3cb530-5362-49ee-a7dd-30369961399f): created successfully Sep 28 17:14:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d31307ad-9d94-4668-ae29-c3f2fd35f3a4 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc4f59b-3c66-4cf4-bd46-55db2ae735ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d31307ad-9d94-4668-ae29-c3f2fd35f3a4 tempest-AttachVolumeTestJSON-1638983725 None] Flow 'volume_create_manager' (cbe23953-a8d2-43b2-a163-d63e76618969) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:09 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-d31307ad-9d94-4668-ae29-c3f2fd35f3a4 tempest-AttachVolumeTestJSON-1638983725 None] Created volume successfully. Sep 28 17:14:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-69570fe1-0993-4d32-976a-7f1a8b928732 req-7c6ea752-78da-41b1-ad5d-8e13e4df63a8 tempest-AttachVolumeTestJSON-1638983725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-69570fe1-0993-4d32-976a-7f1a8b928732 req-7c6ea752-78da-41b1-ad5d-8e13e4df63a8 tempest-AttachVolumeTestJSON-1638983725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-69570fe1-0993-4d32-976a-7f1a8b928732 req-7c6ea752-78da-41b1-ad5d-8e13e4df63a8 tempest-AttachVolumeTestJSON-1638983725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-69570fe1-0993-4d32-976a-7f1a8b928732 req-7c6ea752-78da-41b1-ad5d-8e13e4df63a8 tempest-AttachVolumeTestJSON-1638983725 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069', 'name': 'volume-6b3cb530-5362-49ee-a7dd-30369961399f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd0c03cfa-f692-4275-8b7d-66d3304fae02', 'enforce_multipath': True} {{(pid=86917) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:14:11 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-69570fe1-0993-4d32-976a-7f1a8b928732 req-7c6ea752-78da-41b1-ad5d-8e13e4df63a8 tempest-AttachVolumeTestJSON-1638983725 None] attachment_update completed successfully. Sep 28 17:14:13 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f68d204-5e81-4991-8262-62caf29cc437 tempest-SnapshotMetadataTestJSON-2146540363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:13 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6f68d204-5e81-4991-8262-62caf29cc437 tempest-SnapshotMetadataTestJSON-2146540363 None] Flow 'volume_create_manager' (2aeab3cc-f3c1-4e23-8ba6-1e5fc397d014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:13 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6f68d204-5e81-4991-8262-62caf29cc437 tempest-SnapshotMetadataTestJSON-2146540363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6a858d1-6d34-4715-adea-64a64b09cc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:13 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6f68d204-5e81-4991-8262-62caf29cc437 tempest-SnapshotMetadataTestJSON-2146540363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6a858d1-6d34-4715-adea-64a64b09cc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-683600632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1733bacf-6bf9-498d-9182-23f42fe5c272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55b79996c8e4ee9bfc204c0395dc220',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:13Z,use_quota=True,user_id='8395c337b6b84bd4b8ef213eb109ff70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:13 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6f68d204-5e81-4991-8262-62caf29cc437 tempest-SnapshotMetadataTestJSON-2146540363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab7b125e-57e6-49ab-9342-1d0b15ff49ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:13 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6f68d204-5e81-4991-8262-62caf29cc437 tempest-SnapshotMetadataTestJSON-2146540363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab7b125e-57e6-49ab-9342-1d0b15ff49ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:13 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6f68d204-5e81-4991-8262-62caf29cc437 tempest-SnapshotMetadataTestJSON-2146540363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef87a23-fac8-4af3-a49c-43f9c5e17e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:13 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6f68d204-5e81-4991-8262-62caf29cc437 tempest-SnapshotMetadataTestJSON-2146540363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef87a23-fac8-4af3-a49c-43f9c5e17e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1733bacf-6bf9-498d-9182-23f42fe5c272', 'volume_name': 'volume-1733bacf-6bf9-498d-9182-23f42fe5c272', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:13 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6f68d204-5e81-4991-8262-62caf29cc437 tempest-SnapshotMetadataTestJSON-2146540363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aeac03d-a18b-43ef-bda2-e27843091869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:13 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6f68d204-5e81-4991-8262-62caf29cc437 tempest-SnapshotMetadataTestJSON-2146540363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aeac03d-a18b-43ef-bda2-e27843091869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:13 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6f68d204-5e81-4991-8262-62caf29cc437 tempest-SnapshotMetadataTestJSON-2146540363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb78a239-6466-4367-abd7-4adfd9632d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:13 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-6f68d204-5e81-4991-8262-62caf29cc437 tempest-SnapshotMetadataTestJSON-2146540363 None] Volume 1733bacf-6bf9-498d-9182-23f42fe5c272: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1733bacf-6bf9-498d-9182-23f42fe5c272', 'volume_size': 1} Sep 28 17:14:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6f68d204-5e81-4991-8262-62caf29cc437 tempest-SnapshotMetadataTestJSON-2146540363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6f68d204-5e81-4991-8262-62caf29cc437 tempest-SnapshotMetadataTestJSON-2146540363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:13 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6f68d204-5e81-4991-8262-62caf29cc437 tempest-SnapshotMetadataTestJSON-2146540363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-683600632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1733bacf-6bf9-498d-9182-23f42fe5c272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55b79996c8e4ee9bfc204c0395dc220',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:13Z,use_quota=True,user_id='8395c337b6b84bd4b8ef213eb109ff70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:13 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-6f68d204-5e81-4991-8262-62caf29cc437 tempest-SnapshotMetadataTestJSON-2146540363 None] Creating volume 1733bacf-6bf9-498d-9182-23f42fe5c272 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6f68d204-5e81-4991-8262-62caf29cc437 tempest-SnapshotMetadataTestJSON-2146540363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6f68d204-5e81-4991-8262-62caf29cc437 tempest-SnapshotMetadataTestJSON-2146540363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:13 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6f68d204-5e81-4991-8262-62caf29cc437 tempest-SnapshotMetadataTestJSON-2146540363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:13 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6f68d204-5e81-4991-8262-62caf29cc437 tempest-SnapshotMetadataTestJSON-2146540363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6f68d204-5e81-4991-8262-62caf29cc437 tempest-SnapshotMetadataTestJSON-2146540363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:13 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6f68d204-5e81-4991-8262-62caf29cc437 tempest-SnapshotMetadataTestJSON-2146540363 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:13 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-6f68d204-5e81-4991-8262-62caf29cc437 tempest-SnapshotMetadataTestJSON-2146540363 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:14:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6f68d204-5e81-4991-8262-62caf29cc437 tempest-SnapshotMetadataTestJSON-2146540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:13 devstack sudo[93856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272 1073741824 Sep 28 17:14:13 devstack sudo[93856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:14 devstack sudo[93856]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6f68d204-5e81-4991-8262-62caf29cc437 tempest-SnapshotMetadataTestJSON-2146540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272 1073741824" returned: 0 in 0.920s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6f68d204-5e81-4991-8262-62caf29cc437 tempest-SnapshotMetadataTestJSON-2146540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:14 devstack sudo[93864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272 Sep 28 17:14:14 devstack sudo[93864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:15 devstack sudo[93864]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6f68d204-5e81-4991-8262-62caf29cc437 tempest-SnapshotMetadataTestJSON-2146540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272" returned: 0 in 0.572s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:15 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6f68d204-5e81-4991-8262-62caf29cc437 tempest-SnapshotMetadataTestJSON-2146540363 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6f68d204-5e81-4991-8262-62caf29cc437 tempest-SnapshotMetadataTestJSON-2146540363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6f68d204-5e81-4991-8262-62caf29cc437 tempest-SnapshotMetadataTestJSON-2146540363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb78a239-6466-4367-abd7-4adfd9632d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1733bacf-6bf9-498d-9182-23f42fe5c272', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6f68d204-5e81-4991-8262-62caf29cc437 tempest-SnapshotMetadataTestJSON-2146540363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c0d437b-a9ae-494a-b334-f6a9388d1c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:15 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-6f68d204-5e81-4991-8262-62caf29cc437 tempest-SnapshotMetadataTestJSON-2146540363 None] Volume volume-1733bacf-6bf9-498d-9182-23f42fe5c272 (1733bacf-6bf9-498d-9182-23f42fe5c272): created successfully Sep 28 17:14:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6f68d204-5e81-4991-8262-62caf29cc437 tempest-SnapshotMetadataTestJSON-2146540363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c0d437b-a9ae-494a-b334-f6a9388d1c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6f68d204-5e81-4991-8262-62caf29cc437 tempest-SnapshotMetadataTestJSON-2146540363 None] Flow 'volume_create_manager' (2aeab3cc-f3c1-4e23-8ba6-1e5fc397d014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:15 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-6f68d204-5e81-4991-8262-62caf29cc437 tempest-SnapshotMetadataTestJSON-2146540363 None] Created volume successfully. Sep 28 17:14:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1e01c232-4316-4784-b11e-3ed183995aa2 tempest-SnapshotMetadataTestJSON-2146540363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1e01c232-4316-4784-b11e-3ed183995aa2 tempest-SnapshotMetadataTestJSON-2146540363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:15 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-1e01c232-4316-4784-b11e-3ed183995aa2 tempest-SnapshotMetadataTestJSON-2146540363 None] Creating offline snapshot 99fde542-ebe7-4e56-840d-4e2bbf365211 of volume 1733bacf-6bf9-498d-9182-23f42fe5c272 {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:14:15 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[403eddc7-ac32-4107-989d-85468f529102]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1e01c232-4316-4784-b11e-3ed183995aa2 tempest-SnapshotMetadataTestJSON-2146540363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:16 devstack sudo[93877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272 Sep 28 17:14:16 devstack sudo[93877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:16 devstack sudo[93877]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1e01c232-4316-4784-b11e-3ed183995aa2 tempest-SnapshotMetadataTestJSON-2146540363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272" returned: 0 in 0.631s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1e01c232-4316-4784-b11e-3ed183995aa2 tempest-SnapshotMetadataTestJSON-2146540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272.99fde542-ebe7-4e56-840d-4e2bbf365211 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:16 devstack sudo[93882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272.99fde542-ebe7-4e56-840d-4e2bbf365211 1G Sep 28 17:14:16 devstack sudo[93882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:17 devstack sudo[93882]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1e01c232-4316-4784-b11e-3ed183995aa2 tempest-SnapshotMetadataTestJSON-2146540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272.99fde542-ebe7-4e56-840d-4e2bbf365211 1G" returned: 0 in 0.816s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1e01c232-4316-4784-b11e-3ed183995aa2 tempest-SnapshotMetadataTestJSON-2146540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1733bacf-6bf9-498d-9182-23f42fe5c272 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272.99fde542-ebe7-4e56-840d-4e2bbf365211 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:17 devstack sudo[93895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1733bacf-6bf9-498d-9182-23f42fe5c272 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272.99fde542-ebe7-4e56-840d-4e2bbf365211 Sep 28 17:14:17 devstack sudo[93895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:18 devstack sudo[93895]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1e01c232-4316-4784-b11e-3ed183995aa2 tempest-SnapshotMetadataTestJSON-2146540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1733bacf-6bf9-498d-9182-23f42fe5c272 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272.99fde542-ebe7-4e56-840d-4e2bbf365211" returned: 0 in 0.711s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:18 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-1e01c232-4316-4784-b11e-3ed183995aa2 tempest-SnapshotMetadataTestJSON-2146540363 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272.99fde542-ebe7-4e56-840d-4e2bbf365211 is being set with open permissions: ugo+rw Sep 28 17:14:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1e01c232-4316-4784-b11e-3ed183995aa2 tempest-SnapshotMetadataTestJSON-2146540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272.99fde542-ebe7-4e56-840d-4e2bbf365211 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:18 devstack sudo[93900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272.99fde542-ebe7-4e56-840d-4e2bbf365211 Sep 28 17:14:18 devstack sudo[93900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:18 devstack sudo[93900]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1e01c232-4316-4784-b11e-3ed183995aa2 tempest-SnapshotMetadataTestJSON-2146540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272.99fde542-ebe7-4e56-840d-4e2bbf365211" returned: 0 in 0.476s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1e01c232-4316-4784-b11e-3ed183995aa2 tempest-SnapshotMetadataTestJSON-2146540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:18 devstack sudo[93904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272.info Sep 28 17:14:18 devstack sudo[93904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:19 devstack sudo[93904]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1e01c232-4316-4784-b11e-3ed183995aa2 tempest-SnapshotMetadataTestJSON-2146540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272.info" returned: 0 in 0.775s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:19 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-1e01c232-4316-4784-b11e-3ed183995aa2 tempest-SnapshotMetadataTestJSON-2146540363 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272.info is being set with open permissions: ugo+rw Sep 28 17:14:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1e01c232-4316-4784-b11e-3ed183995aa2 tempest-SnapshotMetadataTestJSON-2146540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:19 devstack sudo[93972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272.info Sep 28 17:14:19 devstack sudo[93972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:20 devstack sudo[93972]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1e01c232-4316-4784-b11e-3ed183995aa2 tempest-SnapshotMetadataTestJSON-2146540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272.info" returned: 0 in 0.799s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1e01c232-4316-4784-b11e-3ed183995aa2 tempest-SnapshotMetadataTestJSON-2146540363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.480s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:20 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:UPDATE=76,cinder:SELECT=60,cinder:DELETE=7,cinder:INSERT=17 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:14:20 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=55,cinder:UPDATE=75,cinder:INSERT=16,cinder:DELETE=7 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:14:20 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-1e01c232-4316-4784-b11e-3ed183995aa2 tempest-SnapshotMetadataTestJSON-2146540363 None] Create snapshot completed successfully Sep 28 17:14:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6f7e572c-b4a9-4618-9fda-ebdcb49582d0 tempest-SnapshotMetadataTestJSON-2146540363 None] Acquiring lock "cinder-99fde542-ebe7-4e56-840d-4e2bbf365211-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6f7e572c-b4a9-4618-9fda-ebdcb49582d0 tempest-SnapshotMetadataTestJSON-2146540363 None] Lock "cinder-99fde542-ebe7-4e56-840d-4e2bbf365211-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6f7e572c-b4a9-4618-9fda-ebdcb49582d0 tempest-SnapshotMetadataTestJSON-2146540363 None] Acquiring lock "cinder-quobyte-1733bacf-6bf9-498d-9182-23f42fe5c272" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6f7e572c-b4a9-4618-9fda-ebdcb49582d0 tempest-SnapshotMetadataTestJSON-2146540363 None] Lock "cinder-quobyte-1733bacf-6bf9-498d-9182-23f42fe5c272" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6f7e572c-b4a9-4618-9fda-ebdcb49582d0 tempest-SnapshotMetadataTestJSON-2146540363 None] Acquiring lock "cinder-quobyte-99fde542-ebe7-4e56-840d-4e2bbf365211" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6f7e572c-b4a9-4618-9fda-ebdcb49582d0 tempest-SnapshotMetadataTestJSON-2146540363 None] Lock "cinder-quobyte-99fde542-ebe7-4e56-840d-4e2bbf365211" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-6f7e572c-b4a9-4618-9fda-ebdcb49582d0 tempest-SnapshotMetadataTestJSON-2146540363 None] Deleting offline snapshot 99fde542-ebe7-4e56-840d-4e2bbf365211 of volume 1733bacf-6bf9-498d-9182-23f42fe5c272 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:14:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-6f7e572c-b4a9-4618-9fda-ebdcb49582d0 tempest-SnapshotMetadataTestJSON-2146540363 None] snapshot_file for this snap is: volume-1733bacf-6bf9-498d-9182-23f42fe5c272.99fde542-ebe7-4e56-840d-4e2bbf365211 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:14:24 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[41989526-4272-4472-ab50-fafa7f8fe679]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6f7e572c-b4a9-4618-9fda-ebdcb49582d0 tempest-SnapshotMetadataTestJSON-2146540363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272.99fde542-ebe7-4e56-840d-4e2bbf365211 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:24 devstack sudo[94460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272.99fde542-ebe7-4e56-840d-4e2bbf365211 Sep 28 17:14:24 devstack sudo[94460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:25 devstack sudo[94460]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6f7e572c-b4a9-4618-9fda-ebdcb49582d0 tempest-SnapshotMetadataTestJSON-2146540363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272.99fde542-ebe7-4e56-840d-4e2bbf365211" returned: 0 in 0.801s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:25 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-6f7e572c-b4a9-4618-9fda-ebdcb49582d0 tempest-SnapshotMetadataTestJSON-2146540363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1733bacf-6bf9-498d-9182-23f42fe5c272(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:14:25 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9648dfb-8b53-4031-b3b6-d70edde70922]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6f7e572c-b4a9-4618-9fda-ebdcb49582d0 tempest-SnapshotMetadataTestJSON-2146540363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:25 devstack sudo[94465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272 Sep 28 17:14:25 devstack sudo[94465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:25 devstack sudo[94465]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6f7e572c-b4a9-4618-9fda-ebdcb49582d0 tempest-SnapshotMetadataTestJSON-2146540363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272" returned: 0 in 0.809s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6f7e572c-b4a9-4618-9fda-ebdcb49582d0 tempest-SnapshotMetadataTestJSON-2146540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272.99fde542-ebe7-4e56-840d-4e2bbf365211 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:25 devstack sudo[94472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272.99fde542-ebe7-4e56-840d-4e2bbf365211 Sep 28 17:14:25 devstack sudo[94472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:26 devstack sudo[94472]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6f7e572c-b4a9-4618-9fda-ebdcb49582d0 tempest-SnapshotMetadataTestJSON-2146540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272.99fde542-ebe7-4e56-840d-4e2bbf365211" returned: 0 in 0.708s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6f7e572c-b4a9-4618-9fda-ebdcb49582d0 tempest-SnapshotMetadataTestJSON-2146540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272.99fde542-ebe7-4e56-840d-4e2bbf365211 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:26 devstack sudo[94477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272.99fde542-ebe7-4e56-840d-4e2bbf365211 Sep 28 17:14:26 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:27 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6f7e572c-b4a9-4618-9fda-ebdcb49582d0 tempest-SnapshotMetadataTestJSON-2146540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272.99fde542-ebe7-4e56-840d-4e2bbf365211" returned: 0 in 0.507s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6f7e572c-b4a9-4618-9fda-ebdcb49582d0 tempest-SnapshotMetadataTestJSON-2146540363 None] Lock "cinder-quobyte-99fde542-ebe7-4e56-840d-4e2bbf365211" released by "_delete_snapshot" :: held 3.063s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6f7e572c-b4a9-4618-9fda-ebdcb49582d0 tempest-SnapshotMetadataTestJSON-2146540363 None] Lock "cinder-quobyte-1733bacf-6bf9-498d-9182-23f42fe5c272" released by "delete_snapshot" :: held 3.101s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:27 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-6f7e572c-b4a9-4618-9fda-ebdcb49582d0 tempest-SnapshotMetadataTestJSON-2146540363 None] Created reservations ['c8c0ff76-1bca-4160-a191-d89892aad2f6', 'b4d600ab-f6f5-4de3-8ccb-494776f78a34', '170f7b32-3128-480f-92f0-b0a2a3a496b7', '8c82e747-2228-4f2e-b3d4-c7e1e22069fa'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:27 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-6f7e572c-b4a9-4618-9fda-ebdcb49582d0 tempest-SnapshotMetadataTestJSON-2146540363 None] Delete snapshot completed successfully. Sep 28 17:14:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6f7e572c-b4a9-4618-9fda-ebdcb49582d0 tempest-SnapshotMetadataTestJSON-2146540363 None] Lock "cinder-99fde542-ebe7-4e56-840d-4e2bbf365211-delete_snapshot" released by "delete_snapshot" :: held 3.347s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:28 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ae133497-1fa6-4a77-bab2-6c8010a689a9 tempest-SnapshotMetadataTestJSON-2146540363 None] Acquiring lock "cinder-1733bacf-6bf9-498d-9182-23f42fe5c272-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:28 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ae133497-1fa6-4a77-bab2-6c8010a689a9 tempest-SnapshotMetadataTestJSON-2146540363 None] Lock "cinder-1733bacf-6bf9-498d-9182-23f42fe5c272-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ae133497-1fa6-4a77-bab2-6c8010a689a9 tempest-SnapshotMetadataTestJSON-2146540363 None] Acquiring lock "cinder-quobyte-1733bacf-6bf9-498d-9182-23f42fe5c272" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ae133497-1fa6-4a77-bab2-6c8010a689a9 tempest-SnapshotMetadataTestJSON-2146540363 None] Lock "cinder-quobyte-1733bacf-6bf9-498d-9182-23f42fe5c272" acquired by "delete_volume" :: waited 0.060s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:29 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21f6e98-5c71-4d0d-a0a5-a07c15d7e5ca]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ae133497-1fa6-4a77-bab2-6c8010a689a9 tempest-SnapshotMetadataTestJSON-2146540363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:29 devstack sudo[94480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272 Sep 28 17:14:29 devstack sudo[94480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:29 devstack sudo[94480]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ae133497-1fa6-4a77-bab2-6c8010a689a9 tempest-SnapshotMetadataTestJSON-2146540363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272" returned: 0 in 0.722s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ae133497-1fa6-4a77-bab2-6c8010a689a9 tempest-SnapshotMetadataTestJSON-2146540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:30 devstack sudo[94485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272 Sep 28 17:14:30 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:30 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ae133497-1fa6-4a77-bab2-6c8010a689a9 tempest-SnapshotMetadataTestJSON-2146540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1733bacf-6bf9-498d-9182-23f42fe5c272" returned: 0 in 0.646s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ae133497-1fa6-4a77-bab2-6c8010a689a9 tempest-SnapshotMetadataTestJSON-2146540363 None] Lock "cinder-quobyte-1733bacf-6bf9-498d-9182-23f42fe5c272" released by "delete_volume" :: held 1.513s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:30 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-ae133497-1fa6-4a77-bab2-6c8010a689a9 tempest-SnapshotMetadataTestJSON-2146540363 None] Created reservations ['67e038a2-6388-4e55-97b6-b18d334197b8', '0fd0d79f-d854-4b20-9af4-952c9ec0c556', '8d3de6f1-7650-46d2-83af-7dae57319f1e', 'bbe062ac-7105-43ad-b3e6-2aaf8d969502'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ae133497-1fa6-4a77-bab2-6c8010a689a9 tempest-SnapshotMetadataTestJSON-2146540363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ae133497-1fa6-4a77-bab2-6c8010a689a9 tempest-SnapshotMetadataTestJSON-2146540363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:30 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ae133497-1fa6-4a77-bab2-6c8010a689a9 tempest-SnapshotMetadataTestJSON-2146540363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:30 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ae133497-1fa6-4a77-bab2-6c8010a689a9 tempest-SnapshotMetadataTestJSON-2146540363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ae133497-1fa6-4a77-bab2-6c8010a689a9 tempest-SnapshotMetadataTestJSON-2146540363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ae133497-1fa6-4a77-bab2-6c8010a689a9 tempest-SnapshotMetadataTestJSON-2146540363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:31 devstack sudo[94489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:14:31 devstack sudo[94489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:31 devstack sudo[94489]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ae133497-1fa6-4a77-bab2-6c8010a689a9 tempest-SnapshotMetadataTestJSON-2146540363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.776s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:31 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-ae133497-1fa6-4a77-bab2-6c8010a689a9 tempest-SnapshotMetadataTestJSON-2146540363 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:31 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-ae133497-1fa6-4a77-bab2-6c8010a689a9 tempest-SnapshotMetadataTestJSON-2146540363 None] Deleted volume successfully. Sep 28 17:14:31 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ae133497-1fa6-4a77-bab2-6c8010a689a9 tempest-SnapshotMetadataTestJSON-2146540363 None] Lock "cinder-1733bacf-6bf9-498d-9182-23f42fe5c272-delete_volume" released by "delete_volume" :: held 2.915s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:40 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=9,cinder:INSERT=4,cinder:UPDATE=13 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:14:41 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e953803-646e-4463-8454-04aa772ef2d0 tempest-VolumesActionsTest-1828093912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:41 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e953803-646e-4463-8454-04aa772ef2d0 tempest-VolumesActionsTest-1828093912 None] Flow 'volume_create_manager' (8866f880-8b60-4072-878e-98d6787d6101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:41 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e953803-646e-4463-8454-04aa772ef2d0 tempest-VolumesActionsTest-1828093912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b8ea540-af2b-4354-9a43-fc9010f689e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:41 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e953803-646e-4463-8454-04aa772ef2d0 tempest-VolumesActionsTest-1828093912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b8ea540-af2b-4354-9a43-fc9010f689e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1824133768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b992f70c-58b4-42f5-aca7-04b53f8fc980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b17e2e27c346a2863b3ccba487d7ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:42Z,use_quota=True,user_id='d2307aa5b0104031a0d1f1806292722d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:41 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e953803-646e-4463-8454-04aa772ef2d0 tempest-VolumesActionsTest-1828093912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa283d9b-c822-49bf-bff3-bb0c47c8f599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:41 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e953803-646e-4463-8454-04aa772ef2d0 tempest-VolumesActionsTest-1828093912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa283d9b-c822-49bf-bff3-bb0c47c8f599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:41 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e953803-646e-4463-8454-04aa772ef2d0 tempest-VolumesActionsTest-1828093912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a526348a-7352-40ee-8fac-6da827af8b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:41 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e953803-646e-4463-8454-04aa772ef2d0 tempest-VolumesActionsTest-1828093912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a526348a-7352-40ee-8fac-6da827af8b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b992f70c-58b4-42f5-aca7-04b53f8fc980', 'volume_name': 'volume-b992f70c-58b4-42f5-aca7-04b53f8fc980', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:41 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e953803-646e-4463-8454-04aa772ef2d0 tempest-VolumesActionsTest-1828093912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e1aadcd-580d-40bb-964f-7e27b43420c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:41 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e953803-646e-4463-8454-04aa772ef2d0 tempest-VolumesActionsTest-1828093912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e1aadcd-580d-40bb-964f-7e27b43420c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:41 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e953803-646e-4463-8454-04aa772ef2d0 tempest-VolumesActionsTest-1828093912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd3a087f-09f4-4ca8-b716-093007d3d42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:41 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-4e953803-646e-4463-8454-04aa772ef2d0 tempest-VolumesActionsTest-1828093912 None] Volume b992f70c-58b4-42f5-aca7-04b53f8fc980: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b992f70c-58b4-42f5-aca7-04b53f8fc980', 'volume_size': 1} Sep 28 17:14:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4e953803-646e-4463-8454-04aa772ef2d0 tempest-VolumesActionsTest-1828093912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4e953803-646e-4463-8454-04aa772ef2d0 tempest-VolumesActionsTest-1828093912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:41 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4e953803-646e-4463-8454-04aa772ef2d0 tempest-VolumesActionsTest-1828093912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1824133768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b992f70c-58b4-42f5-aca7-04b53f8fc980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b17e2e27c346a2863b3ccba487d7ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:42Z,use_quota=True,user_id='d2307aa5b0104031a0d1f1806292722d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:41 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-4e953803-646e-4463-8454-04aa772ef2d0 tempest-VolumesActionsTest-1828093912 None] Creating volume b992f70c-58b4-42f5-aca7-04b53f8fc980 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4e953803-646e-4463-8454-04aa772ef2d0 tempest-VolumesActionsTest-1828093912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4e953803-646e-4463-8454-04aa772ef2d0 tempest-VolumesActionsTest-1828093912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:41 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4e953803-646e-4463-8454-04aa772ef2d0 tempest-VolumesActionsTest-1828093912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:41 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4e953803-646e-4463-8454-04aa772ef2d0 tempest-VolumesActionsTest-1828093912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4e953803-646e-4463-8454-04aa772ef2d0 tempest-VolumesActionsTest-1828093912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:41 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4e953803-646e-4463-8454-04aa772ef2d0 tempest-VolumesActionsTest-1828093912 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:41 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-4e953803-646e-4463-8454-04aa772ef2d0 tempest-VolumesActionsTest-1828093912 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:14:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e953803-646e-4463-8454-04aa772ef2d0 tempest-VolumesActionsTest-1828093912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:41 devstack sudo[94528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980 1073741824 Sep 28 17:14:41 devstack sudo[94528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:42 devstack sudo[94528]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e953803-646e-4463-8454-04aa772ef2d0 tempest-VolumesActionsTest-1828093912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980 1073741824" returned: 0 in 0.609s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e953803-646e-4463-8454-04aa772ef2d0 tempest-VolumesActionsTest-1828093912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:42 devstack sudo[94534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980 Sep 28 17:14:42 devstack sudo[94534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:42 devstack sudo[94534]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e953803-646e-4463-8454-04aa772ef2d0 tempest-VolumesActionsTest-1828093912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980" returned: 0 in 0.395s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:43 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4e953803-646e-4463-8454-04aa772ef2d0 tempest-VolumesActionsTest-1828093912 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4e953803-646e-4463-8454-04aa772ef2d0 tempest-VolumesActionsTest-1828093912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e953803-646e-4463-8454-04aa772ef2d0 tempest-VolumesActionsTest-1828093912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd3a087f-09f4-4ca8-b716-093007d3d42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b992f70c-58b4-42f5-aca7-04b53f8fc980', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e953803-646e-4463-8454-04aa772ef2d0 tempest-VolumesActionsTest-1828093912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c3666a-9972-4ac5-8392-43a0c05353d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:43 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-4e953803-646e-4463-8454-04aa772ef2d0 tempest-VolumesActionsTest-1828093912 None] Volume volume-b992f70c-58b4-42f5-aca7-04b53f8fc980 (b992f70c-58b4-42f5-aca7-04b53f8fc980): created successfully Sep 28 17:14:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e953803-646e-4463-8454-04aa772ef2d0 tempest-VolumesActionsTest-1828093912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c3666a-9972-4ac5-8392-43a0c05353d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e953803-646e-4463-8454-04aa772ef2d0 tempest-VolumesActionsTest-1828093912 None] Flow 'volume_create_manager' (8866f880-8b60-4072-878e-98d6787d6101) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:43 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-4e953803-646e-4463-8454-04aa772ef2d0 tempest-VolumesActionsTest-1828093912 None] Created volume successfully. Sep 28 17:14:49 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d904cd2-f382-4c54-a2d3-edfebf3b5890 tempest-VolumesNegativeTest-1772986728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6d904cd2-f382-4c54-a2d3-edfebf3b5890 tempest-VolumesNegativeTest-1772986728 None] Flow 'volume_create_manager' (1e058a10-c064-4698-abf9-22c3a8b42569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6d904cd2-f382-4c54-a2d3-edfebf3b5890 tempest-VolumesNegativeTest-1772986728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (032c6cfb-477f-4ed9-8083-50f765340030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6d904cd2-f382-4c54-a2d3-edfebf3b5890 tempest-VolumesNegativeTest-1772986728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (032c6cfb-477f-4ed9-8083-50f765340030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1862149452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa8b7266-9554-4a6d-b25b-5aa486dbef45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef310c6c51174e8bb58a28b726274321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:49Z,use_quota=True,user_id='f9137327f6b045bebea42996c4f0d4a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6d904cd2-f382-4c54-a2d3-edfebf3b5890 tempest-VolumesNegativeTest-1772986728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52116327-f39e-4d47-94b8-3ce1f58df6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6d904cd2-f382-4c54-a2d3-edfebf3b5890 tempest-VolumesNegativeTest-1772986728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52116327-f39e-4d47-94b8-3ce1f58df6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6d904cd2-f382-4c54-a2d3-edfebf3b5890 tempest-VolumesNegativeTest-1772986728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b1d24b0-35c3-421c-ab40-b987f956414e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6d904cd2-f382-4c54-a2d3-edfebf3b5890 tempest-VolumesNegativeTest-1772986728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b1d24b0-35c3-421c-ab40-b987f956414e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa8b7266-9554-4a6d-b25b-5aa486dbef45', 'volume_name': 'volume-aa8b7266-9554-4a6d-b25b-5aa486dbef45', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6d904cd2-f382-4c54-a2d3-edfebf3b5890 tempest-VolumesNegativeTest-1772986728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3dcecff-d2d5-4c05-86db-2f19d8d207de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6d904cd2-f382-4c54-a2d3-edfebf3b5890 tempest-VolumesNegativeTest-1772986728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3dcecff-d2d5-4c05-86db-2f19d8d207de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6d904cd2-f382-4c54-a2d3-edfebf3b5890 tempest-VolumesNegativeTest-1772986728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66426cfc-279d-4f45-b45f-2a077a121b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:49 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-6d904cd2-f382-4c54-a2d3-edfebf3b5890 tempest-VolumesNegativeTest-1772986728 None] Volume aa8b7266-9554-4a6d-b25b-5aa486dbef45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa8b7266-9554-4a6d-b25b-5aa486dbef45', 'volume_size': 1} Sep 28 17:14:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6d904cd2-f382-4c54-a2d3-edfebf3b5890 tempest-VolumesNegativeTest-1772986728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6d904cd2-f382-4c54-a2d3-edfebf3b5890 tempest-VolumesNegativeTest-1772986728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6d904cd2-f382-4c54-a2d3-edfebf3b5890 tempest-VolumesNegativeTest-1772986728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1862149452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa8b7266-9554-4a6d-b25b-5aa486dbef45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef310c6c51174e8bb58a28b726274321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:49Z,use_quota=True,user_id='f9137327f6b045bebea42996c4f0d4a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-6d904cd2-f382-4c54-a2d3-edfebf3b5890 tempest-VolumesNegativeTest-1772986728 None] Creating volume aa8b7266-9554-4a6d-b25b-5aa486dbef45 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6d904cd2-f382-4c54-a2d3-edfebf3b5890 tempest-VolumesNegativeTest-1772986728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6d904cd2-f382-4c54-a2d3-edfebf3b5890 tempest-VolumesNegativeTest-1772986728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6d904cd2-f382-4c54-a2d3-edfebf3b5890 tempest-VolumesNegativeTest-1772986728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6d904cd2-f382-4c54-a2d3-edfebf3b5890 tempest-VolumesNegativeTest-1772986728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6d904cd2-f382-4c54-a2d3-edfebf3b5890 tempest-VolumesNegativeTest-1772986728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6d904cd2-f382-4c54-a2d3-edfebf3b5890 tempest-VolumesNegativeTest-1772986728 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:49 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-6d904cd2-f382-4c54-a2d3-edfebf3b5890 tempest-VolumesNegativeTest-1772986728 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:14:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6d904cd2-f382-4c54-a2d3-edfebf3b5890 tempest-VolumesNegativeTest-1772986728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aa8b7266-9554-4a6d-b25b-5aa486dbef45 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:14:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:49 devstack sudo[94550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aa8b7266-9554-4a6d-b25b-5aa486dbef45 1073741824 Sep 28 17:14:49 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:49 devstack sudo[94553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:14:49 devstack sudo[94553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:49 devstack sudo[94553]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.500s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:50 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:50 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager._thread_info {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:14:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread count: 28 {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:14:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread info: [<_MainThread(MainThread, started 132915553284224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:14:50 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6d904cd2-f382-4c54-a2d3-edfebf3b5890 tempest-VolumesNegativeTest-1772986728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aa8b7266-9554-4a6d-b25b-5aa486dbef45 1073741824" returned: 0 in 0.972s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6d904cd2-f382-4c54-a2d3-edfebf3b5890 tempest-VolumesNegativeTest-1772986728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aa8b7266-9554-4a6d-b25b-5aa486dbef45 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:50 devstack sudo[94570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aa8b7266-9554-4a6d-b25b-5aa486dbef45 Sep 28 17:14:50 devstack sudo[94570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:50 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-27bf24b6-bd00-438d-b288-2e0fe7857c03 tempest-VolumesListAdminTestJSON-1135256991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-27bf24b6-bd00-438d-b288-2e0fe7857c03 tempest-VolumesListAdminTestJSON-1135256991 None] Flow 'volume_create_manager' (c709d97c-1d8b-42be-9568-8c835302dd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-27bf24b6-bd00-438d-b288-2e0fe7857c03 tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (204f1378-0683-4990-a90d-75d5bea41052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-27bf24b6-bd00-438d-b288-2e0fe7857c03 tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (204f1378-0683-4990-a90d-75d5bea41052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1630145520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0011cde5-224e-446a-98f6-293d4c7b96a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a95e8afb21492b89db4045924f9cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:50Z,use_quota=True,user_id='7c9ccf5f3d8c4023844db3177694ddb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-27bf24b6-bd00-438d-b288-2e0fe7857c03 tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d20b24b-ebbd-4d10-9ec6-c703ab652e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-27bf24b6-bd00-438d-b288-2e0fe7857c03 tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d20b24b-ebbd-4d10-9ec6-c703ab652e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-27bf24b6-bd00-438d-b288-2e0fe7857c03 tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (056f2897-2018-40a7-860c-8adef7841f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-27bf24b6-bd00-438d-b288-2e0fe7857c03 tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (056f2897-2018-40a7-860c-8adef7841f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0011cde5-224e-446a-98f6-293d4c7b96a8', 'volume_name': 'volume-0011cde5-224e-446a-98f6-293d4c7b96a8', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-27bf24b6-bd00-438d-b288-2e0fe7857c03 tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e0fd65-b2b3-475a-8570-594da579c578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-27bf24b6-bd00-438d-b288-2e0fe7857c03 tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e0fd65-b2b3-475a-8570-594da579c578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-27bf24b6-bd00-438d-b288-2e0fe7857c03 tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc298fe-2c71-4f41-9a11-8aadfc754187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:50 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-27bf24b6-bd00-438d-b288-2e0fe7857c03 tempest-VolumesListAdminTestJSON-1135256991 None] Volume 0011cde5-224e-446a-98f6-293d4c7b96a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0011cde5-224e-446a-98f6-293d4c7b96a8', 'volume_size': 1} Sep 28 17:14:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-27bf24b6-bd00-438d-b288-2e0fe7857c03 tempest-VolumesListAdminTestJSON-1135256991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:50 devstack sudo[94570]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6d904cd2-f382-4c54-a2d3-edfebf3b5890 tempest-VolumesNegativeTest-1772986728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aa8b7266-9554-4a6d-b25b-5aa486dbef45" returned: 0 in 0.446s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:50 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6d904cd2-f382-4c54-a2d3-edfebf3b5890 tempest-VolumesNegativeTest-1772986728 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6d904cd2-f382-4c54-a2d3-edfebf3b5890 tempest-VolumesNegativeTest-1772986728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-27bf24b6-bd00-438d-b288-2e0fe7857c03 tempest-VolumesListAdminTestJSON-1135256991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.204s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:50 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-27bf24b6-bd00-438d-b288-2e0fe7857c03 tempest-VolumesListAdminTestJSON-1135256991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1630145520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0011cde5-224e-446a-98f6-293d4c7b96a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a95e8afb21492b89db4045924f9cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:50Z,use_quota=True,user_id='7c9ccf5f3d8c4023844db3177694ddb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:50 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-27bf24b6-bd00-438d-b288-2e0fe7857c03 tempest-VolumesListAdminTestJSON-1135256991 None] Creating volume 0011cde5-224e-446a-98f6-293d4c7b96a8 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-27bf24b6-bd00-438d-b288-2e0fe7857c03 tempest-VolumesListAdminTestJSON-1135256991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-27bf24b6-bd00-438d-b288-2e0fe7857c03 tempest-VolumesListAdminTestJSON-1135256991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:50 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-27bf24b6-bd00-438d-b288-2e0fe7857c03 tempest-VolumesListAdminTestJSON-1135256991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:50 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-27bf24b6-bd00-438d-b288-2e0fe7857c03 tempest-VolumesListAdminTestJSON-1135256991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-27bf24b6-bd00-438d-b288-2e0fe7857c03 tempest-VolumesListAdminTestJSON-1135256991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:50 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-27bf24b6-bd00-438d-b288-2e0fe7857c03 tempest-VolumesListAdminTestJSON-1135256991 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:50 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-27bf24b6-bd00-438d-b288-2e0fe7857c03 tempest-VolumesListAdminTestJSON-1135256991 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:14:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-27bf24b6-bd00-438d-b288-2e0fe7857c03 tempest-VolumesListAdminTestJSON-1135256991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0011cde5-224e-446a-98f6-293d4c7b96a8 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6d904cd2-f382-4c54-a2d3-edfebf3b5890 tempest-VolumesNegativeTest-1772986728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66426cfc-279d-4f45-b45f-2a077a121b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa8b7266-9554-4a6d-b25b-5aa486dbef45', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:51 devstack sudo[94575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0011cde5-224e-446a-98f6-293d4c7b96a8 1073741824 Sep 28 17:14:51 devstack sudo[94575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6d904cd2-f382-4c54-a2d3-edfebf3b5890 tempest-VolumesNegativeTest-1772986728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de83932-707d-4c45-ad9f-e63d1dfa3160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:51 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-6d904cd2-f382-4c54-a2d3-edfebf3b5890 tempest-VolumesNegativeTest-1772986728 None] Volume volume-aa8b7266-9554-4a6d-b25b-5aa486dbef45 (aa8b7266-9554-4a6d-b25b-5aa486dbef45): created successfully Sep 28 17:14:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6d904cd2-f382-4c54-a2d3-edfebf3b5890 tempest-VolumesNegativeTest-1772986728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de83932-707d-4c45-ad9f-e63d1dfa3160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6d904cd2-f382-4c54-a2d3-edfebf3b5890 tempest-VolumesNegativeTest-1772986728 None] Flow 'volume_create_manager' (1e058a10-c064-4698-abf9-22c3a8b42569) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:51 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-6d904cd2-f382-4c54-a2d3-edfebf3b5890 tempest-VolumesNegativeTest-1772986728 None] Created volume successfully. Sep 28 17:14:51 devstack sudo[94575]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-27bf24b6-bd00-438d-b288-2e0fe7857c03 tempest-VolumesListAdminTestJSON-1135256991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0011cde5-224e-446a-98f6-293d4c7b96a8 1073741824" returned: 0 in 0.864s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-27bf24b6-bd00-438d-b288-2e0fe7857c03 tempest-VolumesListAdminTestJSON-1135256991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0011cde5-224e-446a-98f6-293d4c7b96a8 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:51 devstack sudo[94587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0011cde5-224e-446a-98f6-293d4c7b96a8 Sep 28 17:14:51 devstack sudo[94587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:52 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-b91c272e-2210-4f54-9287-44caa2c00797 req-9aceb8ed-92e6-445d-9b5c-795e80f704b1 tempest-AttachVolumeTestJSON-1638983725 None] Terminate volume connection completed successfully. Sep 28 17:14:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-b91c272e-2210-4f54-9287-44caa2c00797 req-9aceb8ed-92e6-445d-9b5c-795e80f704b1 tempest-AttachVolumeTestJSON-1638983725 None] Deleting attachment d0c03cfa-f692-4275-8b7d-66d3304fae02. {{(pid=86917) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:14:52 devstack sudo[94587]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-27bf24b6-bd00-438d-b288-2e0fe7857c03 tempest-VolumesListAdminTestJSON-1135256991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0011cde5-224e-446a-98f6-293d4c7b96a8" returned: 0 in 0.585s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-27bf24b6-bd00-438d-b288-2e0fe7857c03 tempest-VolumesListAdminTestJSON-1135256991 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-27bf24b6-bd00-438d-b288-2e0fe7857c03 tempest-VolumesListAdminTestJSON-1135256991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-27bf24b6-bd00-438d-b288-2e0fe7857c03 tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc298fe-2c71-4f41-9a11-8aadfc754187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0011cde5-224e-446a-98f6-293d4c7b96a8', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-27bf24b6-bd00-438d-b288-2e0fe7857c03 tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c4cb4e-3522-47ee-ad7f-3cfed3b2c3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:52 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-27bf24b6-bd00-438d-b288-2e0fe7857c03 tempest-VolumesListAdminTestJSON-1135256991 None] Volume volume-0011cde5-224e-446a-98f6-293d4c7b96a8 (0011cde5-224e-446a-98f6-293d4c7b96a8): created successfully Sep 28 17:14:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-27bf24b6-bd00-438d-b288-2e0fe7857c03 tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c4cb4e-3522-47ee-ad7f-3cfed3b2c3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-27bf24b6-bd00-438d-b288-2e0fe7857c03 tempest-VolumesListAdminTestJSON-1135256991 None] Flow 'volume_create_manager' (c709d97c-1d8b-42be-9568-8c835302dd0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:52 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-27bf24b6-bd00-438d-b288-2e0fe7857c03 tempest-VolumesListAdminTestJSON-1135256991 None] Created volume successfully. Sep 28 17:14:55 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-f706c995-0f8b-42a0-88b5-ab16be676fee tempest-VolumesListAdminTestJSON-1135256991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f706c995-0f8b-42a0-88b5-ab16be676fee tempest-VolumesListAdminTestJSON-1135256991 None] Flow 'volume_create_manager' (8e72ca93-5436-4d2d-af04-c7c17dbc2d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f706c995-0f8b-42a0-88b5-ab16be676fee tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a883d7-43bc-49e1-8693-a3ee80ddc844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f706c995-0f8b-42a0-88b5-ab16be676fee tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a883d7-43bc-49e1-8693-a3ee80ddc844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-893895309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f8036ec-c076-40ad-ba7c-2784f616e45e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a95e8afb21492b89db4045924f9cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:55Z,use_quota=True,user_id='7c9ccf5f3d8c4023844db3177694ddb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f706c995-0f8b-42a0-88b5-ab16be676fee tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a674b9da-bae0-44cc-b98c-038ce00a6e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f706c995-0f8b-42a0-88b5-ab16be676fee tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a674b9da-bae0-44cc-b98c-038ce00a6e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f706c995-0f8b-42a0-88b5-ab16be676fee tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9654c1d2-a8e3-405f-8e42-0712f0c2e46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f706c995-0f8b-42a0-88b5-ab16be676fee tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9654c1d2-a8e3-405f-8e42-0712f0c2e46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f8036ec-c076-40ad-ba7c-2784f616e45e', 'volume_name': 'volume-6f8036ec-c076-40ad-ba7c-2784f616e45e', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f706c995-0f8b-42a0-88b5-ab16be676fee tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b565358-20d7-4c8f-827b-16c99161fe69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f706c995-0f8b-42a0-88b5-ab16be676fee tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b565358-20d7-4c8f-827b-16c99161fe69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f706c995-0f8b-42a0-88b5-ab16be676fee tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (360e0a94-4223-4d97-9f47-cc9622876a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:55 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-f706c995-0f8b-42a0-88b5-ab16be676fee tempest-VolumesListAdminTestJSON-1135256991 None] Volume 6f8036ec-c076-40ad-ba7c-2784f616e45e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f8036ec-c076-40ad-ba7c-2784f616e45e', 'volume_size': 1} Sep 28 17:14:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f706c995-0f8b-42a0-88b5-ab16be676fee tempest-VolumesListAdminTestJSON-1135256991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f706c995-0f8b-42a0-88b5-ab16be676fee tempest-VolumesListAdminTestJSON-1135256991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:55 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f706c995-0f8b-42a0-88b5-ab16be676fee tempest-VolumesListAdminTestJSON-1135256991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-893895309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f8036ec-c076-40ad-ba7c-2784f616e45e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a95e8afb21492b89db4045924f9cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:55Z,use_quota=True,user_id='7c9ccf5f3d8c4023844db3177694ddb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:55 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-f706c995-0f8b-42a0-88b5-ab16be676fee tempest-VolumesListAdminTestJSON-1135256991 None] Creating volume 6f8036ec-c076-40ad-ba7c-2784f616e45e {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f706c995-0f8b-42a0-88b5-ab16be676fee tempest-VolumesListAdminTestJSON-1135256991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f706c995-0f8b-42a0-88b5-ab16be676fee tempest-VolumesListAdminTestJSON-1135256991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:55 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f706c995-0f8b-42a0-88b5-ab16be676fee tempest-VolumesListAdminTestJSON-1135256991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:55 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f706c995-0f8b-42a0-88b5-ab16be676fee tempest-VolumesListAdminTestJSON-1135256991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f706c995-0f8b-42a0-88b5-ab16be676fee tempest-VolumesListAdminTestJSON-1135256991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:55 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f706c995-0f8b-42a0-88b5-ab16be676fee tempest-VolumesListAdminTestJSON-1135256991 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:55 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-f706c995-0f8b-42a0-88b5-ab16be676fee tempest-VolumesListAdminTestJSON-1135256991 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:14:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f706c995-0f8b-42a0-88b5-ab16be676fee tempest-VolumesListAdminTestJSON-1135256991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6f8036ec-c076-40ad-ba7c-2784f616e45e 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:55 devstack sudo[94665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6f8036ec-c076-40ad-ba7c-2784f616e45e 1073741824 Sep 28 17:14:55 devstack sudo[94665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:56 devstack sudo[94665]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f706c995-0f8b-42a0-88b5-ab16be676fee tempest-VolumesListAdminTestJSON-1135256991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6f8036ec-c076-40ad-ba7c-2784f616e45e 1073741824" returned: 0 in 0.897s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f706c995-0f8b-42a0-88b5-ab16be676fee tempest-VolumesListAdminTestJSON-1135256991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6f8036ec-c076-40ad-ba7c-2784f616e45e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:56 devstack sudo[94695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6f8036ec-c076-40ad-ba7c-2784f616e45e Sep 28 17:14:56 devstack sudo[94695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:56 devstack sudo[94695]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f706c995-0f8b-42a0-88b5-ab16be676fee tempest-VolumesListAdminTestJSON-1135256991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6f8036ec-c076-40ad-ba7c-2784f616e45e" returned: 0 in 0.335s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:56 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f706c995-0f8b-42a0-88b5-ab16be676fee tempest-VolumesListAdminTestJSON-1135256991 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f706c995-0f8b-42a0-88b5-ab16be676fee tempest-VolumesListAdminTestJSON-1135256991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:57 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f706c995-0f8b-42a0-88b5-ab16be676fee tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (360e0a94-4223-4d97-9f47-cc9622876a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f8036ec-c076-40ad-ba7c-2784f616e45e', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:57 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f706c995-0f8b-42a0-88b5-ab16be676fee tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (443c7d60-af05-4d78-acfc-265265a86b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:57 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-f706c995-0f8b-42a0-88b5-ab16be676fee tempest-VolumesListAdminTestJSON-1135256991 None] Volume volume-6f8036ec-c076-40ad-ba7c-2784f616e45e (6f8036ec-c076-40ad-ba7c-2784f616e45e): created successfully Sep 28 17:14:57 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f706c995-0f8b-42a0-88b5-ab16be676fee tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (443c7d60-af05-4d78-acfc-265265a86b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:57 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f706c995-0f8b-42a0-88b5-ab16be676fee tempest-VolumesListAdminTestJSON-1135256991 None] Flow 'volume_create_manager' (8e72ca93-5436-4d2d-af04-c7c17dbc2d90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:57 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-f706c995-0f8b-42a0-88b5-ab16be676fee tempest-VolumesListAdminTestJSON-1135256991 None] Created volume successfully. Sep 28 17:15:00 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-c24bbfff-6ba1-4fe1-bb04-9c450a4ef429 tempest-VolumesListAdminTestJSON-1135256991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:00 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c24bbfff-6ba1-4fe1-bb04-9c450a4ef429 tempest-VolumesListAdminTestJSON-1135256991 None] Flow 'volume_create_manager' (dddb0667-91da-4130-b2cb-80a5bc14b567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:00 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c24bbfff-6ba1-4fe1-bb04-9c450a4ef429 tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c22de003-1717-4c03-8d1f-87815448f8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:00 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c24bbfff-6ba1-4fe1-bb04-9c450a4ef429 tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c22de003-1717-4c03-8d1f-87815448f8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-646795537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beed8631-d3d1-4d83-a2ac-dcf31c3b8db4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a95e8afb21492b89db4045924f9cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:00Z,use_quota=True,user_id='7c9ccf5f3d8c4023844db3177694ddb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:00 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c24bbfff-6ba1-4fe1-bb04-9c450a4ef429 tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa1d0486-63fa-469f-b188-74bdd04e4b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:00 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c24bbfff-6ba1-4fe1-bb04-9c450a4ef429 tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa1d0486-63fa-469f-b188-74bdd04e4b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:00 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c24bbfff-6ba1-4fe1-bb04-9c450a4ef429 tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43feed27-c4a2-4423-8e8a-f8c2da0b54b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:00 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c24bbfff-6ba1-4fe1-bb04-9c450a4ef429 tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43feed27-c4a2-4423-8e8a-f8c2da0b54b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beed8631-d3d1-4d83-a2ac-dcf31c3b8db4', 'volume_name': 'volume-beed8631-d3d1-4d83-a2ac-dcf31c3b8db4', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:00 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c24bbfff-6ba1-4fe1-bb04-9c450a4ef429 tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4128ff4-6b4d-4966-98e6-473f0277a29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:00 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c24bbfff-6ba1-4fe1-bb04-9c450a4ef429 tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4128ff4-6b4d-4966-98e6-473f0277a29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:00 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c24bbfff-6ba1-4fe1-bb04-9c450a4ef429 tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (491b397a-5891-472d-924e-727324585388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:00 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-c24bbfff-6ba1-4fe1-bb04-9c450a4ef429 tempest-VolumesListAdminTestJSON-1135256991 None] Volume beed8631-d3d1-4d83-a2ac-dcf31c3b8db4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beed8631-d3d1-4d83-a2ac-dcf31c3b8db4', 'volume_size': 1} Sep 28 17:15:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c24bbfff-6ba1-4fe1-bb04-9c450a4ef429 tempest-VolumesListAdminTestJSON-1135256991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c24bbfff-6ba1-4fe1-bb04-9c450a4ef429 tempest-VolumesListAdminTestJSON-1135256991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:00 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c24bbfff-6ba1-4fe1-bb04-9c450a4ef429 tempest-VolumesListAdminTestJSON-1135256991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-646795537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beed8631-d3d1-4d83-a2ac-dcf31c3b8db4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a95e8afb21492b89db4045924f9cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:00Z,use_quota=True,user_id='7c9ccf5f3d8c4023844db3177694ddb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:00 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-c24bbfff-6ba1-4fe1-bb04-9c450a4ef429 tempest-VolumesListAdminTestJSON-1135256991 None] Creating volume beed8631-d3d1-4d83-a2ac-dcf31c3b8db4 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c24bbfff-6ba1-4fe1-bb04-9c450a4ef429 tempest-VolumesListAdminTestJSON-1135256991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c24bbfff-6ba1-4fe1-bb04-9c450a4ef429 tempest-VolumesListAdminTestJSON-1135256991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.022s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:00 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c24bbfff-6ba1-4fe1-bb04-9c450a4ef429 tempest-VolumesListAdminTestJSON-1135256991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:00 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c24bbfff-6ba1-4fe1-bb04-9c450a4ef429 tempest-VolumesListAdminTestJSON-1135256991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c24bbfff-6ba1-4fe1-bb04-9c450a4ef429 tempest-VolumesListAdminTestJSON-1135256991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.069s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:00 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c24bbfff-6ba1-4fe1-bb04-9c450a4ef429 tempest-VolumesListAdminTestJSON-1135256991 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:00 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-c24bbfff-6ba1-4fe1-bb04-9c450a4ef429 tempest-VolumesListAdminTestJSON-1135256991 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:15:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c24bbfff-6ba1-4fe1-bb04-9c450a4ef429 tempest-VolumesListAdminTestJSON-1135256991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-beed8631-d3d1-4d83-a2ac-dcf31c3b8db4 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:01 devstack sudo[94753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-beed8631-d3d1-4d83-a2ac-dcf31c3b8db4 1073741824 Sep 28 17:15:01 devstack sudo[94753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:02 devstack sudo[94753]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c24bbfff-6ba1-4fe1-bb04-9c450a4ef429 tempest-VolumesListAdminTestJSON-1135256991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-beed8631-d3d1-4d83-a2ac-dcf31c3b8db4 1073741824" returned: 0 in 1.568s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c24bbfff-6ba1-4fe1-bb04-9c450a4ef429 tempest-VolumesListAdminTestJSON-1135256991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-beed8631-d3d1-4d83-a2ac-dcf31c3b8db4 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:02 devstack sudo[94800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-beed8631-d3d1-4d83-a2ac-dcf31c3b8db4 Sep 28 17:15:02 devstack sudo[94800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:03 devstack sudo[94800]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c24bbfff-6ba1-4fe1-bb04-9c450a4ef429 tempest-VolumesListAdminTestJSON-1135256991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-beed8631-d3d1-4d83-a2ac-dcf31c3b8db4" returned: 0 in 0.644s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:03 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c24bbfff-6ba1-4fe1-bb04-9c450a4ef429 tempest-VolumesListAdminTestJSON-1135256991 None] <== create_volume: return (2450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c24bbfff-6ba1-4fe1-bb04-9c450a4ef429 tempest-VolumesListAdminTestJSON-1135256991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.477s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c24bbfff-6ba1-4fe1-bb04-9c450a4ef429 tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (491b397a-5891-472d-924e-727324585388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beed8631-d3d1-4d83-a2ac-dcf31c3b8db4', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c24bbfff-6ba1-4fe1-bb04-9c450a4ef429 tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00510051-7b5e-466e-86c0-2c85876fd590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:03 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-c24bbfff-6ba1-4fe1-bb04-9c450a4ef429 tempest-VolumesListAdminTestJSON-1135256991 None] Volume volume-beed8631-d3d1-4d83-a2ac-dcf31c3b8db4 (beed8631-d3d1-4d83-a2ac-dcf31c3b8db4): created successfully Sep 28 17:15:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c24bbfff-6ba1-4fe1-bb04-9c450a4ef429 tempest-VolumesListAdminTestJSON-1135256991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00510051-7b5e-466e-86c0-2c85876fd590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c24bbfff-6ba1-4fe1-bb04-9c450a4ef429 tempest-VolumesListAdminTestJSON-1135256991 None] Flow 'volume_create_manager' (dddb0667-91da-4130-b2cb-80a5bc14b567) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:03 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-c24bbfff-6ba1-4fe1-bb04-9c450a4ef429 tempest-VolumesListAdminTestJSON-1135256991 None] Created volume successfully. Sep 28 17:15:04 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0de3437d-5f2c-4b0e-92e4-b9d1f7a9cfe9 tempest-VolumesActionsTest-1828093912 None] Acquiring lock "cinder-b992f70c-58b4-42f5-aca7-04b53f8fc980" by "attach_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:04 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0de3437d-5f2c-4b0e-92e4-b9d1f7a9cfe9 tempest-VolumesActionsTest-1828093912 None] Lock "cinder-b992f70c-58b4-42f5-aca7-04b53f8fc980" acquired by "attach_volume" :: waited 0.058s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:04 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-0de3437d-5f2c-4b0e-92e4-b9d1f7a9cfe9 tempest-VolumesActionsTest-1828093912 None] Attaching volume b992f70c-58b4-42f5-aca7-04b53f8fc980 to instance a0900c24-8760-462c-8059-8ce6b308c4d2 at mountpoint /dev/vdb on host None. Sep 28 17:15:04 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-0de3437d-5f2c-4b0e-92e4-b9d1f7a9cfe9 tempest-VolumesActionsTest-1828093912 None] Attach volume completed successfully. Sep 28 17:15:04 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0de3437d-5f2c-4b0e-92e4-b9d1f7a9cfe9 tempest-VolumesActionsTest-1828093912 None] Lock "cinder-b992f70c-58b4-42f5-aca7-04b53f8fc980" released by "attach_volume" :: held 0.400s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:05 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-68932b7e-ea2f-4a09-9cc8-d0972b79ecde tempest-VolumesActionsTest-1828093912 None] Acquiring lock "cinder-b992f70c-58b4-42f5-aca7-04b53f8fc980-detach_volume" by "detach_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:05 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-68932b7e-ea2f-4a09-9cc8-d0972b79ecde tempest-VolumesActionsTest-1828093912 None] Lock "cinder-b992f70c-58b4-42f5-aca7-04b53f8fc980-detach_volume" acquired by "detach_volume" :: waited 0.062s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:05 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-68932b7e-ea2f-4a09-9cc8-d0972b79ecde tempest-VolumesActionsTest-1828093912 None] Detaching volume b992f70c-58b4-42f5-aca7-04b53f8fc980 from instance a0900c24-8760-462c-8059-8ce6b308c4d2. Sep 28 17:15:05 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-68932b7e-ea2f-4a09-9cc8-d0972b79ecde tempest-VolumesActionsTest-1828093912 None] Detach volume completed successfully. Sep 28 17:15:05 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-68932b7e-ea2f-4a09-9cc8-d0972b79ecde tempest-VolumesActionsTest-1828093912 None] Lock "cinder-b992f70c-58b4-42f5-aca7-04b53f8fc980-detach_volume" released by "detach_volume" :: held 0.234s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:07 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a6165a3-b324-4bbe-84b2-bc1cca5938de tempest-VolumesListAdminTestJSON-2126167497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0a6165a3-b324-4bbe-84b2-bc1cca5938de tempest-VolumesListAdminTestJSON-2126167497 None] Flow 'volume_create_manager' (7b999aa5-33b1-4de5-a8ee-ce2e8e325606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0a6165a3-b324-4bbe-84b2-bc1cca5938de tempest-VolumesListAdminTestJSON-2126167497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (172bdaeb-b7e8-412e-9b4b-9d8389e72918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0a6165a3-b324-4bbe-84b2-bc1cca5938de tempest-VolumesListAdminTestJSON-2126167497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (172bdaeb-b7e8-412e-9b4b-9d8389e72918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4923e765-5698-4b20-a5d8-07ccb87820fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fecb650e3954a66b46ae0805d7de7f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:07Z,use_quota=True,user_id='6fd4edcead024c3bb12569aef0146061',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0a6165a3-b324-4bbe-84b2-bc1cca5938de tempest-VolumesListAdminTestJSON-2126167497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb36b77-d530-447f-9c6b-befa47f22097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:08 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0a6165a3-b324-4bbe-84b2-bc1cca5938de tempest-VolumesListAdminTestJSON-2126167497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb36b77-d530-447f-9c6b-befa47f22097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:08 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0a6165a3-b324-4bbe-84b2-bc1cca5938de tempest-VolumesListAdminTestJSON-2126167497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef30bb11-9929-40a7-8a18-5d07f25f35a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:08 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0a6165a3-b324-4bbe-84b2-bc1cca5938de tempest-VolumesListAdminTestJSON-2126167497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef30bb11-9929-40a7-8a18-5d07f25f35a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4923e765-5698-4b20-a5d8-07ccb87820fb', 'volume_name': 'volume-4923e765-5698-4b20-a5d8-07ccb87820fb', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:08 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0a6165a3-b324-4bbe-84b2-bc1cca5938de tempest-VolumesListAdminTestJSON-2126167497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd0f14c8-0546-49bb-a950-e183738dfa34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:08 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0a6165a3-b324-4bbe-84b2-bc1cca5938de tempest-VolumesListAdminTestJSON-2126167497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd0f14c8-0546-49bb-a950-e183738dfa34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:08 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0a6165a3-b324-4bbe-84b2-bc1cca5938de tempest-VolumesListAdminTestJSON-2126167497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91ea4c8f-3f71-4187-bc05-9d607ad6880c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:08 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-0a6165a3-b324-4bbe-84b2-bc1cca5938de tempest-VolumesListAdminTestJSON-2126167497 None] Volume 4923e765-5698-4b20-a5d8-07ccb87820fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4923e765-5698-4b20-a5d8-07ccb87820fb', 'volume_size': 1} Sep 28 17:15:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0a6165a3-b324-4bbe-84b2-bc1cca5938de tempest-VolumesListAdminTestJSON-2126167497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0a6165a3-b324-4bbe-84b2-bc1cca5938de tempest-VolumesListAdminTestJSON-2126167497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:08 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0a6165a3-b324-4bbe-84b2-bc1cca5938de tempest-VolumesListAdminTestJSON-2126167497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4923e765-5698-4b20-a5d8-07ccb87820fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fecb650e3954a66b46ae0805d7de7f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:07Z,use_quota=True,user_id='6fd4edcead024c3bb12569aef0146061',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:08 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-0a6165a3-b324-4bbe-84b2-bc1cca5938de tempest-VolumesListAdminTestJSON-2126167497 None] Creating volume 4923e765-5698-4b20-a5d8-07ccb87820fb {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0a6165a3-b324-4bbe-84b2-bc1cca5938de tempest-VolumesListAdminTestJSON-2126167497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0a6165a3-b324-4bbe-84b2-bc1cca5938de tempest-VolumesListAdminTestJSON-2126167497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:08 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0a6165a3-b324-4bbe-84b2-bc1cca5938de tempest-VolumesListAdminTestJSON-2126167497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:08 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0a6165a3-b324-4bbe-84b2-bc1cca5938de tempest-VolumesListAdminTestJSON-2126167497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0a6165a3-b324-4bbe-84b2-bc1cca5938de tempest-VolumesListAdminTestJSON-2126167497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:08 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0a6165a3-b324-4bbe-84b2-bc1cca5938de tempest-VolumesListAdminTestJSON-2126167497 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:08 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-0a6165a3-b324-4bbe-84b2-bc1cca5938de tempest-VolumesListAdminTestJSON-2126167497 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:15:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0a6165a3-b324-4bbe-84b2-bc1cca5938de tempest-VolumesListAdminTestJSON-2126167497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4923e765-5698-4b20-a5d8-07ccb87820fb 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:08 devstack sudo[94871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4923e765-5698-4b20-a5d8-07ccb87820fb 1073741824 Sep 28 17:15:08 devstack sudo[94871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:09 devstack sudo[94871]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0a6165a3-b324-4bbe-84b2-bc1cca5938de tempest-VolumesListAdminTestJSON-2126167497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4923e765-5698-4b20-a5d8-07ccb87820fb 1073741824" returned: 0 in 1.735s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0a6165a3-b324-4bbe-84b2-bc1cca5938de tempest-VolumesListAdminTestJSON-2126167497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4923e765-5698-4b20-a5d8-07ccb87820fb {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:10 devstack sudo[94914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4923e765-5698-4b20-a5d8-07ccb87820fb Sep 28 17:15:10 devstack sudo[94914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:10 devstack sudo[94914]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0a6165a3-b324-4bbe-84b2-bc1cca5938de tempest-VolumesListAdminTestJSON-2126167497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4923e765-5698-4b20-a5d8-07ccb87820fb" returned: 0 in 0.548s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:10 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0a6165a3-b324-4bbe-84b2-bc1cca5938de tempest-VolumesListAdminTestJSON-2126167497 None] <== create_volume: return (2488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0a6165a3-b324-4bbe-84b2-bc1cca5938de tempest-VolumesListAdminTestJSON-2126167497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.498s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:10 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0a6165a3-b324-4bbe-84b2-bc1cca5938de tempest-VolumesListAdminTestJSON-2126167497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91ea4c8f-3f71-4187-bc05-9d607ad6880c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4923e765-5698-4b20-a5d8-07ccb87820fb', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:10 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0a6165a3-b324-4bbe-84b2-bc1cca5938de tempest-VolumesListAdminTestJSON-2126167497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f3c2d7c-a060-4450-9010-d731c380b595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:10 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-0a6165a3-b324-4bbe-84b2-bc1cca5938de tempest-VolumesListAdminTestJSON-2126167497 None] Volume volume-4923e765-5698-4b20-a5d8-07ccb87820fb (4923e765-5698-4b20-a5d8-07ccb87820fb): created successfully Sep 28 17:15:10 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0a6165a3-b324-4bbe-84b2-bc1cca5938de tempest-VolumesListAdminTestJSON-2126167497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f3c2d7c-a060-4450-9010-d731c380b595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:10 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0a6165a3-b324-4bbe-84b2-bc1cca5938de tempest-VolumesListAdminTestJSON-2126167497 None] Flow 'volume_create_manager' (7b999aa5-33b1-4de5-a8ee-ce2e8e325606) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:10 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-0a6165a3-b324-4bbe-84b2-bc1cca5938de tempest-VolumesListAdminTestJSON-2126167497 None] Created volume successfully. Sep 28 17:15:11 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1340fce7-be78-405a-8113-812481a82c47 tempest-VolumesListAdminTestJSON-2126167497 None] Acquiring lock "cinder-4923e765-5698-4b20-a5d8-07ccb87820fb-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:11 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1340fce7-be78-405a-8113-812481a82c47 tempest-VolumesListAdminTestJSON-2126167497 None] Lock "cinder-4923e765-5698-4b20-a5d8-07ccb87820fb-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:11 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1340fce7-be78-405a-8113-812481a82c47 tempest-VolumesListAdminTestJSON-2126167497 None] Acquiring lock "cinder-quobyte-4923e765-5698-4b20-a5d8-07ccb87820fb" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:11 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1340fce7-be78-405a-8113-812481a82c47 tempest-VolumesListAdminTestJSON-2126167497 None] Lock "cinder-quobyte-4923e765-5698-4b20-a5d8-07ccb87820fb" acquired by "delete_volume" :: waited 0.039s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:11 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccea3229-bf6f-48e6-ae1a-4e4ec46b1aad]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1340fce7-be78-405a-8113-812481a82c47 tempest-VolumesListAdminTestJSON-2126167497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4923e765-5698-4b20-a5d8-07ccb87820fb {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:12 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-15b37d0c-bb4c-4cea-bfa7-bba18607bcf7 tempest-VolumesListAdminTestJSON-1135256991 None] Acquiring lock "cinder-beed8631-d3d1-4d83-a2ac-dcf31c3b8db4-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:12 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-15b37d0c-bb4c-4cea-bfa7-bba18607bcf7 tempest-VolumesListAdminTestJSON-1135256991 None] Lock "cinder-beed8631-d3d1-4d83-a2ac-dcf31c3b8db4-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:12 devstack sudo[94948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4923e765-5698-4b20-a5d8-07ccb87820fb Sep 28 17:15:12 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:12 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-15b37d0c-bb4c-4cea-bfa7-bba18607bcf7 tempest-VolumesListAdminTestJSON-1135256991 None] Acquiring lock "cinder-quobyte-beed8631-d3d1-4d83-a2ac-dcf31c3b8db4" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:12 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-15b37d0c-bb4c-4cea-bfa7-bba18607bcf7 tempest-VolumesListAdminTestJSON-1135256991 None] Lock "cinder-quobyte-beed8631-d3d1-4d83-a2ac-dcf31c3b8db4" acquired by "delete_volume" :: waited 0.056s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:12 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb86279-05ab-421c-a0e5-5f24f645791a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-15b37d0c-bb4c-4cea-bfa7-bba18607bcf7 tempest-VolumesListAdminTestJSON-1135256991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-beed8631-d3d1-4d83-a2ac-dcf31c3b8db4 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:12 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1340fce7-be78-405a-8113-812481a82c47 tempest-VolumesListAdminTestJSON-2126167497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4923e765-5698-4b20-a5d8-07ccb87820fb" returned: 0 in 0.780s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1340fce7-be78-405a-8113-812481a82c47 tempest-VolumesListAdminTestJSON-2126167497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4923e765-5698-4b20-a5d8-07ccb87820fb {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:12 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4923e765-5698-4b20-a5d8-07ccb87820fb Sep 28 17:15:12 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:12 devstack sudo[94950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-beed8631-d3d1-4d83-a2ac-dcf31c3b8db4 Sep 28 17:15:12 devstack sudo[94950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:13 devstack sudo[94950]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-15b37d0c-bb4c-4cea-bfa7-bba18607bcf7 tempest-VolumesListAdminTestJSON-1135256991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-beed8631-d3d1-4d83-a2ac-dcf31c3b8db4" returned: 0 in 1.140s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-15b37d0c-bb4c-4cea-bfa7-bba18607bcf7 tempest-VolumesListAdminTestJSON-1135256991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-beed8631-d3d1-4d83-a2ac-dcf31c3b8db4 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:13 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-beed8631-d3d1-4d83-a2ac-dcf31c3b8db4 Sep 28 17:15:13 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:13 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1340fce7-be78-405a-8113-812481a82c47 tempest-VolumesListAdminTestJSON-2126167497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4923e765-5698-4b20-a5d8-07ccb87820fb" returned: 0 in 0.946s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:13 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1340fce7-be78-405a-8113-812481a82c47 tempest-VolumesListAdminTestJSON-2126167497 None] Lock "cinder-quobyte-4923e765-5698-4b20-a5d8-07ccb87820fb" released by "delete_volume" :: held 1.875s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:14 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-1340fce7-be78-405a-8113-812481a82c47 tempest-VolumesListAdminTestJSON-2126167497 None] Created reservations ['93a4884d-c762-4766-8afb-0a172b0663cf', '7e76f488-140f-45dd-967e-dacd6e93ebad', '80f2b471-2037-458f-8e55-2b78bd84ceb0', '17cb469d-75a4-4447-8b19-8be51821415f'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1340fce7-be78-405a-8113-812481a82c47 tempest-VolumesListAdminTestJSON-2126167497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1340fce7-be78-405a-8113-812481a82c47 tempest-VolumesListAdminTestJSON-2126167497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:14 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-1340fce7-be78-405a-8113-812481a82c47 tempest-VolumesListAdminTestJSON-2126167497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:14 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-1340fce7-be78-405a-8113-812481a82c47 tempest-VolumesListAdminTestJSON-2126167497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1340fce7-be78-405a-8113-812481a82c47 tempest-VolumesListAdminTestJSON-2126167497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1340fce7-be78-405a-8113-812481a82c47 tempest-VolumesListAdminTestJSON-2126167497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:14 devstack sudo[94979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:15:14 devstack sudo[94979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:14 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-15b37d0c-bb4c-4cea-bfa7-bba18607bcf7 tempest-VolumesListAdminTestJSON-1135256991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-beed8631-d3d1-4d83-a2ac-dcf31c3b8db4" returned: 0 in 0.924s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:14 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-15b37d0c-bb4c-4cea-bfa7-bba18607bcf7 tempest-VolumesListAdminTestJSON-1135256991 None] Lock "cinder-quobyte-beed8631-d3d1-4d83-a2ac-dcf31c3b8db4" released by "delete_volume" :: held 2.235s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:14 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-15b37d0c-bb4c-4cea-bfa7-bba18607bcf7 tempest-VolumesListAdminTestJSON-1135256991 None] Created reservations ['64000dc6-75df-475c-9f96-3de5c2c704e9', 'e675c8e3-fdea-4320-8c01-e3c1bf04079b', '2a7ceb6a-7aaf-4ed2-98f4-e4f554287ef6', 'e34d4145-2091-4be7-a8e6-6f8a93da6a56'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:15 devstack sudo[94979]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1340fce7-be78-405a-8113-812481a82c47 tempest-VolumesListAdminTestJSON-2126167497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.857s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:15 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-1340fce7-be78-405a-8113-812481a82c47 tempest-VolumesListAdminTestJSON-2126167497 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:15 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-1340fce7-be78-405a-8113-812481a82c47 tempest-VolumesListAdminTestJSON-2126167497 None] Deleted volume successfully. Sep 28 17:15:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-15b37d0c-bb4c-4cea-bfa7-bba18607bcf7 tempest-VolumesListAdminTestJSON-1135256991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-15b37d0c-bb4c-4cea-bfa7-bba18607bcf7 tempest-VolumesListAdminTestJSON-1135256991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:15 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-15b37d0c-bb4c-4cea-bfa7-bba18607bcf7 tempest-VolumesListAdminTestJSON-1135256991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:15 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-15b37d0c-bb4c-4cea-bfa7-bba18607bcf7 tempest-VolumesListAdminTestJSON-1135256991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-15b37d0c-bb4c-4cea-bfa7-bba18607bcf7 tempest-VolumesListAdminTestJSON-1135256991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-15b37d0c-bb4c-4cea-bfa7-bba18607bcf7 tempest-VolumesListAdminTestJSON-1135256991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:15 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1340fce7-be78-405a-8113-812481a82c47 tempest-VolumesListAdminTestJSON-2126167497 None] Lock "cinder-4923e765-5698-4b20-a5d8-07ccb87820fb-delete_volume" released by "delete_volume" :: held 3.599s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:15 devstack sudo[95003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:15:15 devstack sudo[95003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:15 devstack sudo[95003]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-15b37d0c-bb4c-4cea-bfa7-bba18607bcf7 tempest-VolumesListAdminTestJSON-1135256991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.707s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:16 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-15b37d0c-bb4c-4cea-bfa7-bba18607bcf7 tempest-VolumesListAdminTestJSON-1135256991 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:16 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-15b37d0c-bb4c-4cea-bfa7-bba18607bcf7 tempest-VolumesListAdminTestJSON-1135256991 None] Deleted volume successfully. Sep 28 17:15:16 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-15b37d0c-bb4c-4cea-bfa7-bba18607bcf7 tempest-VolumesListAdminTestJSON-1135256991 None] Lock "cinder-beed8631-d3d1-4d83-a2ac-dcf31c3b8db4-delete_volume" released by "delete_volume" :: held 3.909s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:16 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-597c3551-edbb-4587-8433-43fe079d35a0 tempest-VolumesListAdminTestJSON-1135256991 None] Acquiring lock "cinder-6f8036ec-c076-40ad-ba7c-2784f616e45e-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:16 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-597c3551-edbb-4587-8433-43fe079d35a0 tempest-VolumesListAdminTestJSON-1135256991 None] Lock "cinder-6f8036ec-c076-40ad-ba7c-2784f616e45e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:16 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-597c3551-edbb-4587-8433-43fe079d35a0 tempest-VolumesListAdminTestJSON-1135256991 None] Acquiring lock "cinder-quobyte-6f8036ec-c076-40ad-ba7c-2784f616e45e" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:16 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-597c3551-edbb-4587-8433-43fe079d35a0 tempest-VolumesListAdminTestJSON-1135256991 None] Lock "cinder-quobyte-6f8036ec-c076-40ad-ba7c-2784f616e45e" acquired by "delete_volume" :: waited 0.059s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:16 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cae8057-b3bf-4f63-93c7-0c74c45a7c48]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-597c3551-edbb-4587-8433-43fe079d35a0 tempest-VolumesListAdminTestJSON-1135256991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6f8036ec-c076-40ad-ba7c-2784f616e45e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:17 devstack sudo[95033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6f8036ec-c076-40ad-ba7c-2784f616e45e Sep 28 17:15:17 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:17 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-597c3551-edbb-4587-8433-43fe079d35a0 tempest-VolumesListAdminTestJSON-1135256991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6f8036ec-c076-40ad-ba7c-2784f616e45e" returned: 0 in 0.882s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-597c3551-edbb-4587-8433-43fe079d35a0 tempest-VolumesListAdminTestJSON-1135256991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6f8036ec-c076-40ad-ba7c-2784f616e45e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:17 devstack sudo[95049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6f8036ec-c076-40ad-ba7c-2784f616e45e Sep 28 17:15:17 devstack sudo[95049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:18 devstack sudo[95049]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-597c3551-edbb-4587-8433-43fe079d35a0 tempest-VolumesListAdminTestJSON-1135256991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6f8036ec-c076-40ad-ba7c-2784f616e45e" returned: 0 in 0.546s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:18 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-597c3551-edbb-4587-8433-43fe079d35a0 tempest-VolumesListAdminTestJSON-1135256991 None] Lock "cinder-quobyte-6f8036ec-c076-40ad-ba7c-2784f616e45e" released by "delete_volume" :: held 1.565s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:18 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-597c3551-edbb-4587-8433-43fe079d35a0 tempest-VolumesListAdminTestJSON-1135256991 None] Created reservations ['50936033-60d5-466f-942a-1cea444062c6', '9780338d-e6c8-47cb-aa4d-a670431ecb76', '6999e614-0cb6-42c2-b874-4c341c75b44c', '9df85ab0-6112-4f95-acc9-d51cdcfcde36'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-597c3551-edbb-4587-8433-43fe079d35a0 tempest-VolumesListAdminTestJSON-1135256991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-597c3551-edbb-4587-8433-43fe079d35a0 tempest-VolumesListAdminTestJSON-1135256991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-597c3551-edbb-4587-8433-43fe079d35a0 tempest-VolumesListAdminTestJSON-1135256991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-597c3551-edbb-4587-8433-43fe079d35a0 tempest-VolumesListAdminTestJSON-1135256991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-597c3551-edbb-4587-8433-43fe079d35a0 tempest-VolumesListAdminTestJSON-1135256991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-597c3551-edbb-4587-8433-43fe079d35a0 tempest-VolumesListAdminTestJSON-1135256991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:18 devstack sudo[95053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:15:18 devstack sudo[95053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:19 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-59ccdd1c-cc1a-4e0d-956f-13c0438ca10c tempest-VolumesListAdminTestJSON-1135256991 None] Acquiring lock "cinder-0011cde5-224e-446a-98f6-293d4c7b96a8-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:19 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-59ccdd1c-cc1a-4e0d-956f-13c0438ca10c tempest-VolumesListAdminTestJSON-1135256991 None] Lock "cinder-0011cde5-224e-446a-98f6-293d4c7b96a8-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:19 devstack sudo[95053]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-597c3551-edbb-4587-8433-43fe079d35a0 tempest-VolumesListAdminTestJSON-1135256991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.841s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:19 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-597c3551-edbb-4587-8433-43fe079d35a0 tempest-VolumesListAdminTestJSON-1135256991 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:19 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-59ccdd1c-cc1a-4e0d-956f-13c0438ca10c tempest-VolumesListAdminTestJSON-1135256991 None] Acquiring lock "cinder-quobyte-0011cde5-224e-446a-98f6-293d4c7b96a8" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:19 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-597c3551-edbb-4587-8433-43fe079d35a0 tempest-VolumesListAdminTestJSON-1135256991 None] Deleted volume successfully. Sep 28 17:15:19 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-597c3551-edbb-4587-8433-43fe079d35a0 tempest-VolumesListAdminTestJSON-1135256991 None] Lock "cinder-6f8036ec-c076-40ad-ba7c-2784f616e45e-delete_volume" released by "delete_volume" :: held 3.041s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:19 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-59ccdd1c-cc1a-4e0d-956f-13c0438ca10c tempest-VolumesListAdminTestJSON-1135256991 None] Lock "cinder-quobyte-0011cde5-224e-446a-98f6-293d4c7b96a8" acquired by "delete_volume" :: waited 0.051s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:19 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9cdd96-cb54-46c2-960b-3ec3aca581a7]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-59ccdd1c-cc1a-4e0d-956f-13c0438ca10c tempest-VolumesListAdminTestJSON-1135256991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0011cde5-224e-446a-98f6-293d4c7b96a8 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:19 devstack sudo[95058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0011cde5-224e-446a-98f6-293d4c7b96a8 Sep 28 17:15:19 devstack sudo[95058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:20 devstack sudo[95058]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-59ccdd1c-cc1a-4e0d-956f-13c0438ca10c tempest-VolumesListAdminTestJSON-1135256991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0011cde5-224e-446a-98f6-293d4c7b96a8" returned: 0 in 0.862s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-59ccdd1c-cc1a-4e0d-956f-13c0438ca10c tempest-VolumesListAdminTestJSON-1135256991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0011cde5-224e-446a-98f6-293d4c7b96a8 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:20 devstack sudo[95076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0011cde5-224e-446a-98f6-293d4c7b96a8 Sep 28 17:15:20 devstack sudo[95076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:21 devstack sudo[95076]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-59ccdd1c-cc1a-4e0d-956f-13c0438ca10c tempest-VolumesListAdminTestJSON-1135256991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0011cde5-224e-446a-98f6-293d4c7b96a8" returned: 0 in 0.631s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:21 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-59ccdd1c-cc1a-4e0d-956f-13c0438ca10c tempest-VolumesListAdminTestJSON-1135256991 None] Lock "cinder-quobyte-0011cde5-224e-446a-98f6-293d4c7b96a8" released by "delete_volume" :: held 1.609s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:21 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:DELETE=7,cinder:SELECT=47,cinder:INSERT=16,cinder:UPDATE=56 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:15:21 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-59ccdd1c-cc1a-4e0d-956f-13c0438ca10c tempest-VolumesListAdminTestJSON-1135256991 None] Created reservations ['018adfd1-71f7-4a68-aea6-a2fed3ff3493', '31d2d37a-09cc-43ea-b0e6-5a44a0e6f4ed', 'd9f7191d-a72e-4fe4-99bf-6bd77bc6ae1e', '90a1794a-6a69-4218-9725-c3e19046854b'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-59ccdd1c-cc1a-4e0d-956f-13c0438ca10c tempest-VolumesListAdminTestJSON-1135256991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-59ccdd1c-cc1a-4e0d-956f-13c0438ca10c tempest-VolumesListAdminTestJSON-1135256991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:21 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-59ccdd1c-cc1a-4e0d-956f-13c0438ca10c tempest-VolumesListAdminTestJSON-1135256991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:21 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-59ccdd1c-cc1a-4e0d-956f-13c0438ca10c tempest-VolumesListAdminTestJSON-1135256991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-59ccdd1c-cc1a-4e0d-956f-13c0438ca10c tempest-VolumesListAdminTestJSON-1135256991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-59ccdd1c-cc1a-4e0d-956f-13c0438ca10c tempest-VolumesListAdminTestJSON-1135256991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:21 devstack sudo[95095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:15:21 devstack sudo[95095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:21 devstack sudo[95095]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-59ccdd1c-cc1a-4e0d-956f-13c0438ca10c tempest-VolumesListAdminTestJSON-1135256991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.297s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:21 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-59ccdd1c-cc1a-4e0d-956f-13c0438ca10c tempest-VolumesListAdminTestJSON-1135256991 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:21 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-59ccdd1c-cc1a-4e0d-956f-13c0438ca10c tempest-VolumesListAdminTestJSON-1135256991 None] Deleted volume successfully. Sep 28 17:15:21 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-59ccdd1c-cc1a-4e0d-956f-13c0438ca10c tempest-VolumesListAdminTestJSON-1135256991 None] Lock "cinder-0011cde5-224e-446a-98f6-293d4c7b96a8-delete_volume" released by "delete_volume" :: held 2.429s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e5f523e4-2b44-4e82-8203-68849804d6dd tempest-VolumesActionsTest-1828093912 None] Acquiring lock "cinder-b992f70c-58b4-42f5-aca7-04b53f8fc980" by "attach_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e5f523e4-2b44-4e82-8203-68849804d6dd tempest-VolumesActionsTest-1828093912 None] Lock "cinder-b992f70c-58b4-42f5-aca7-04b53f8fc980" acquired by "attach_volume" :: waited 0.047s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:30 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-e5f523e4-2b44-4e82-8203-68849804d6dd tempest-VolumesActionsTest-1828093912 None] Attaching volume b992f70c-58b4-42f5-aca7-04b53f8fc980 to instance c569a5c0-0521-4d2d-a293-2817e2be3889 at mountpoint /dev/vdb on host None. Sep 28 17:15:30 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-e5f523e4-2b44-4e82-8203-68849804d6dd tempest-VolumesActionsTest-1828093912 None] Attach volume completed successfully. Sep 28 17:15:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e5f523e4-2b44-4e82-8203-68849804d6dd tempest-VolumesActionsTest-1828093912 None] Lock "cinder-b992f70c-58b4-42f5-aca7-04b53f8fc980" released by "attach_volume" :: held 0.289s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e05c90ae-afb4-4fa4-a972-6d0369ff7309 tempest-VolumesActionsTest-1828093912 None] Acquiring lock "cinder-b992f70c-58b4-42f5-aca7-04b53f8fc980-detach_volume" by "detach_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e05c90ae-afb4-4fa4-a972-6d0369ff7309 tempest-VolumesActionsTest-1828093912 None] Lock "cinder-b992f70c-58b4-42f5-aca7-04b53f8fc980-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:30 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-e05c90ae-afb4-4fa4-a972-6d0369ff7309 tempest-VolumesActionsTest-1828093912 None] Detaching volume b992f70c-58b4-42f5-aca7-04b53f8fc980 from instance c569a5c0-0521-4d2d-a293-2817e2be3889. Sep 28 17:15:31 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-e05c90ae-afb4-4fa4-a972-6d0369ff7309 tempest-VolumesActionsTest-1828093912 None] Detach volume completed successfully. Sep 28 17:15:31 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e05c90ae-afb4-4fa4-a972-6d0369ff7309 tempest-VolumesActionsTest-1828093912 None] Lock "cinder-b992f70c-58b4-42f5-aca7-04b53f8fc980-detach_volume" released by "detach_volume" :: held 0.147s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:33 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:33 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Flow 'volume_create_manager' (2053f4ed-33bb-474a-a5e9-5fa13b296f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:33 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74e4430-48af-414f-9a1f-5234b050123e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:33 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74e4430-48af-414f-9a1f-5234b050123e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-445149182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d83c461-c78b-44da-ac76-0c689040dbb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f80d2cb0b5f94ccea41bd4d23f2836c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:33Z,use_quota=True,user_id='862b327ef0a343fcbcab8d2112128f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:33 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3933e5-8537-4bed-803f-44254c4c2c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:33 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3933e5-8537-4bed-803f-44254c4c2c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:33 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4676a4-2544-46a9-9661-87fecdb4109c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:33 devstack cinder-volume[86917]: DEBUG cinder.image.glance [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Creating Keystone auth plugin from conf {{(pid=86917) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:15:34 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4676a4-2544-46a9-9661-87fecdb4109c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0d83c461-c78b-44da-ac76-0c689040dbb2', 'volume_name': 'volume-0d83c461-c78b-44da-ac76-0c689040dbb2', 'volume_size': 1, 'image_id': '19d24755-5fa8-4e1d-aef6-b5fdde452855', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19d24755-5fa8-4e1d-aef6-b5fdde452855', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '307b831956a2452b912f3a0d37f5ee84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '19d24755-5fa8-4e1d-aef6-b5fdde452855', 'created_at': datetime.datetime(2026, 9, 28, 15, 0, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 0, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19d24755-5fa8-4e1d-aef6-b5fdde452855/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:34 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39faa76c-7a97-419a-ad1e-4d40ffda0606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:34 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39faa76c-7a97-419a-ad1e-4d40ffda0606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:34 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (254f1977-c9df-4f2f-9a9e-3b380d1a7eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:34 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Volume 0d83c461-c78b-44da-ac76-0c689040dbb2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0d83c461-c78b-44da-ac76-0c689040dbb2', 'volume_size': 1, 'image_id': '19d24755-5fa8-4e1d-aef6-b5fdde452855', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19d24755-5fa8-4e1d-aef6-b5fdde452855', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '307b831956a2452b912f3a0d37f5ee84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '19d24755-5fa8-4e1d-aef6-b5fdde452855', 'created_at': datetime.datetime(2026, 9, 28, 15, 0, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 0, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19d24755-5fa8-4e1d-aef6-b5fdde452855/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 17:15:34 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Trying to clone 0d83c461-c78b-44da-ac76-0c689040dbb2 from image 19d24755-5fa8-4e1d-aef6-b5fdde452855 at location (None, [{'url': 'file:///opt/stack/data/glance/images/19d24755-5fa8-4e1d-aef6-b5fdde452855', 'metadata': {}}]). {{(pid=86917) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:15:34 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_bt2o6eo6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86917) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:15:34 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Image download 20.69 MB at 20.69 MB/s Sep 28 17:15:34 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cc04e4-e8cd-46cc-a53f-c38f9cb09d1b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_bt2o6eo6devstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:35 devstack sudo[95245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_bt2o6eo6devstack@QuobyteHD Sep 28 17:15:35 devstack sudo[95245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:35 devstack sudo[95245]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_bt2o6eo6devstack@QuobyteHD" returned: 0 in 0.548s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:35 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Temporary image 19d24755-5fa8-4e1d-aef6-b5fdde452855 is fetched for user 862b327ef0a343fcbcab8d2112128f01. {{(pid=86917) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:15:35 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa21740-4343-4ac5-a5de-3a8e08c2e593]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_bt2o6eo6devstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:35 devstack sudo[95253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_bt2o6eo6devstack@QuobyteHD Sep 28 17:15:35 devstack sudo[95253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:36 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d00d461d-6d76-4e27-afb4-15f579b6bf96 tempest-VolumesNegativeTest-1772986728 None] Acquiring lock "cinder-aa8b7266-9554-4a6d-b25b-5aa486dbef45-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:36 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d00d461d-6d76-4e27-afb4-15f579b6bf96 tempest-VolumesNegativeTest-1772986728 None] Lock "cinder-aa8b7266-9554-4a6d-b25b-5aa486dbef45-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:36 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d00d461d-6d76-4e27-afb4-15f579b6bf96 tempest-VolumesNegativeTest-1772986728 None] Acquiring lock "cinder-quobyte-aa8b7266-9554-4a6d-b25b-5aa486dbef45" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:36 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d00d461d-6d76-4e27-afb4-15f579b6bf96 tempest-VolumesNegativeTest-1772986728 None] Lock "cinder-quobyte-aa8b7266-9554-4a6d-b25b-5aa486dbef45" acquired by "delete_volume" :: waited 0.028s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:36 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f41ba6-f716-4bfb-8278-ee057827bb68]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d00d461d-6d76-4e27-afb4-15f579b6bf96 tempest-VolumesNegativeTest-1772986728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aa8b7266-9554-4a6d-b25b-5aa486dbef45 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:36 devstack sudo[95253]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_bt2o6eo6devstack@QuobyteHD" returned: 0 in 0.830s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:36 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-445149182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d83c461-c78b-44da-ac76-0c689040dbb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f80d2cb0b5f94ccea41bd4d23f2836c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:33Z,use_quota=True,user_id='862b327ef0a343fcbcab8d2112128f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:36 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Creating volume 0d83c461-c78b-44da-ac76-0c689040dbb2 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:36 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:36 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:36 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:36 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:15:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0d83c461-c78b-44da-ac76-0c689040dbb2 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:36 devstack sudo[95260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0d83c461-c78b-44da-ac76-0c689040dbb2 1073741824 Sep 28 17:15:36 devstack sudo[95260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:36 devstack sudo[95257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aa8b7266-9554-4a6d-b25b-5aa486dbef45 Sep 28 17:15:36 devstack sudo[95257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:36 devstack sudo[95257]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d00d461d-6d76-4e27-afb4-15f579b6bf96 tempest-VolumesNegativeTest-1772986728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aa8b7266-9554-4a6d-b25b-5aa486dbef45" returned: 0 in 0.646s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d00d461d-6d76-4e27-afb4-15f579b6bf96 tempest-VolumesNegativeTest-1772986728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aa8b7266-9554-4a6d-b25b-5aa486dbef45 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:37 devstack sudo[95269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aa8b7266-9554-4a6d-b25b-5aa486dbef45 Sep 28 17:15:37 devstack sudo[95269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:37 devstack sudo[95260]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0d83c461-c78b-44da-ac76-0c689040dbb2 1073741824" returned: 0 in 0.867s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0d83c461-c78b-44da-ac76-0c689040dbb2 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:37 devstack sudo[95272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0d83c461-c78b-44da-ac76-0c689040dbb2 Sep 28 17:15:37 devstack sudo[95272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:37 devstack sudo[95269]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d00d461d-6d76-4e27-afb4-15f579b6bf96 tempest-VolumesNegativeTest-1772986728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aa8b7266-9554-4a6d-b25b-5aa486dbef45" returned: 0 in 0.480s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:37 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d00d461d-6d76-4e27-afb4-15f579b6bf96 tempest-VolumesNegativeTest-1772986728 None] Lock "cinder-quobyte-aa8b7266-9554-4a6d-b25b-5aa486dbef45" released by "delete_volume" :: held 1.208s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:37 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-d00d461d-6d76-4e27-afb4-15f579b6bf96 tempest-VolumesNegativeTest-1772986728 None] Created reservations ['2c1ea4c9-abdd-4aea-ba32-d1caf36546b2', 'bbde7d39-3122-4845-9fb0-cefa9a58b5fa', '90791dc2-64dc-45de-a14a-d3132d0bed69', '5c0c5d13-b882-4b90-bdfb-2b1a1d638a1a'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d00d461d-6d76-4e27-afb4-15f579b6bf96 tempest-VolumesNegativeTest-1772986728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d00d461d-6d76-4e27-afb4-15f579b6bf96 tempest-VolumesNegativeTest-1772986728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:37 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d00d461d-6d76-4e27-afb4-15f579b6bf96 tempest-VolumesNegativeTest-1772986728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:37 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d00d461d-6d76-4e27-afb4-15f579b6bf96 tempest-VolumesNegativeTest-1772986728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d00d461d-6d76-4e27-afb4-15f579b6bf96 tempest-VolumesNegativeTest-1772986728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d00d461d-6d76-4e27-afb4-15f579b6bf96 tempest-VolumesNegativeTest-1772986728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:37 devstack sudo[95275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:15:37 devstack sudo[95275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:37 devstack sudo[95272]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0d83c461-c78b-44da-ac76-0c689040dbb2" returned: 0 in 0.429s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:37 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] <== create_volume: return (1378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.386s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:37 devstack cinder-volume[86917]: DEBUG cinder.volume.volume_utils [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Attempting download of 19d24755-5fa8-4e1d-aef6-b5fdde452855 ((None, [{'url': 'file:///opt/stack/data/glance/images/19d24755-5fa8-4e1d-aef6-b5fdde452855', 'metadata': {}}])) to volume 0d83c461-c78b-44da-ac76-0c689040dbb2. {{(pid=86917) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:15:37 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[18580bfa-75c2-4c35-a6ff-88b10b4e0cd3]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19d24755-5fa8-4e1d-aef6-b5fdde452855_m8jyr8t2 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:38 devstack sudo[95278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19d24755-5fa8-4e1d-aef6-b5fdde452855_m8jyr8t2 Sep 28 17:15:38 devstack sudo[95278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:38 devstack sudo[95275]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d00d461d-6d76-4e27-afb4-15f579b6bf96 tempest-VolumesNegativeTest-1772986728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.488s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:38 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-d00d461d-6d76-4e27-afb4-15f579b6bf96 tempest-VolumesNegativeTest-1772986728 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:38 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-d00d461d-6d76-4e27-afb4-15f579b6bf96 tempest-VolumesNegativeTest-1772986728 None] Deleted volume successfully. Sep 28 17:15:38 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d00d461d-6d76-4e27-afb4-15f579b6bf96 tempest-VolumesNegativeTest-1772986728 None] Lock "cinder-aa8b7266-9554-4a6d-b25b-5aa486dbef45-delete_volume" released by "delete_volume" :: held 2.084s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:38 devstack sudo[95278]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19d24755-5fa8-4e1d-aef6-b5fdde452855_m8jyr8t2" returned: 0 in 0.499s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19d24755-5fa8-4e1d-aef6-b5fdde452855_m8jyr8t2 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:38 devstack sudo[95283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19d24755-5fa8-4e1d-aef6-b5fdde452855_m8jyr8t2 Sep 28 17:15:38 devstack sudo[95283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:39 devstack sudo[95283]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19d24755-5fa8-4e1d-aef6-b5fdde452855_m8jyr8t2" returned: 1 in 0.636s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19d24755-5fa8-4e1d-aef6-b5fdde452855_m8jyr8t2' failed. Not Retrying. {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:15:39 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6630965e-a01a-46c4-b581-80067132c5a0]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_bt2o6eo6devstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-30a280e2-73cc-42a9-98f4-82338356a635 tempest-VolumesActionsTest-1828093912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-30a280e2-73cc-42a9-98f4-82338356a635 tempest-VolumesActionsTest-1828093912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:39 devstack sudo[95287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_bt2o6eo6devstack@QuobyteHD Sep 28 17:15:39 devstack sudo[95287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:39 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8cfa41-fb97-4e3f-b061-1884ceffe360]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-30a280e2-73cc-42a9-98f4-82338356a635 tempest-VolumesActionsTest-1828093912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:39 devstack sudo[95289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980 Sep 28 17:15:39 devstack sudo[95289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:39 devstack sudo[95287]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_bt2o6eo6devstack@QuobyteHD" returned: 0 in 0.557s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:39 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] 19d24755-5fa8-4e1d-aef6-b5fdde452855 was qcow2, converting to qcow2 {{(pid=86917) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:15:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_bt2o6eo6devstack@QuobyteHD /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0d83c461-c78b-44da-ac76-0c689040dbb2 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:39 devstack sudo[95295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_bt2o6eo6devstack@QuobyteHD /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0d83c461-c78b-44da-ac76-0c689040dbb2 Sep 28 17:15:39 devstack sudo[95295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:39 devstack sudo[95289]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-30a280e2-73cc-42a9-98f4-82338356a635 tempest-VolumesActionsTest-1828093912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980" returned: 0 in 0.548s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:39 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[08939cda-644d-4faa-80ba-4eb01d81ea1d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-30a280e2-73cc-42a9-98f4-82338356a635 tempest-VolumesActionsTest-1828093912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:40 devstack sudo[95301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980 Sep 28 17:15:40 devstack sudo[95301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:40 devstack sudo[95301]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-30a280e2-73cc-42a9-98f4-82338356a635 tempest-VolumesActionsTest-1828093912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980" returned: 0 in 0.624s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-30a280e2-73cc-42a9-98f4-82338356a635 tempest-VolumesActionsTest-1828093912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980 /opt/stack/data/cinder/conversion/b992f70c-58b4-42f5-aca7-04b53f8fc980.temp_image.a0c70dd1-68b2-4eba-9289-1f1ff9a9330b7tohzh7k.img {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:40 devstack sudo[95312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980 /opt/stack/data/cinder/conversion/b992f70c-58b4-42f5-aca7-04b53f8fc980.temp_image.a0c70dd1-68b2-4eba-9289-1f1ff9a9330b7tohzh7k.img Sep 28 17:15:40 devstack sudo[95312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_bt2o6eo6devstack@QuobyteHD /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0d83c461-c78b-44da-ac76-0c689040dbb2" returned: 0 in 5.585s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:45 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_bt2o6eo6devstack@QuobyteHD, size 112.00 MB, duration 5.59 sec, destination /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0d83c461-c78b-44da-ac76-0c689040dbb2 {{(pid=86917) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:15:45 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Converted 112.00 MB image at 20.05 MB/s Sep 28 17:15:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0d83c461-c78b-44da-ac76-0c689040dbb2 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:45 devstack sudo[95332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0d83c461-c78b-44da-ac76-0c689040dbb2 1G Sep 28 17:15:45 devstack sudo[95332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:46 devstack sudo[95332]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0d83c461-c78b-44da-ac76-0c689040dbb2 1G" returned: 0 in 1.085s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:46 devstack cinder-volume[86917]: DEBUG cinder.volume.volume_utils [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Downloaded image 19d24755-5fa8-4e1d-aef6-b5fdde452855 ((None, [{'url': 'file:///opt/stack/data/glance/images/19d24755-5fa8-4e1d-aef6-b5fdde452855', 'metadata': {}}])) to volume 0d83c461-c78b-44da-ac76-0c689040dbb2 successfully. {{(pid=86917) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:15:46 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Temporary image 19d24755-5fa8-4e1d-aef6-b5fdde452855 for user 862b327ef0a343fcbcab8d2112128f01 is deleted. {{(pid=86917) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:15:46 devstack cinder-volume[86917]: DEBUG cinder.volume.volume_utils [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Marking volume 0d83c461-c78b-44da-ac76-0c689040dbb2 as bootable. {{(pid=86917) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:15:46 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=58,cinder:UPDATE=76,cinder:INSERT=12,cinder:DELETE=6 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:15:46 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Copying metadata from image 19d24755-5fa8-4e1d-aef6-b5fdde452855 to 0d83c461-c78b-44da-ac76-0c689040dbb2. {{(pid=86917) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:15:46 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Creating volume glance metadata for volume 0d83c461-c78b-44da-ac76-0c689040dbb2 backed by image 19d24755-5fa8-4e1d-aef6-b5fdde452855 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '19d24755-5fa8-4e1d-aef6-b5fdde452855', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86917) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:15:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (254f1977-c9df-4f2f-9a9e-3b380d1a7eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d83c461-c78b-44da-ac76-0c689040dbb2', 'volume_size': 1, 'image_id': '19d24755-5fa8-4e1d-aef6-b5fdde452855', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19d24755-5fa8-4e1d-aef6-b5fdde452855', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '307b831956a2452b912f3a0d37f5ee84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '19d24755-5fa8-4e1d-aef6-b5fdde452855', 'created_at': datetime.datetime(2026, 9, 28, 15, 0, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 0, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19d24755-5fa8-4e1d-aef6-b5fdde452855/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecac07b3-532a-4227-80e4-0d2511b08ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:46 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Volume volume-0d83c461-c78b-44da-ac76-0c689040dbb2 (0d83c461-c78b-44da-ac76-0c689040dbb2): created successfully Sep 28 17:15:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecac07b3-532a-4227-80e4-0d2511b08ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Flow 'volume_create_manager' (2053f4ed-33bb-474a-a5e9-5fa13b296f15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:46 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-d7eb84e2-0ba0-4a7f-8812-ca54039afab7 tempest-VolumesImageMetadata-240942391 None] Created volume successfully. Sep 28 17:15:47 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-31039e81-663c-4721-89ff-c74965dfe7dd tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:47 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-31039e81-663c-4721-89ff-c74965dfe7dd tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Flow 'volume_create_manager' (17f6d62a-08c3-41a5-a9be-6f0a5aed0e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:47 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-31039e81-663c-4721-89ff-c74965dfe7dd tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41af433c-355d-4fa6-8d6c-372eddb384c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:47 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-31039e81-663c-4721-89ff-c74965dfe7dd tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41af433c-355d-4fa6-8d6c-372eddb384c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1289203726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1e70217-3ad9-47be-b8e1-2371760292d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64448f12884643fcab1294942ac3cc35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:47Z,use_quota=True,user_id='91e3d9cb412648c0ad9e7f3686f43046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:47 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-31039e81-663c-4721-89ff-c74965dfe7dd tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed71e8d1-378c-44db-b81a-afedaa4647b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:47 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-31039e81-663c-4721-89ff-c74965dfe7dd tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed71e8d1-378c-44db-b81a-afedaa4647b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:47 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-31039e81-663c-4721-89ff-c74965dfe7dd tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17ab2c47-5f7c-4fbe-be6a-f1f664002fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:47 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-31039e81-663c-4721-89ff-c74965dfe7dd tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17ab2c47-5f7c-4fbe-be6a-f1f664002fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1e70217-3ad9-47be-b8e1-2371760292d8', 'volume_name': 'volume-f1e70217-3ad9-47be-b8e1-2371760292d8', 'volume_size': 2}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:47 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-31039e81-663c-4721-89ff-c74965dfe7dd tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c303c89f-9768-443c-bb33-85beb454c1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:47 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-31039e81-663c-4721-89ff-c74965dfe7dd tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c303c89f-9768-443c-bb33-85beb454c1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:47 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-31039e81-663c-4721-89ff-c74965dfe7dd tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17b33f73-1705-4d7d-8df3-f96696b26a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:47 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-31039e81-663c-4721-89ff-c74965dfe7dd tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Volume f1e70217-3ad9-47be-b8e1-2371760292d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1e70217-3ad9-47be-b8e1-2371760292d8', 'volume_size': 2} Sep 28 17:15:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-31039e81-663c-4721-89ff-c74965dfe7dd tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:48 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0d40ad41-3bc5-4bc5-9bbc-08b5b4b522ed tempest-VolumesImageMetadata-240942391 None] Acquiring lock "cinder-0d83c461-c78b-44da-ac76-0c689040dbb2-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:48 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0d40ad41-3bc5-4bc5-9bbc-08b5b4b522ed tempest-VolumesImageMetadata-240942391 None] Lock "cinder-0d83c461-c78b-44da-ac76-0c689040dbb2-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:48 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0d40ad41-3bc5-4bc5-9bbc-08b5b4b522ed tempest-VolumesImageMetadata-240942391 None] Acquiring lock "cinder-quobyte-0d83c461-c78b-44da-ac76-0c689040dbb2" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:48 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0d40ad41-3bc5-4bc5-9bbc-08b5b4b522ed tempest-VolumesImageMetadata-240942391 None] Lock "cinder-quobyte-0d83c461-c78b-44da-ac76-0c689040dbb2" acquired by "delete_volume" :: waited 0.033s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:48 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[695a45ff-34ca-4220-8586-8e25861cf8a1]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0d40ad41-3bc5-4bc5-9bbc-08b5b4b522ed tempest-VolumesImageMetadata-240942391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0d83c461-c78b-44da-ac76-0c689040dbb2 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:49 devstack sudo[95342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0d83c461-c78b-44da-ac76-0c689040dbb2 Sep 28 17:15:49 devstack sudo[95342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:15:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:49 devstack sudo[95355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:15:49 devstack sudo[95355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:50 devstack sudo[95342]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0d40ad41-3bc5-4bc5-9bbc-08b5b4b522ed tempest-VolumesImageMetadata-240942391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0d83c461-c78b-44da-ac76-0c689040dbb2" returned: 0 in 1.343s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0d40ad41-3bc5-4bc5-9bbc-08b5b4b522ed tempest-VolumesImageMetadata-240942391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0d83c461-c78b-44da-ac76-0c689040dbb2 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:50 devstack sudo[95363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0d83c461-c78b-44da-ac76-0c689040dbb2 Sep 28 17:15:50 devstack sudo[95363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:50 devstack sudo[95355]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.967s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:50 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:50 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager._thread_info {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:15:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread count: 28 {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:15:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread info: [<_MainThread(MainThread, started 132915553284224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:15:50 devstack sudo[95363]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0d40ad41-3bc5-4bc5-9bbc-08b5b4b522ed tempest-VolumesImageMetadata-240942391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0d83c461-c78b-44da-ac76-0c689040dbb2" returned: 0 in 0.570s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:50 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0d40ad41-3bc5-4bc5-9bbc-08b5b4b522ed tempest-VolumesImageMetadata-240942391 None] Lock "cinder-quobyte-0d83c461-c78b-44da-ac76-0c689040dbb2" released by "delete_volume" :: held 2.091s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:50 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-0d40ad41-3bc5-4bc5-9bbc-08b5b4b522ed tempest-VolumesImageMetadata-240942391 None] Created reservations ['b52356ff-39c5-457c-afa2-5a2209d28123', 'b38e386a-1535-4e10-8970-f6ad25b800f9', '3137f8c7-b18f-4af2-ad29-73c4b9a34d5d', '55decd23-07db-4dae-9df2-5b5e81b584d4'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:51 devstack sudo[95312]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-30a280e2-73cc-42a9-98f4-82338356a635 tempest-VolumesActionsTest-1828093912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980 /opt/stack/data/cinder/conversion/b992f70c-58b4-42f5-aca7-04b53f8fc980.temp_image.a0c70dd1-68b2-4eba-9289-1f1ff9a9330b7tohzh7k.img" returned: 0 in 10.458s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:51 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f77da8-a729-4bcd-aca7-99acde73e13b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-30a280e2-73cc-42a9-98f4-82338356a635 tempest-VolumesActionsTest-1828093912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0d40ad41-3bc5-4bc5-9bbc-08b5b4b522ed tempest-VolumesImageMetadata-240942391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0d40ad41-3bc5-4bc5-9bbc-08b5b4b522ed tempest-VolumesImageMetadata-240942391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:51 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0d40ad41-3bc5-4bc5-9bbc-08b5b4b522ed tempest-VolumesImageMetadata-240942391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:51 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0d40ad41-3bc5-4bc5-9bbc-08b5b4b522ed tempest-VolumesImageMetadata-240942391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0d40ad41-3bc5-4bc5-9bbc-08b5b4b522ed tempest-VolumesImageMetadata-240942391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0d40ad41-3bc5-4bc5-9bbc-08b5b4b522ed tempest-VolumesImageMetadata-240942391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:51 devstack sudo[95372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:15:51 devstack sudo[95372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:51 devstack sudo[95371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980 Sep 28 17:15:51 devstack sudo[95371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:51 devstack sudo[95372]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0d40ad41-3bc5-4bc5-9bbc-08b5b4b522ed tempest-VolumesImageMetadata-240942391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.331s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:51 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-0d40ad41-3bc5-4bc5-9bbc-08b5b4b522ed tempest-VolumesImageMetadata-240942391 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:51 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-0d40ad41-3bc5-4bc5-9bbc-08b5b4b522ed tempest-VolumesImageMetadata-240942391 None] Deleted volume successfully. Sep 28 17:15:51 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0d40ad41-3bc5-4bc5-9bbc-08b5b4b522ed tempest-VolumesImageMetadata-240942391 None] Lock "cinder-0d83c461-c78b-44da-ac76-0c689040dbb2-delete_volume" released by "delete_volume" :: held 2.994s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:51 devstack sudo[95371]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-30a280e2-73cc-42a9-98f4-82338356a635 tempest-VolumesActionsTest-1828093912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980" returned: 0 in 0.747s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:51 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-30a280e2-73cc-42a9-98f4-82338356a635 tempest-VolumesActionsTest-1828093912 None] Image conversion details: src /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980, size 1024.00 MB, duration 10.46 sec, destination /opt/stack/data/cinder/conversion/b992f70c-58b4-42f5-aca7-04b53f8fc980.temp_image.a0c70dd1-68b2-4eba-9289-1f1ff9a9330b7tohzh7k.img {{(pid=86917) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:15:51 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-30a280e2-73cc-42a9-98f4-82338356a635 tempest-VolumesActionsTest-1828093912 None] Converted 1024.00 MB image at 97.90 MB/s Sep 28 17:15:51 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-30a280e2-73cc-42a9-98f4-82338356a635 tempest-VolumesActionsTest-1828093912 None] a0c70dd1-68b2-4eba-9289-1f1ff9a9330b was raw, no need to convert to raw {{(pid=86917) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 17:15:59 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c7f0cc2-8837-47b5-9d63-f190f96617d6 tempest-VolumesMetadataTest-1805907391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6c7f0cc2-8837-47b5-9d63-f190f96617d6 tempest-VolumesMetadataTest-1805907391 None] Flow 'volume_create_manager' (7ab8cbcc-a1b6-4538-814c-801735d8c4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6c7f0cc2-8837-47b5-9d63-f190f96617d6 tempest-VolumesMetadataTest-1805907391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3989e79f-7365-4b1c-9899-bcb52ee86ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6c7f0cc2-8837-47b5-9d63-f190f96617d6 tempest-VolumesMetadataTest-1805907391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3989e79f-7365-4b1c-9899-bcb52ee86ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-805348052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32c5926e-57d7-4cbc-8070-4a67d0c3b799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fd6065b2af94ed39314cf9375265320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:59Z,use_quota=True,user_id='8cd100110a864867932245e9ee91f3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6c7f0cc2-8837-47b5-9d63-f190f96617d6 tempest-VolumesMetadataTest-1805907391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b54fda-07a6-4fb8-a13c-a8b11dabd6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6c7f0cc2-8837-47b5-9d63-f190f96617d6 tempest-VolumesMetadataTest-1805907391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b54fda-07a6-4fb8-a13c-a8b11dabd6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6c7f0cc2-8837-47b5-9d63-f190f96617d6 tempest-VolumesMetadataTest-1805907391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44a94d04-3567-40c9-9f8f-3d27c927e3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6c7f0cc2-8837-47b5-9d63-f190f96617d6 tempest-VolumesMetadataTest-1805907391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44a94d04-3567-40c9-9f8f-3d27c927e3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32c5926e-57d7-4cbc-8070-4a67d0c3b799', 'volume_name': 'volume-32c5926e-57d7-4cbc-8070-4a67d0c3b799', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6c7f0cc2-8837-47b5-9d63-f190f96617d6 tempest-VolumesMetadataTest-1805907391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b18ddd27-5c2b-4213-bc00-86e1bafbb25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6c7f0cc2-8837-47b5-9d63-f190f96617d6 tempest-VolumesMetadataTest-1805907391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b18ddd27-5c2b-4213-bc00-86e1bafbb25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6c7f0cc2-8837-47b5-9d63-f190f96617d6 tempest-VolumesMetadataTest-1805907391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c6f8a0f-0637-495c-9cd2-dd9488cb1090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:59 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-6c7f0cc2-8837-47b5-9d63-f190f96617d6 tempest-VolumesMetadataTest-1805907391 None] Volume 32c5926e-57d7-4cbc-8070-4a67d0c3b799: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32c5926e-57d7-4cbc-8070-4a67d0c3b799', 'volume_size': 1} Sep 28 17:15:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6c7f0cc2-8837-47b5-9d63-f190f96617d6 tempest-VolumesMetadataTest-1805907391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:17 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:INSERT=19,cinder:UPDATE=27,cinder:SELECT=32,cinder:DELETE=2 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:16:17 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=14,cinder:INSERT=5,cinder:UPDATE=11 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:16:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-30a280e2-73cc-42a9-98f4-82338356a635 tempest-VolumesActionsTest-1828093912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 39.517s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-30a280e2-73cc-42a9-98f4-82338356a635 tempest-VolumesActionsTest-1828093912 None] Uploaded volume to glance image-id: a0c70dd1-68b2-4eba-9289-1f1ff9a9330b. {{(pid=86917) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 17:16:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-31039e81-663c-4721-89ff-c74965dfe7dd tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 31.595s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-31039e81-663c-4721-89ff-c74965dfe7dd tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1289203726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1e70217-3ad9-47be-b8e1-2371760292d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64448f12884643fcab1294942ac3cc35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:47Z,use_quota=True,user_id='91e3d9cb412648c0ad9e7f3686f43046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:16:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-31039e81-663c-4721-89ff-c74965dfe7dd tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Creating volume f1e70217-3ad9-47be-b8e1-2371760292d8 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:16:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-31039e81-663c-4721-89ff-c74965dfe7dd tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-31039e81-663c-4721-89ff-c74965dfe7dd tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-31039e81-663c-4721-89ff-c74965dfe7dd tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-31039e81-663c-4721-89ff-c74965dfe7dd tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-31039e81-663c-4721-89ff-c74965dfe7dd tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-31039e81-663c-4721-89ff-c74965dfe7dd tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:16:18 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-31039e81-663c-4721-89ff-c74965dfe7dd tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:16:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-31039e81-663c-4721-89ff-c74965dfe7dd tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8 2147483648 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:18 devstack sudo[95542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8 2147483648 Sep 28 17:16:18 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:18 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-30a280e2-73cc-42a9-98f4-82338356a635 tempest-VolumesActionsTest-1828093912 None] Copy volume to image completed successfully. Sep 28 17:16:19 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-31039e81-663c-4721-89ff-c74965dfe7dd tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8 2147483648" returned: 0 in 0.601s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-31039e81-663c-4721-89ff-c74965dfe7dd tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:19 devstack sudo[95547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8 Sep 28 17:16:19 devstack sudo[95547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:19 devstack sudo[95547]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-31039e81-663c-4721-89ff-c74965dfe7dd tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8" returned: 0 in 0.276s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-31039e81-663c-4721-89ff-c74965dfe7dd tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:16:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-31039e81-663c-4721-89ff-c74965dfe7dd tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6c7f0cc2-8837-47b5-9d63-f190f96617d6 tempest-VolumesMetadataTest-1805907391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.237s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6c7f0cc2-8837-47b5-9d63-f190f96617d6 tempest-VolumesMetadataTest-1805907391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-805348052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32c5926e-57d7-4cbc-8070-4a67d0c3b799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fd6065b2af94ed39314cf9375265320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:59Z,use_quota=True,user_id='8cd100110a864867932245e9ee91f3b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:16:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-6c7f0cc2-8837-47b5-9d63-f190f96617d6 tempest-VolumesMetadataTest-1805907391 None] Creating volume 32c5926e-57d7-4cbc-8070-4a67d0c3b799 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:16:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6c7f0cc2-8837-47b5-9d63-f190f96617d6 tempest-VolumesMetadataTest-1805907391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6c7f0cc2-8837-47b5-9d63-f190f96617d6 tempest-VolumesMetadataTest-1805907391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6c7f0cc2-8837-47b5-9d63-f190f96617d6 tempest-VolumesMetadataTest-1805907391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6c7f0cc2-8837-47b5-9d63-f190f96617d6 tempest-VolumesMetadataTest-1805907391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6c7f0cc2-8837-47b5-9d63-f190f96617d6 tempest-VolumesMetadataTest-1805907391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6c7f0cc2-8837-47b5-9d63-f190f96617d6 tempest-VolumesMetadataTest-1805907391 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:16:19 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-6c7f0cc2-8837-47b5-9d63-f190f96617d6 tempest-VolumesMetadataTest-1805907391 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:16:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6c7f0cc2-8837-47b5-9d63-f190f96617d6 tempest-VolumesMetadataTest-1805907391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-32c5926e-57d7-4cbc-8070-4a67d0c3b799 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-31039e81-663c-4721-89ff-c74965dfe7dd tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17b33f73-1705-4d7d-8df3-f96696b26a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1e70217-3ad9-47be-b8e1-2371760292d8', 'volume_size': 2}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:19 devstack sudo[95550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-32c5926e-57d7-4cbc-8070-4a67d0c3b799 1073741824 Sep 28 17:16:19 devstack sudo[95550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-31039e81-663c-4721-89ff-c74965dfe7dd tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30139671-1f3f-44c0-b1f3-dfef21f046ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:19 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-31039e81-663c-4721-89ff-c74965dfe7dd tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Volume volume-f1e70217-3ad9-47be-b8e1-2371760292d8 (f1e70217-3ad9-47be-b8e1-2371760292d8): created successfully Sep 28 17:16:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-31039e81-663c-4721-89ff-c74965dfe7dd tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30139671-1f3f-44c0-b1f3-dfef21f046ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-31039e81-663c-4721-89ff-c74965dfe7dd tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Flow 'volume_create_manager' (17f6d62a-08c3-41a5-a9be-6f0a5aed0e41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:19 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-31039e81-663c-4721-89ff-c74965dfe7dd tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Created volume successfully. Sep 28 17:16:20 devstack sudo[95550]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6c7f0cc2-8837-47b5-9d63-f190f96617d6 tempest-VolumesMetadataTest-1805907391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-32c5926e-57d7-4cbc-8070-4a67d0c3b799 1073741824" returned: 0 in 0.634s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6c7f0cc2-8837-47b5-9d63-f190f96617d6 tempest-VolumesMetadataTest-1805907391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-32c5926e-57d7-4cbc-8070-4a67d0c3b799 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:20 devstack sudo[95557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-32c5926e-57d7-4cbc-8070-4a67d0c3b799 Sep 28 17:16:20 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-821a48e9-ba6a-4c22-8b71-878da2c32fb4 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:20 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6c7f0cc2-8837-47b5-9d63-f190f96617d6 tempest-VolumesMetadataTest-1805907391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-32c5926e-57d7-4cbc-8070-4a67d0c3b799" returned: 0 in 0.354s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6c7f0cc2-8837-47b5-9d63-f190f96617d6 tempest-VolumesMetadataTest-1805907391 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:16:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6c7f0cc2-8837-47b5-9d63-f190f96617d6 tempest-VolumesMetadataTest-1805907391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-821a48e9-ba6a-4c22-8b71-878da2c32fb4 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.167s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-821a48e9-ba6a-4c22-8b71-878da2c32fb4 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Creating offline snapshot 0b2b1b78-1002-4a68-892b-55ad39f4aa7c of volume f1e70217-3ad9-47be-b8e1-2371760292d8 {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:16:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6c7f0cc2-8837-47b5-9d63-f190f96617d6 tempest-VolumesMetadataTest-1805907391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c6f8a0f-0637-495c-9cd2-dd9488cb1090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32c5926e-57d7-4cbc-8070-4a67d0c3b799', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6c7f0cc2-8837-47b5-9d63-f190f96617d6 tempest-VolumesMetadataTest-1805907391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63679b8c-ba7e-4378-944c-230895f1dd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:20 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[796e0541-939e-46fe-865a-38dd7e1229b2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-821a48e9-ba6a-4c22-8b71-878da2c32fb4 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:20 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-6c7f0cc2-8837-47b5-9d63-f190f96617d6 tempest-VolumesMetadataTest-1805907391 None] Volume volume-32c5926e-57d7-4cbc-8070-4a67d0c3b799 (32c5926e-57d7-4cbc-8070-4a67d0c3b799): created successfully Sep 28 17:16:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6c7f0cc2-8837-47b5-9d63-f190f96617d6 tempest-VolumesMetadataTest-1805907391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63679b8c-ba7e-4378-944c-230895f1dd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6c7f0cc2-8837-47b5-9d63-f190f96617d6 tempest-VolumesMetadataTest-1805907391 None] Flow 'volume_create_manager' (7ab8cbcc-a1b6-4538-814c-801735d8c4e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:20 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-6c7f0cc2-8837-47b5-9d63-f190f96617d6 tempest-VolumesMetadataTest-1805907391 None] Created volume successfully. Sep 28 17:16:21 devstack sudo[95562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8 Sep 28 17:16:21 devstack sudo[95562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:21 devstack sudo[95562]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-821a48e9-ba6a-4c22-8b71-878da2c32fb4 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8" returned: 0 in 0.481s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-821a48e9-ba6a-4c22-8b71-878da2c32fb4 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8.0b2b1b78-1002-4a68-892b-55ad39f4aa7c 2G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:21 devstack sudo[95568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8.0b2b1b78-1002-4a68-892b-55ad39f4aa7c 2G Sep 28 17:16:21 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e9eedda2-5486-4aa5-a678-4b70456115c1 tempest-VolumesActionsTest-1828093912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:21 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-9832b4c4-dff0-491b-9156-c307d09682b1 tempest-AttachVolumeTestJSON-1638983725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9832b4c4-dff0-491b-9156-c307d09682b1 tempest-AttachVolumeTestJSON-1638983725 None] Flow 'volume_create_manager' (5bf31c87-b700-4fea-9235-2cd6a6ce5169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9832b4c4-dff0-491b-9156-c307d09682b1 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8083ea1-5696-41cb-a658-e146ff7de276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9832b4c4-dff0-491b-9156-c307d09682b1 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8083ea1-5696-41cb-a658-e146ff7de276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1343559046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08d2b783-c1a4-4e37-8ce8-02755130b87c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c850ba8a5859455b92b280cb91ab5945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:22Z,use_quota=True,user_id='519c735893a8461bb5ca0169f6a5168c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9832b4c4-dff0-491b-9156-c307d09682b1 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (657e7137-bc8a-4b88-a5ee-83141f735995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9832b4c4-dff0-491b-9156-c307d09682b1 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (657e7137-bc8a-4b88-a5ee-83141f735995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9832b4c4-dff0-491b-9156-c307d09682b1 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c571af0-6bd4-4888-822b-05927825a93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9832b4c4-dff0-491b-9156-c307d09682b1 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c571af0-6bd4-4888-822b-05927825a93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08d2b783-c1a4-4e37-8ce8-02755130b87c', 'volume_name': 'volume-08d2b783-c1a4-4e37-8ce8-02755130b87c', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9832b4c4-dff0-491b-9156-c307d09682b1 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2818fd6-f3c6-49b2-bd8e-3f01c34ed4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9832b4c4-dff0-491b-9156-c307d09682b1 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2818fd6-f3c6-49b2-bd8e-3f01c34ed4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9832b4c4-dff0-491b-9156-c307d09682b1 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7901e8c0-9d81-4acd-a68b-768ae77c2b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:21 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-9832b4c4-dff0-491b-9156-c307d09682b1 tempest-AttachVolumeTestJSON-1638983725 None] Volume 08d2b783-c1a4-4e37-8ce8-02755130b87c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08d2b783-c1a4-4e37-8ce8-02755130b87c', 'volume_size': 1} Sep 28 17:16:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9832b4c4-dff0-491b-9156-c307d09682b1 tempest-AttachVolumeTestJSON-1638983725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-821a48e9-ba6a-4c22-8b71-878da2c32fb4 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8.0b2b1b78-1002-4a68-892b-55ad39f4aa7c 2G" returned: 0 in 0.630s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-821a48e9-ba6a-4c22-8b71-878da2c32fb4 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1e70217-3ad9-47be-b8e1-2371760292d8 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8.0b2b1b78-1002-4a68-892b-55ad39f4aa7c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:21 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:22 devstack sudo[95574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1e70217-3ad9-47be-b8e1-2371760292d8 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8.0b2b1b78-1002-4a68-892b-55ad39f4aa7c Sep 28 17:16:22 devstack sudo[95574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:22 devstack sudo[95574]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-821a48e9-ba6a-4c22-8b71-878da2c32fb4 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1e70217-3ad9-47be-b8e1-2371760292d8 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8.0b2b1b78-1002-4a68-892b-55ad39f4aa7c" returned: 0 in 0.378s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:22 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-821a48e9-ba6a-4c22-8b71-878da2c32fb4 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8.0b2b1b78-1002-4a68-892b-55ad39f4aa7c is being set with open permissions: ugo+rw Sep 28 17:16:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-821a48e9-ba6a-4c22-8b71-878da2c32fb4 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8.0b2b1b78-1002-4a68-892b-55ad39f4aa7c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:22 devstack sudo[95579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8.0b2b1b78-1002-4a68-892b-55ad39f4aa7c Sep 28 17:16:22 devstack sudo[95579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:22 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d3cb2a06-8036-425f-a127-e5c14b04105c tempest-VolumesMetadataTest-1805907391 None] Acquiring lock "cinder-32c5926e-57d7-4cbc-8070-4a67d0c3b799-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:22 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d3cb2a06-8036-425f-a127-e5c14b04105c tempest-VolumesMetadataTest-1805907391 None] Lock "cinder-32c5926e-57d7-4cbc-8070-4a67d0c3b799-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:22 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d3cb2a06-8036-425f-a127-e5c14b04105c tempest-VolumesMetadataTest-1805907391 None] Acquiring lock "cinder-quobyte-32c5926e-57d7-4cbc-8070-4a67d0c3b799" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:22 devstack sudo[95579]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-821a48e9-ba6a-4c22-8b71-878da2c32fb4 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8.0b2b1b78-1002-4a68-892b-55ad39f4aa7c" returned: 0 in 0.366s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:22 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d3cb2a06-8036-425f-a127-e5c14b04105c tempest-VolumesMetadataTest-1805907391 None] Lock "cinder-quobyte-32c5926e-57d7-4cbc-8070-4a67d0c3b799" acquired by "delete_volume" :: waited 0.029s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-821a48e9-ba6a-4c22-8b71-878da2c32fb4 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:22 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fab12a9-d741-4014-b508-a04f8fd04df4]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d3cb2a06-8036-425f-a127-e5c14b04105c tempest-VolumesMetadataTest-1805907391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-32c5926e-57d7-4cbc-8070-4a67d0c3b799 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:22 devstack sudo[95582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8.info Sep 28 17:16:22 devstack sudo[95582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:22 devstack sudo[95583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-32c5926e-57d7-4cbc-8070-4a67d0c3b799 Sep 28 17:16:22 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:23 devstack sudo[95582]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-821a48e9-ba6a-4c22-8b71-878da2c32fb4 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8.info" returned: 0 in 0.326s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:23 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-821a48e9-ba6a-4c22-8b71-878da2c32fb4 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8.info is being set with open permissions: ugo+rw Sep 28 17:16:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-821a48e9-ba6a-4c22-8b71-878da2c32fb4 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:23 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8.info Sep 28 17:16:23 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:23 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d3cb2a06-8036-425f-a127-e5c14b04105c tempest-VolumesMetadataTest-1805907391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-32c5926e-57d7-4cbc-8070-4a67d0c3b799" returned: 0 in 0.506s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d3cb2a06-8036-425f-a127-e5c14b04105c tempest-VolumesMetadataTest-1805907391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-32c5926e-57d7-4cbc-8070-4a67d0c3b799 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:23 devstack sudo[95592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-32c5926e-57d7-4cbc-8070-4a67d0c3b799 Sep 28 17:16:23 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:23 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-821a48e9-ba6a-4c22-8b71-878da2c32fb4 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8.info" returned: 0 in 0.320s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-821a48e9-ba6a-4c22-8b71-878da2c32fb4 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.657s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e9eedda2-5486-4aa5-a678-4b70456115c1 tempest-VolumesActionsTest-1828093912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.061s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:23 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebe7329-ef64-4015-9ef7-6f0cce220fbc]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e9eedda2-5486-4aa5-a678-4b70456115c1 tempest-VolumesActionsTest-1828093912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:23 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-821a48e9-ba6a-4c22-8b71-878da2c32fb4 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Create snapshot completed successfully Sep 28 17:16:23 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d3cb2a06-8036-425f-a127-e5c14b04105c tempest-VolumesMetadataTest-1805907391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-32c5926e-57d7-4cbc-8070-4a67d0c3b799" returned: 0 in 0.321s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:23 devstack sudo[95595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980 Sep 28 17:16:23 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:23 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d3cb2a06-8036-425f-a127-e5c14b04105c tempest-VolumesMetadataTest-1805907391 None] Lock "cinder-quobyte-32c5926e-57d7-4cbc-8070-4a67d0c3b799" released by "delete_volume" :: held 0.911s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:23 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-d3cb2a06-8036-425f-a127-e5c14b04105c tempest-VolumesMetadataTest-1805907391 None] Created reservations ['4d4132ee-9a5e-4d40-bc49-f0a3d1638d6c', '021085e1-7a1f-41f4-b2a4-fabc8d3a7de9', 'c732f30e-288f-4b5b-beef-62f61f0dabba', '05f5c5b4-6e71-4432-8999-7cce5bd4a4ec'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d3cb2a06-8036-425f-a127-e5c14b04105c tempest-VolumesMetadataTest-1805907391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d3cb2a06-8036-425f-a127-e5c14b04105c tempest-VolumesMetadataTest-1805907391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:23 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d3cb2a06-8036-425f-a127-e5c14b04105c tempest-VolumesMetadataTest-1805907391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:23 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d3cb2a06-8036-425f-a127-e5c14b04105c tempest-VolumesMetadataTest-1805907391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d3cb2a06-8036-425f-a127-e5c14b04105c tempest-VolumesMetadataTest-1805907391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d3cb2a06-8036-425f-a127-e5c14b04105c tempest-VolumesMetadataTest-1805907391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:23 devstack sudo[95598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:16:23 devstack sudo[95598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2950bc47-5a94-4d97-b3b8-8ab8bd648323 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Acquiring lock "cinder-0b2b1b78-1002-4a68-892b-55ad39f4aa7c-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2950bc47-5a94-4d97-b3b8-8ab8bd648323 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Lock "cinder-0b2b1b78-1002-4a68-892b-55ad39f4aa7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2950bc47-5a94-4d97-b3b8-8ab8bd648323 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Acquiring lock "cinder-quobyte-f1e70217-3ad9-47be-b8e1-2371760292d8" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2950bc47-5a94-4d97-b3b8-8ab8bd648323 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Lock "cinder-quobyte-f1e70217-3ad9-47be-b8e1-2371760292d8" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2950bc47-5a94-4d97-b3b8-8ab8bd648323 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Acquiring lock "cinder-quobyte-0b2b1b78-1002-4a68-892b-55ad39f4aa7c" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2950bc47-5a94-4d97-b3b8-8ab8bd648323 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Lock "cinder-quobyte-0b2b1b78-1002-4a68-892b-55ad39f4aa7c" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-2950bc47-5a94-4d97-b3b8-8ab8bd648323 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Deleting offline snapshot 0b2b1b78-1002-4a68-892b-55ad39f4aa7c of volume f1e70217-3ad9-47be-b8e1-2371760292d8 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:16:24 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-2950bc47-5a94-4d97-b3b8-8ab8bd648323 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] snapshot_file for this snap is: volume-f1e70217-3ad9-47be-b8e1-2371760292d8.0b2b1b78-1002-4a68-892b-55ad39f4aa7c {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:16:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e9eedda2-5486-4aa5-a678-4b70456115c1 tempest-VolumesActionsTest-1828093912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980" returned: 0 in 0.684s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:24 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb5411e-bd7d-4a27-8819-00edef3faaef]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2950bc47-5a94-4d97-b3b8-8ab8bd648323 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8.0b2b1b78-1002-4a68-892b-55ad39f4aa7c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:24 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[428e7427-824d-484e-bd28-be37d6f067d9]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e9eedda2-5486-4aa5-a678-4b70456115c1 tempest-VolumesActionsTest-1828093912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:24 devstack sudo[95598]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d3cb2a06-8036-425f-a127-e5c14b04105c tempest-VolumesMetadataTest-1805907391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.425s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:24 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-d3cb2a06-8036-425f-a127-e5c14b04105c tempest-VolumesMetadataTest-1805907391 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:16:24 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-d3cb2a06-8036-425f-a127-e5c14b04105c tempest-VolumesMetadataTest-1805907391 None] Deleted volume successfully. Sep 28 17:16:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d3cb2a06-8036-425f-a127-e5c14b04105c tempest-VolumesMetadataTest-1805907391 None] Lock "cinder-32c5926e-57d7-4cbc-8070-4a67d0c3b799-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:24 devstack sudo[95604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8.0b2b1b78-1002-4a68-892b-55ad39f4aa7c Sep 28 17:16:24 devstack sudo[95604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:24 devstack sudo[95606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980 Sep 28 17:16:24 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:24 devstack sudo[95604]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2950bc47-5a94-4d97-b3b8-8ab8bd648323 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8.0b2b1b78-1002-4a68-892b-55ad39f4aa7c" returned: 0 in 0.529s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-2950bc47-5a94-4d97-b3b8-8ab8bd648323 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1e70217-3ad9-47be-b8e1-2371760292d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:16:24 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e9eedda2-5486-4aa5-a678-4b70456115c1 tempest-VolumesActionsTest-1828093912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980" returned: 0 in 0.550s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e9eedda2-5486-4aa5-a678-4b70456115c1 tempest-VolumesActionsTest-1828093912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980 /opt/stack/data/cinder/conversion/b992f70c-58b4-42f5-aca7-04b53f8fc980.temp_image.c4537d8e-9726-4409-9382-fc376e457b02qr4zc8fa.img {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:24 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a88fcf-2a0c-4f67-9097-6d9d5e21722c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2950bc47-5a94-4d97-b3b8-8ab8bd648323 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:24 devstack sudo[95616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980 /opt/stack/data/cinder/conversion/b992f70c-58b4-42f5-aca7-04b53f8fc980.temp_image.c4537d8e-9726-4409-9382-fc376e457b02qr4zc8fa.img Sep 28 17:16:24 devstack sudo[95616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:24 devstack sudo[95617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8 Sep 28 17:16:24 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:25 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2950bc47-5a94-4d97-b3b8-8ab8bd648323 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8" returned: 0 in 0.625s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2950bc47-5a94-4d97-b3b8-8ab8bd648323 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8.0b2b1b78-1002-4a68-892b-55ad39f4aa7c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:25 devstack sudo[95633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8.0b2b1b78-1002-4a68-892b-55ad39f4aa7c Sep 28 17:16:25 devstack sudo[95633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:26 devstack sudo[95633]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2950bc47-5a94-4d97-b3b8-8ab8bd648323 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8.0b2b1b78-1002-4a68-892b-55ad39f4aa7c" returned: 0 in 1.037s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2950bc47-5a94-4d97-b3b8-8ab8bd648323 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8.0b2b1b78-1002-4a68-892b-55ad39f4aa7c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:26 devstack sudo[95639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8.0b2b1b78-1002-4a68-892b-55ad39f4aa7c Sep 28 17:16:26 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:26 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2950bc47-5a94-4d97-b3b8-8ab8bd648323 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8.0b2b1b78-1002-4a68-892b-55ad39f4aa7c" returned: 0 in 0.401s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2950bc47-5a94-4d97-b3b8-8ab8bd648323 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Lock "cinder-quobyte-0b2b1b78-1002-4a68-892b-55ad39f4aa7c" released by "_delete_snapshot" :: held 2.845s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2950bc47-5a94-4d97-b3b8-8ab8bd648323 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Lock "cinder-quobyte-f1e70217-3ad9-47be-b8e1-2371760292d8" released by "delete_snapshot" :: held 2.902s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:27 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-2950bc47-5a94-4d97-b3b8-8ab8bd648323 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Created reservations ['8b6580a4-84be-4111-9085-d12f22dce800', '9a1280bf-d706-40a0-8bc0-f1ba0a1bd324', '9879d036-37bf-4693-8f29-d3de976adfc8', '9f828e3f-0170-4d9a-a925-f35b8ff59360'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:27 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-2950bc47-5a94-4d97-b3b8-8ab8bd648323 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Delete snapshot completed successfully. Sep 28 17:16:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2950bc47-5a94-4d97-b3b8-8ab8bd648323 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Lock "cinder-0b2b1b78-1002-4a68-892b-55ad39f4aa7c-delete_snapshot" released by "delete_snapshot" :: held 3.393s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:28 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-3cca7316-1369-4db5-85bb-efc341a265b2 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Acquiring lock "cinder-f1e70217-3ad9-47be-b8e1-2371760292d8-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:28 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-3cca7316-1369-4db5-85bb-efc341a265b2 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Lock "cinder-f1e70217-3ad9-47be-b8e1-2371760292d8-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:28 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-3cca7316-1369-4db5-85bb-efc341a265b2 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Acquiring lock "cinder-quobyte-f1e70217-3ad9-47be-b8e1-2371760292d8" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-3cca7316-1369-4db5-85bb-efc341a265b2 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Lock "cinder-quobyte-f1e70217-3ad9-47be-b8e1-2371760292d8" acquired by "delete_volume" :: waited 0.057s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:29 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d906dea8-4875-4c5a-aa76-029946d71ead]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3cca7316-1369-4db5-85bb-efc341a265b2 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:29 devstack sudo[95642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8 Sep 28 17:16:29 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:30 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3cca7316-1369-4db5-85bb-efc341a265b2 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8" returned: 0 in 1.054s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3cca7316-1369-4db5-85bb-efc341a265b2 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:30 devstack sudo[95647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8 Sep 28 17:16:30 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:30 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3cca7316-1369-4db5-85bb-efc341a265b2 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f1e70217-3ad9-47be-b8e1-2371760292d8" returned: 0 in 0.761s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:31 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-3cca7316-1369-4db5-85bb-efc341a265b2 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Lock "cinder-quobyte-f1e70217-3ad9-47be-b8e1-2371760292d8" released by "delete_volume" :: held 2.028s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:31 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-3cca7316-1369-4db5-85bb-efc341a265b2 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Created reservations ['b979bfdf-ed3d-4781-8a8f-38bd8bc61ebf', '96358a52-359a-4420-8290-a03a7146d9fe', 'b735bc2e-0166-4a4c-84dc-33d35cae6cc2', '39bfdb47-11c3-4c23-a303-b6515da13bc0'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3cca7316-1369-4db5-85bb-efc341a265b2 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3cca7316-1369-4db5-85bb-efc341a265b2 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-3cca7316-1369-4db5-85bb-efc341a265b2 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-3cca7316-1369-4db5-85bb-efc341a265b2 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3cca7316-1369-4db5-85bb-efc341a265b2 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3cca7316-1369-4db5-85bb-efc341a265b2 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:31 devstack sudo[95651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:16:31 devstack sudo[95651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:31 devstack sudo[95651]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3cca7316-1369-4db5-85bb-efc341a265b2 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.584s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:31 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-3cca7316-1369-4db5-85bb-efc341a265b2 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:16:31 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-3cca7316-1369-4db5-85bb-efc341a265b2 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Deleted volume successfully. Sep 28 17:16:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-3cca7316-1369-4db5-85bb-efc341a265b2 tempest-VolumesSnapshotNegativeTestJSON-1095925515 None] Lock "cinder-f1e70217-3ad9-47be-b8e1-2371760292d8-delete_volume" released by "delete_volume" :: held 3.236s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:33 devstack sudo[95616]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e9eedda2-5486-4aa5-a678-4b70456115c1 tempest-VolumesActionsTest-1828093912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980 /opt/stack/data/cinder/conversion/b992f70c-58b4-42f5-aca7-04b53f8fc980.temp_image.c4537d8e-9726-4409-9382-fc376e457b02qr4zc8fa.img" returned: 0 in 8.430s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:33 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c145ac7a-0280-4e05-bebd-0aa0253fe7f1]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e9eedda2-5486-4aa5-a678-4b70456115c1 tempest-VolumesActionsTest-1828093912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:33 devstack sudo[95655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980 Sep 28 17:16:33 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:33 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e9eedda2-5486-4aa5-a678-4b70456115c1 tempest-VolumesActionsTest-1828093912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980" returned: 0 in 0.609s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:33 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-e9eedda2-5486-4aa5-a678-4b70456115c1 tempest-VolumesActionsTest-1828093912 None] Image conversion details: src /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980, size 1024.00 MB, duration 8.43 sec, destination /opt/stack/data/cinder/conversion/b992f70c-58b4-42f5-aca7-04b53f8fc980.temp_image.c4537d8e-9726-4409-9382-fc376e457b02qr4zc8fa.img {{(pid=86917) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:16:33 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-e9eedda2-5486-4aa5-a678-4b70456115c1 tempest-VolumesActionsTest-1828093912 None] Converted 1024.00 MB image at 121.45 MB/s Sep 28 17:16:33 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-e9eedda2-5486-4aa5-a678-4b70456115c1 tempest-VolumesActionsTest-1828093912 None] c4537d8e-9726-4409-9382-fc376e457b02 was raw, converting to qcow2 {{(pid=86917) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 28 17:16:33 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2654474-24c7-4530-9b84-f7f2e9d9d341]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e9eedda2-5486-4aa5-a678-4b70456115c1 tempest-VolumesActionsTest-1828093912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b992f70c-58b4-42f5-aca7-04b53f8fc980.temp_image.c4537d8e-9726-4409-9382-fc376e457b02qr4zc8fa.img {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:34 devstack sudo[95660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b992f70c-58b4-42f5-aca7-04b53f8fc980.temp_image.c4537d8e-9726-4409-9382-fc376e457b02qr4zc8fa.img Sep 28 17:16:34 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:34 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e9eedda2-5486-4aa5-a678-4b70456115c1 tempest-VolumesActionsTest-1828093912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b992f70c-58b4-42f5-aca7-04b53f8fc980.temp_image.c4537d8e-9726-4409-9382-fc376e457b02qr4zc8fa.img" returned: 0 in 0.504s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e9eedda2-5486-4aa5-a678-4b70456115c1 tempest-VolumesActionsTest-1828093912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b992f70c-58b4-42f5-aca7-04b53f8fc980.temp_image.c4537d8e-9726-4409-9382-fc376e457b02qr4zc8fa.img {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:34 devstack sudo[95664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b992f70c-58b4-42f5-aca7-04b53f8fc980.temp_image.c4537d8e-9726-4409-9382-fc376e457b02qr4zc8fa.img Sep 28 17:16:34 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:34 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e9eedda2-5486-4aa5-a678-4b70456115c1 tempest-VolumesActionsTest-1828093912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b992f70c-58b4-42f5-aca7-04b53f8fc980.temp_image.c4537d8e-9726-4409-9382-fc376e457b02qr4zc8fa.img" returned: 1 in 0.532s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e9eedda2-5486-4aa5-a678-4b70456115c1 tempest-VolumesActionsTest-1828093912 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b992f70c-58b4-42f5-aca7-04b53f8fc980.temp_image.c4537d8e-9726-4409-9382-fc376e457b02qr4zc8fa.img' failed. Not Retrying. {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:16:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e9eedda2-5486-4aa5-a678-4b70456115c1 tempest-VolumesActionsTest-1828093912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b992f70c-58b4-42f5-aca7-04b53f8fc980.temp_image.c4537d8e-9726-4409-9382-fc376e457b02qr4zc8fa.img /opt/stack/data/cinder/conversion/vol_upload_1bivu9dh {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:35 devstack sudo[95669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b992f70c-58b4-42f5-aca7-04b53f8fc980.temp_image.c4537d8e-9726-4409-9382-fc376e457b02qr4zc8fa.img /opt/stack/data/cinder/conversion/vol_upload_1bivu9dh Sep 28 17:16:35 devstack sudo[95669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:35 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9d0ad26-9588-475a-ae63-57cad0b6afd1 tempest-VolumesTransfersV357Test-1460105389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:35 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f9d0ad26-9588-475a-ae63-57cad0b6afd1 tempest-VolumesTransfersV357Test-1460105389 None] Flow 'volume_create_manager' (b624e732-5b7f-4263-ada7-3b10c8598166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:35 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f9d0ad26-9588-475a-ae63-57cad0b6afd1 tempest-VolumesTransfersV357Test-1460105389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31dcb57f-4e82-4e1c-addf-af902c53ec04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:35 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f9d0ad26-9588-475a-ae63-57cad0b6afd1 tempest-VolumesTransfersV357Test-1460105389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31dcb57f-4e82-4e1c-addf-af902c53ec04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1162878948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=040aee9d-3f9c-4d1c-9194-e905ee97f460,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02bc4e9347f341c08fac46e4947f1e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:35Z,use_quota=True,user_id='b2b7b32bfc86450783b9a701a0710832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:35 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f9d0ad26-9588-475a-ae63-57cad0b6afd1 tempest-VolumesTransfersV357Test-1460105389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7afbeeed-77fd-4432-b9f1-bc74e0557df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:35 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f9d0ad26-9588-475a-ae63-57cad0b6afd1 tempest-VolumesTransfersV357Test-1460105389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7afbeeed-77fd-4432-b9f1-bc74e0557df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:35 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f9d0ad26-9588-475a-ae63-57cad0b6afd1 tempest-VolumesTransfersV357Test-1460105389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0988b03-a5dc-4c35-970c-39381c08c48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:35 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f9d0ad26-9588-475a-ae63-57cad0b6afd1 tempest-VolumesTransfersV357Test-1460105389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0988b03-a5dc-4c35-970c-39381c08c48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '040aee9d-3f9c-4d1c-9194-e905ee97f460', 'volume_name': 'volume-040aee9d-3f9c-4d1c-9194-e905ee97f460', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:35 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f9d0ad26-9588-475a-ae63-57cad0b6afd1 tempest-VolumesTransfersV357Test-1460105389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c51b9d1a-9926-46db-89f5-1a432fe4329a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:35 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f9d0ad26-9588-475a-ae63-57cad0b6afd1 tempest-VolumesTransfersV357Test-1460105389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c51b9d1a-9926-46db-89f5-1a432fe4329a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:35 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f9d0ad26-9588-475a-ae63-57cad0b6afd1 tempest-VolumesTransfersV357Test-1460105389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a4df129-c638-44f8-ac12-aad784476314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:35 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-f9d0ad26-9588-475a-ae63-57cad0b6afd1 tempest-VolumesTransfersV357Test-1460105389 None] Volume 040aee9d-3f9c-4d1c-9194-e905ee97f460: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-040aee9d-3f9c-4d1c-9194-e905ee97f460', 'volume_size': 1} Sep 28 17:16:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f9d0ad26-9588-475a-ae63-57cad0b6afd1 tempest-VolumesTransfersV357Test-1460105389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:35 devstack sudo[95669]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e9eedda2-5486-4aa5-a678-4b70456115c1 tempest-VolumesActionsTest-1828093912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b992f70c-58b4-42f5-aca7-04b53f8fc980.temp_image.c4537d8e-9726-4409-9382-fc376e457b02qr4zc8fa.img /opt/stack/data/cinder/conversion/vol_upload_1bivu9dh" returned: 0 in 0.509s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:35 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-e9eedda2-5486-4aa5-a678-4b70456115c1 tempest-VolumesActionsTest-1828093912 None] Image conversion details: src /opt/stack/data/cinder/conversion/b992f70c-58b4-42f5-aca7-04b53f8fc980.temp_image.c4537d8e-9726-4409-9382-fc376e457b02qr4zc8fa.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_1bivu9dh {{(pid=86917) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:16:35 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-e9eedda2-5486-4aa5-a678-4b70456115c1 tempest-VolumesActionsTest-1828093912 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 28 17:16:35 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd3d796-e450-43c5-a8c5-e82bb00b72b4]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e9eedda2-5486-4aa5-a678-4b70456115c1 tempest-VolumesActionsTest-1828093912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_1bivu9dh {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:35 devstack sudo[95676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_1bivu9dh Sep 28 17:16:35 devstack sudo[95676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:35 devstack sudo[95676]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e9eedda2-5486-4aa5-a678-4b70456115c1 tempest-VolumesActionsTest-1828093912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_1bivu9dh" returned: 0 in 0.413s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e9eedda2-5486-4aa5-a678-4b70456115c1 tempest-VolumesActionsTest-1828093912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.241s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:37 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-e9eedda2-5486-4aa5-a678-4b70456115c1 tempest-VolumesActionsTest-1828093912 None] Uploaded volume to glance image-id: c4537d8e-9726-4409-9382-fc376e457b02. {{(pid=86917) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 17:16:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9832b4c4-dff0-491b-9156-c307d09682b1 tempest-AttachVolumeTestJSON-1638983725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.855s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:37 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-9832b4c4-dff0-491b-9156-c307d09682b1 tempest-AttachVolumeTestJSON-1638983725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1343559046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08d2b783-c1a4-4e37-8ce8-02755130b87c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c850ba8a5859455b92b280cb91ab5945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:22Z,use_quota=True,user_id='519c735893a8461bb5ca0169f6a5168c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:16:37 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-9832b4c4-dff0-491b-9156-c307d09682b1 tempest-AttachVolumeTestJSON-1638983725 None] Creating volume 08d2b783-c1a4-4e37-8ce8-02755130b87c {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:16:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9832b4c4-dff0-491b-9156-c307d09682b1 tempest-AttachVolumeTestJSON-1638983725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9832b4c4-dff0-491b-9156-c307d09682b1 tempest-AttachVolumeTestJSON-1638983725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:37 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-9832b4c4-dff0-491b-9156-c307d09682b1 tempest-AttachVolumeTestJSON-1638983725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:37 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-9832b4c4-dff0-491b-9156-c307d09682b1 tempest-AttachVolumeTestJSON-1638983725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9832b4c4-dff0-491b-9156-c307d09682b1 tempest-AttachVolumeTestJSON-1638983725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:37 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-9832b4c4-dff0-491b-9156-c307d09682b1 tempest-AttachVolumeTestJSON-1638983725 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:16:37 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-9832b4c4-dff0-491b-9156-c307d09682b1 tempest-AttachVolumeTestJSON-1638983725 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:16:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9832b4c4-dff0-491b-9156-c307d09682b1 tempest-AttachVolumeTestJSON-1638983725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-08d2b783-c1a4-4e37-8ce8-02755130b87c 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:37 devstack sudo[95681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-08d2b783-c1a4-4e37-8ce8-02755130b87c 1073741824 Sep 28 17:16:37 devstack sudo[95681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:37 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-e9eedda2-5486-4aa5-a678-4b70456115c1 tempest-VolumesActionsTest-1828093912 None] Copy volume to image completed successfully. Sep 28 17:16:38 devstack sudo[95681]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9832b4c4-dff0-491b-9156-c307d09682b1 tempest-AttachVolumeTestJSON-1638983725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-08d2b783-c1a4-4e37-8ce8-02755130b87c 1073741824" returned: 0 in 0.553s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9832b4c4-dff0-491b-9156-c307d09682b1 tempest-AttachVolumeTestJSON-1638983725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-08d2b783-c1a4-4e37-8ce8-02755130b87c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:38 devstack sudo[95687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-08d2b783-c1a4-4e37-8ce8-02755130b87c Sep 28 17:16:38 devstack sudo[95687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:38 devstack sudo[95687]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9832b4c4-dff0-491b-9156-c307d09682b1 tempest-AttachVolumeTestJSON-1638983725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-08d2b783-c1a4-4e37-8ce8-02755130b87c" returned: 0 in 0.351s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:38 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-9832b4c4-dff0-491b-9156-c307d09682b1 tempest-AttachVolumeTestJSON-1638983725 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:16:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9832b4c4-dff0-491b-9156-c307d09682b1 tempest-AttachVolumeTestJSON-1638983725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f9d0ad26-9588-475a-ae63-57cad0b6afd1 tempest-VolumesTransfersV357Test-1460105389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.470s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:38 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f9d0ad26-9588-475a-ae63-57cad0b6afd1 tempest-VolumesTransfersV357Test-1460105389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1162878948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=040aee9d-3f9c-4d1c-9194-e905ee97f460,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02bc4e9347f341c08fac46e4947f1e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:35Z,use_quota=True,user_id='b2b7b32bfc86450783b9a701a0710832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:16:38 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-f9d0ad26-9588-475a-ae63-57cad0b6afd1 tempest-VolumesTransfersV357Test-1460105389 None] Creating volume 040aee9d-3f9c-4d1c-9194-e905ee97f460 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:16:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f9d0ad26-9588-475a-ae63-57cad0b6afd1 tempest-VolumesTransfersV357Test-1460105389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f9d0ad26-9588-475a-ae63-57cad0b6afd1 tempest-VolumesTransfersV357Test-1460105389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:38 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f9d0ad26-9588-475a-ae63-57cad0b6afd1 tempest-VolumesTransfersV357Test-1460105389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:38 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f9d0ad26-9588-475a-ae63-57cad0b6afd1 tempest-VolumesTransfersV357Test-1460105389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f9d0ad26-9588-475a-ae63-57cad0b6afd1 tempest-VolumesTransfersV357Test-1460105389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:38 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f9d0ad26-9588-475a-ae63-57cad0b6afd1 tempest-VolumesTransfersV357Test-1460105389 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:16:38 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-f9d0ad26-9588-475a-ae63-57cad0b6afd1 tempest-VolumesTransfersV357Test-1460105389 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:16:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f9d0ad26-9588-475a-ae63-57cad0b6afd1 tempest-VolumesTransfersV357Test-1460105389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-040aee9d-3f9c-4d1c-9194-e905ee97f460 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:38 devstack sudo[95690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-040aee9d-3f9c-4d1c-9194-e905ee97f460 1073741824 Sep 28 17:16:38 devstack sudo[95690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9832b4c4-dff0-491b-9156-c307d09682b1 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7901e8c0-9d81-4acd-a68b-768ae77c2b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08d2b783-c1a4-4e37-8ce8-02755130b87c', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9832b4c4-dff0-491b-9156-c307d09682b1 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96dd0be4-e68d-4bb1-8f16-c08d5b3dfdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:38 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-9832b4c4-dff0-491b-9156-c307d09682b1 tempest-AttachVolumeTestJSON-1638983725 None] Volume volume-08d2b783-c1a4-4e37-8ce8-02755130b87c (08d2b783-c1a4-4e37-8ce8-02755130b87c): created successfully Sep 28 17:16:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9832b4c4-dff0-491b-9156-c307d09682b1 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96dd0be4-e68d-4bb1-8f16-c08d5b3dfdc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9832b4c4-dff0-491b-9156-c307d09682b1 tempest-AttachVolumeTestJSON-1638983725 None] Flow 'volume_create_manager' (5bf31c87-b700-4fea-9235-2cd6a6ce5169) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:38 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-9832b4c4-dff0-491b-9156-c307d09682b1 tempest-AttachVolumeTestJSON-1638983725 None] Created volume successfully. Sep 28 17:16:39 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-448ba3ac-8223-49c7-a919-7f1e55c379b7 tempest-VolumesActionsTest-1828093912 None] Acquiring lock "cinder-b992f70c-58b4-42f5-aca7-04b53f8fc980-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:39 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-448ba3ac-8223-49c7-a919-7f1e55c379b7 tempest-VolumesActionsTest-1828093912 None] Lock "cinder-b992f70c-58b4-42f5-aca7-04b53f8fc980-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:39 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-448ba3ac-8223-49c7-a919-7f1e55c379b7 tempest-VolumesActionsTest-1828093912 None] Acquiring lock "cinder-quobyte-b992f70c-58b4-42f5-aca7-04b53f8fc980" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:39 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-448ba3ac-8223-49c7-a919-7f1e55c379b7 tempest-VolumesActionsTest-1828093912 None] Lock "cinder-quobyte-b992f70c-58b4-42f5-aca7-04b53f8fc980" acquired by "delete_volume" :: waited 0.019s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:39 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9384d783-4ee9-4e5d-96ff-45ce25ceda1e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-448ba3ac-8223-49c7-a919-7f1e55c379b7 tempest-VolumesActionsTest-1828093912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:39 devstack sudo[95690]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f9d0ad26-9588-475a-ae63-57cad0b6afd1 tempest-VolumesTransfersV357Test-1460105389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-040aee9d-3f9c-4d1c-9194-e905ee97f460 1073741824" returned: 0 in 0.690s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f9d0ad26-9588-475a-ae63-57cad0b6afd1 tempest-VolumesTransfersV357Test-1460105389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-040aee9d-3f9c-4d1c-9194-e905ee97f460 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:39 devstack sudo[95697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-040aee9d-3f9c-4d1c-9194-e905ee97f460 Sep 28 17:16:39 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:39 devstack sudo[95696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980 Sep 28 17:16:39 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:39 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f9d0ad26-9588-475a-ae63-57cad0b6afd1 tempest-VolumesTransfersV357Test-1460105389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-040aee9d-3f9c-4d1c-9194-e905ee97f460" returned: 0 in 0.326s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:39 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f9d0ad26-9588-475a-ae63-57cad0b6afd1 tempest-VolumesTransfersV357Test-1460105389 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:16:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f9d0ad26-9588-475a-ae63-57cad0b6afd1 tempest-VolumesTransfersV357Test-1460105389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:39 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f9d0ad26-9588-475a-ae63-57cad0b6afd1 tempest-VolumesTransfersV357Test-1460105389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a4df129-c638-44f8-ac12-aad784476314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-040aee9d-3f9c-4d1c-9194-e905ee97f460', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:39 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f9d0ad26-9588-475a-ae63-57cad0b6afd1 tempest-VolumesTransfersV357Test-1460105389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a4d5378-e44a-4fe2-8f2e-818d1c424db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:39 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-f9d0ad26-9588-475a-ae63-57cad0b6afd1 tempest-VolumesTransfersV357Test-1460105389 None] Volume volume-040aee9d-3f9c-4d1c-9194-e905ee97f460 (040aee9d-3f9c-4d1c-9194-e905ee97f460): created successfully Sep 28 17:16:39 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f9d0ad26-9588-475a-ae63-57cad0b6afd1 tempest-VolumesTransfersV357Test-1460105389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a4d5378-e44a-4fe2-8f2e-818d1c424db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:39 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f9d0ad26-9588-475a-ae63-57cad0b6afd1 tempest-VolumesTransfersV357Test-1460105389 None] Flow 'volume_create_manager' (b624e732-5b7f-4263-ada7-3b10c8598166) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:39 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-f9d0ad26-9588-475a-ae63-57cad0b6afd1 tempest-VolumesTransfersV357Test-1460105389 None] Created volume successfully. Sep 28 17:16:40 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-448ba3ac-8223-49c7-a919-7f1e55c379b7 tempest-VolumesActionsTest-1828093912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980" returned: 0 in 0.618s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-448ba3ac-8223-49c7-a919-7f1e55c379b7 tempest-VolumesActionsTest-1828093912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:40 devstack sudo[95708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980 Sep 28 17:16:40 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:40 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-448ba3ac-8223-49c7-a919-7f1e55c379b7 tempest-VolumesActionsTest-1828093912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b992f70c-58b4-42f5-aca7-04b53f8fc980" returned: 0 in 0.365s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:40 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-448ba3ac-8223-49c7-a919-7f1e55c379b7 tempest-VolumesActionsTest-1828093912 None] Lock "cinder-quobyte-b992f70c-58b4-42f5-aca7-04b53f8fc980" released by "delete_volume" :: held 1.054s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:40 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-448ba3ac-8223-49c7-a919-7f1e55c379b7 tempest-VolumesActionsTest-1828093912 None] Created reservations ['83a2d02c-5bae-40af-8a85-3a163b5cc72b', 'b8a6ca3b-645d-4b01-89b0-3170a49673a5', 'd5bb05c8-8273-4a21-9174-44aaf27e9c24', '53c92098-0330-452a-b1c7-2c53aa304ea9'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-448ba3ac-8223-49c7-a919-7f1e55c379b7 tempest-VolumesActionsTest-1828093912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-448ba3ac-8223-49c7-a919-7f1e55c379b7 tempest-VolumesActionsTest-1828093912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:40 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-448ba3ac-8223-49c7-a919-7f1e55c379b7 tempest-VolumesActionsTest-1828093912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:40 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-448ba3ac-8223-49c7-a919-7f1e55c379b7 tempest-VolumesActionsTest-1828093912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-448ba3ac-8223-49c7-a919-7f1e55c379b7 tempest-VolumesActionsTest-1828093912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-448ba3ac-8223-49c7-a919-7f1e55c379b7 tempest-VolumesActionsTest-1828093912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:40 devstack sudo[95713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:16:40 devstack sudo[95713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:41 devstack sudo[95713]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-448ba3ac-8223-49c7-a919-7f1e55c379b7 tempest-VolumesActionsTest-1828093912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.477s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:41 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-448ba3ac-8223-49c7-a919-7f1e55c379b7 tempest-VolumesActionsTest-1828093912 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:16:41 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-448ba3ac-8223-49c7-a919-7f1e55c379b7 tempest-VolumesActionsTest-1828093912 None] Deleted volume successfully. Sep 28 17:16:41 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-448ba3ac-8223-49c7-a919-7f1e55c379b7 tempest-VolumesActionsTest-1828093912 None] Lock "cinder-b992f70c-58b4-42f5-aca7-04b53f8fc980-delete_volume" released by "delete_volume" :: held 1.953s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-87eb1084-ef7d-4780-adb9-d93cc3ceb8db req-78589a12-22be-4eb0-9588-08ede9427284 tempest-AttachVolumeTestJSON-1638983725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-87eb1084-ef7d-4780-adb9-d93cc3ceb8db req-78589a12-22be-4eb0-9588-08ede9427284 tempest-AttachVolumeTestJSON-1638983725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-87eb1084-ef7d-4780-adb9-d93cc3ceb8db req-78589a12-22be-4eb0-9588-08ede9427284 tempest-AttachVolumeTestJSON-1638983725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:41 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-87eb1084-ef7d-4780-adb9-d93cc3ceb8db req-78589a12-22be-4eb0-9588-08ede9427284 tempest-AttachVolumeTestJSON-1638983725 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069', 'name': 'volume-08d2b783-c1a4-4e37-8ce8-02755130b87c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a59c893b-587d-4a98-b5b7-145ae2893f63', 'enforce_multipath': True} {{(pid=86917) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:16:41 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-87eb1084-ef7d-4780-adb9-d93cc3ceb8db req-78589a12-22be-4eb0-9588-08ede9427284 tempest-AttachVolumeTestJSON-1638983725 None] attachment_update completed successfully. Sep 28 17:16:42 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-4cee6715-10d6-4243-8e11-e4421e6937f1 tempest-VolumesTransfersV357Test-2021043816 None] Transfer volume completed successfully. Sep 28 17:16:43 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0e635e44-039d-4eba-b645-0b39b0c42077 tempest-VolumesTransfersV357Test-184260223 None] Acquiring lock "cinder-040aee9d-3f9c-4d1c-9194-e905ee97f460-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:43 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0e635e44-039d-4eba-b645-0b39b0c42077 tempest-VolumesTransfersV357Test-184260223 None] Lock "cinder-040aee9d-3f9c-4d1c-9194-e905ee97f460-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:43 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0e635e44-039d-4eba-b645-0b39b0c42077 tempest-VolumesTransfersV357Test-184260223 None] Acquiring lock "cinder-quobyte-040aee9d-3f9c-4d1c-9194-e905ee97f460" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:43 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0e635e44-039d-4eba-b645-0b39b0c42077 tempest-VolumesTransfersV357Test-184260223 None] Lock "cinder-quobyte-040aee9d-3f9c-4d1c-9194-e905ee97f460" acquired by "delete_volume" :: waited 0.029s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:43 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a698326c-17db-480d-8e2f-35de21acc372]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0e635e44-039d-4eba-b645-0b39b0c42077 tempest-VolumesTransfersV357Test-184260223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-040aee9d-3f9c-4d1c-9194-e905ee97f460 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:43 devstack sudo[96143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-040aee9d-3f9c-4d1c-9194-e905ee97f460 Sep 28 17:16:43 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:43 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0e635e44-039d-4eba-b645-0b39b0c42077 tempest-VolumesTransfersV357Test-184260223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-040aee9d-3f9c-4d1c-9194-e905ee97f460" returned: 0 in 0.506s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0e635e44-039d-4eba-b645-0b39b0c42077 tempest-VolumesTransfersV357Test-184260223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-040aee9d-3f9c-4d1c-9194-e905ee97f460 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:43 devstack sudo[96149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-040aee9d-3f9c-4d1c-9194-e905ee97f460 Sep 28 17:16:43 devstack sudo[96149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:44 devstack sudo[96149]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0e635e44-039d-4eba-b645-0b39b0c42077 tempest-VolumesTransfersV357Test-184260223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-040aee9d-3f9c-4d1c-9194-e905ee97f460" returned: 0 in 0.620s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:44 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0e635e44-039d-4eba-b645-0b39b0c42077 tempest-VolumesTransfersV357Test-184260223 None] Lock "cinder-quobyte-040aee9d-3f9c-4d1c-9194-e905ee97f460" released by "delete_volume" :: held 1.207s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:44 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-0e635e44-039d-4eba-b645-0b39b0c42077 tempest-VolumesTransfersV357Test-184260223 None] Created reservations ['ad9277d6-5be1-444f-a2cd-9e7d1f79888c', '9880da42-82b5-47bf-9034-2f3ad89495f7', '74145762-4f40-4745-bfe0-a945c74eae4c', '6dcf59c9-5765-40f1-ad72-dfc5859aaf3f'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:44 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-c595d3ce-1432-4d65-b0f9-e4d64a19f161 tempest-AttachVolumeTestJSON-1638983725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c595d3ce-1432-4d65-b0f9-e4d64a19f161 tempest-AttachVolumeTestJSON-1638983725 None] Flow 'volume_create_manager' (7789d549-d23c-4e0f-8b1c-32407818626e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c595d3ce-1432-4d65-b0f9-e4d64a19f161 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29d439b4-94ff-4d9b-81c2-f7c08d094aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c595d3ce-1432-4d65-b0f9-e4d64a19f161 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29d439b4-94ff-4d9b-81c2-f7c08d094aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-789369128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f75ed8d6-3d7b-410d-95cf-aa24a0ce5fdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c850ba8a5859455b92b280cb91ab5945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:44Z,use_quota=True,user_id='519c735893a8461bb5ca0169f6a5168c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c595d3ce-1432-4d65-b0f9-e4d64a19f161 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d17b8260-0c38-4585-ae82-76c69d6760ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c595d3ce-1432-4d65-b0f9-e4d64a19f161 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d17b8260-0c38-4585-ae82-76c69d6760ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c595d3ce-1432-4d65-b0f9-e4d64a19f161 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a39f152-a49b-4748-8a20-1c8ab384ea03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c595d3ce-1432-4d65-b0f9-e4d64a19f161 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a39f152-a49b-4748-8a20-1c8ab384ea03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f75ed8d6-3d7b-410d-95cf-aa24a0ce5fdf', 'volume_name': 'volume-f75ed8d6-3d7b-410d-95cf-aa24a0ce5fdf', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c595d3ce-1432-4d65-b0f9-e4d64a19f161 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (073398a0-ea04-464f-b55c-a8bd845a2dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c595d3ce-1432-4d65-b0f9-e4d64a19f161 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (073398a0-ea04-464f-b55c-a8bd845a2dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c595d3ce-1432-4d65-b0f9-e4d64a19f161 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (622e9427-a6e1-4bd0-ac1a-78ee77993385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:44 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-c595d3ce-1432-4d65-b0f9-e4d64a19f161 tempest-AttachVolumeTestJSON-1638983725 None] Volume f75ed8d6-3d7b-410d-95cf-aa24a0ce5fdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f75ed8d6-3d7b-410d-95cf-aa24a0ce5fdf', 'volume_size': 1} Sep 28 17:16:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c595d3ce-1432-4d65-b0f9-e4d64a19f161 tempest-AttachVolumeTestJSON-1638983725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c595d3ce-1432-4d65-b0f9-e4d64a19f161 tempest-AttachVolumeTestJSON-1638983725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:44 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c595d3ce-1432-4d65-b0f9-e4d64a19f161 tempest-AttachVolumeTestJSON-1638983725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-789369128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f75ed8d6-3d7b-410d-95cf-aa24a0ce5fdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c850ba8a5859455b92b280cb91ab5945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:44Z,use_quota=True,user_id='519c735893a8461bb5ca0169f6a5168c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:16:44 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-c595d3ce-1432-4d65-b0f9-e4d64a19f161 tempest-AttachVolumeTestJSON-1638983725 None] Creating volume f75ed8d6-3d7b-410d-95cf-aa24a0ce5fdf {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:16:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c595d3ce-1432-4d65-b0f9-e4d64a19f161 tempest-AttachVolumeTestJSON-1638983725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c595d3ce-1432-4d65-b0f9-e4d64a19f161 tempest-AttachVolumeTestJSON-1638983725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:44 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c595d3ce-1432-4d65-b0f9-e4d64a19f161 tempest-AttachVolumeTestJSON-1638983725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:44 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c595d3ce-1432-4d65-b0f9-e4d64a19f161 tempest-AttachVolumeTestJSON-1638983725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c595d3ce-1432-4d65-b0f9-e4d64a19f161 tempest-AttachVolumeTestJSON-1638983725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:44 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c595d3ce-1432-4d65-b0f9-e4d64a19f161 tempest-AttachVolumeTestJSON-1638983725 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:16:44 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-c595d3ce-1432-4d65-b0f9-e4d64a19f161 tempest-AttachVolumeTestJSON-1638983725 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:16:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c595d3ce-1432-4d65-b0f9-e4d64a19f161 tempest-AttachVolumeTestJSON-1638983725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f75ed8d6-3d7b-410d-95cf-aa24a0ce5fdf 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:44 devstack sudo[96152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f75ed8d6-3d7b-410d-95cf-aa24a0ce5fdf 1073741824 Sep 28 17:16:44 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0e635e44-039d-4eba-b645-0b39b0c42077 tempest-VolumesTransfersV357Test-184260223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0e635e44-039d-4eba-b645-0b39b0c42077 tempest-VolumesTransfersV357Test-184260223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:44 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0e635e44-039d-4eba-b645-0b39b0c42077 tempest-VolumesTransfersV357Test-184260223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:44 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0e635e44-039d-4eba-b645-0b39b0c42077 tempest-VolumesTransfersV357Test-184260223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0e635e44-039d-4eba-b645-0b39b0c42077 tempest-VolumesTransfersV357Test-184260223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0e635e44-039d-4eba-b645-0b39b0c42077 tempest-VolumesTransfersV357Test-184260223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:44 devstack sudo[96155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:16:44 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:45 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0e635e44-039d-4eba-b645-0b39b0c42077 tempest-VolumesTransfersV357Test-184260223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.446s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:45 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-0e635e44-039d-4eba-b645-0b39b0c42077 tempest-VolumesTransfersV357Test-184260223 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:16:45 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-0e635e44-039d-4eba-b645-0b39b0c42077 tempest-VolumesTransfersV357Test-184260223 None] Deleted volume successfully. Sep 28 17:16:45 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0e635e44-039d-4eba-b645-0b39b0c42077 tempest-VolumesTransfersV357Test-184260223 None] Lock "cinder-040aee9d-3f9c-4d1c-9194-e905ee97f460-delete_volume" released by "delete_volume" :: held 2.199s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:45 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c595d3ce-1432-4d65-b0f9-e4d64a19f161 tempest-AttachVolumeTestJSON-1638983725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f75ed8d6-3d7b-410d-95cf-aa24a0ce5fdf 1073741824" returned: 0 in 0.723s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c595d3ce-1432-4d65-b0f9-e4d64a19f161 tempest-AttachVolumeTestJSON-1638983725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f75ed8d6-3d7b-410d-95cf-aa24a0ce5fdf {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:45 devstack sudo[96164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f75ed8d6-3d7b-410d-95cf-aa24a0ce5fdf Sep 28 17:16:45 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:45 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c595d3ce-1432-4d65-b0f9-e4d64a19f161 tempest-AttachVolumeTestJSON-1638983725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f75ed8d6-3d7b-410d-95cf-aa24a0ce5fdf" returned: 0 in 0.365s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c595d3ce-1432-4d65-b0f9-e4d64a19f161 tempest-AttachVolumeTestJSON-1638983725 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:16:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c595d3ce-1432-4d65-b0f9-e4d64a19f161 tempest-AttachVolumeTestJSON-1638983725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c595d3ce-1432-4d65-b0f9-e4d64a19f161 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (622e9427-a6e1-4bd0-ac1a-78ee77993385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f75ed8d6-3d7b-410d-95cf-aa24a0ce5fdf', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c595d3ce-1432-4d65-b0f9-e4d64a19f161 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19cbc6b-ec56-495a-8b0d-0c3e174ec677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:45 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-c595d3ce-1432-4d65-b0f9-e4d64a19f161 tempest-AttachVolumeTestJSON-1638983725 None] Volume volume-f75ed8d6-3d7b-410d-95cf-aa24a0ce5fdf (f75ed8d6-3d7b-410d-95cf-aa24a0ce5fdf): created successfully Sep 28 17:16:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c595d3ce-1432-4d65-b0f9-e4d64a19f161 tempest-AttachVolumeTestJSON-1638983725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19cbc6b-ec56-495a-8b0d-0c3e174ec677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c595d3ce-1432-4d65-b0f9-e4d64a19f161 tempest-AttachVolumeTestJSON-1638983725 None] Flow 'volume_create_manager' (7789d549-d23c-4e0f-8b1c-32407818626e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:45 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-c595d3ce-1432-4d65-b0f9-e4d64a19f161 tempest-AttachVolumeTestJSON-1638983725 None] Created volume successfully. Sep 28 17:16:46 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-5af1523b-0c46-4e49-9a32-f0b01ecdd6b2 tempest-VolumesTransfersV357Test-1460105389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5af1523b-0c46-4e49-9a32-f0b01ecdd6b2 tempest-VolumesTransfersV357Test-1460105389 None] Flow 'volume_create_manager' (e2dbf7f8-8a28-42f4-b8ef-7bdb50ac0603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5af1523b-0c46-4e49-9a32-f0b01ecdd6b2 tempest-VolumesTransfersV357Test-1460105389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcd5b1e4-3fc1-4f85-b630-98b4a904373f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5af1523b-0c46-4e49-9a32-f0b01ecdd6b2 tempest-VolumesTransfersV357Test-1460105389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcd5b1e4-3fc1-4f85-b630-98b4a904373f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1449415727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e198f741-5d5f-4cf7-a979-63909b0e4237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02bc4e9347f341c08fac46e4947f1e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:46Z,use_quota=True,user_id='b2b7b32bfc86450783b9a701a0710832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5af1523b-0c46-4e49-9a32-f0b01ecdd6b2 tempest-VolumesTransfersV357Test-1460105389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69cffeca-7495-4317-ab53-dc03a055ca0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5af1523b-0c46-4e49-9a32-f0b01ecdd6b2 tempest-VolumesTransfersV357Test-1460105389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69cffeca-7495-4317-ab53-dc03a055ca0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5af1523b-0c46-4e49-9a32-f0b01ecdd6b2 tempest-VolumesTransfersV357Test-1460105389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00188e93-b51a-4fc5-9c9a-37d2ea42bf33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5af1523b-0c46-4e49-9a32-f0b01ecdd6b2 tempest-VolumesTransfersV357Test-1460105389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00188e93-b51a-4fc5-9c9a-37d2ea42bf33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e198f741-5d5f-4cf7-a979-63909b0e4237', 'volume_name': 'volume-e198f741-5d5f-4cf7-a979-63909b0e4237', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5af1523b-0c46-4e49-9a32-f0b01ecdd6b2 tempest-VolumesTransfersV357Test-1460105389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd5e71e-27fc-4e5a-aa3f-d84532695839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5af1523b-0c46-4e49-9a32-f0b01ecdd6b2 tempest-VolumesTransfersV357Test-1460105389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd5e71e-27fc-4e5a-aa3f-d84532695839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5af1523b-0c46-4e49-9a32-f0b01ecdd6b2 tempest-VolumesTransfersV357Test-1460105389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4985037-3445-4ad0-b4c1-56d31248b792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:46 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-5af1523b-0c46-4e49-9a32-f0b01ecdd6b2 tempest-VolumesTransfersV357Test-1460105389 None] Volume e198f741-5d5f-4cf7-a979-63909b0e4237: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e198f741-5d5f-4cf7-a979-63909b0e4237', 'volume_size': 1} Sep 28 17:16:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5af1523b-0c46-4e49-9a32-f0b01ecdd6b2 tempest-VolumesTransfersV357Test-1460105389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5af1523b-0c46-4e49-9a32-f0b01ecdd6b2 tempest-VolumesTransfersV357Test-1460105389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:46 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-5af1523b-0c46-4e49-9a32-f0b01ecdd6b2 tempest-VolumesTransfersV357Test-1460105389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1449415727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e198f741-5d5f-4cf7-a979-63909b0e4237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02bc4e9347f341c08fac46e4947f1e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:46Z,use_quota=True,user_id='b2b7b32bfc86450783b9a701a0710832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:16:46 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-5af1523b-0c46-4e49-9a32-f0b01ecdd6b2 tempest-VolumesTransfersV357Test-1460105389 None] Creating volume e198f741-5d5f-4cf7-a979-63909b0e4237 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:16:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5af1523b-0c46-4e49-9a32-f0b01ecdd6b2 tempest-VolumesTransfersV357Test-1460105389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5af1523b-0c46-4e49-9a32-f0b01ecdd6b2 tempest-VolumesTransfersV357Test-1460105389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:46 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-5af1523b-0c46-4e49-9a32-f0b01ecdd6b2 tempest-VolumesTransfersV357Test-1460105389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:46 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-5af1523b-0c46-4e49-9a32-f0b01ecdd6b2 tempest-VolumesTransfersV357Test-1460105389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5af1523b-0c46-4e49-9a32-f0b01ecdd6b2 tempest-VolumesTransfersV357Test-1460105389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:46 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-5af1523b-0c46-4e49-9a32-f0b01ecdd6b2 tempest-VolumesTransfersV357Test-1460105389 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:16:46 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-5af1523b-0c46-4e49-9a32-f0b01ecdd6b2 tempest-VolumesTransfersV357Test-1460105389 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:16:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5af1523b-0c46-4e49-9a32-f0b01ecdd6b2 tempest-VolumesTransfersV357Test-1460105389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e198f741-5d5f-4cf7-a979-63909b0e4237 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:46 devstack sudo[96167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e198f741-5d5f-4cf7-a979-63909b0e4237 1073741824 Sep 28 17:16:46 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:47 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5af1523b-0c46-4e49-9a32-f0b01ecdd6b2 tempest-VolumesTransfersV357Test-1460105389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e198f741-5d5f-4cf7-a979-63909b0e4237 1073741824" returned: 0 in 0.863s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5af1523b-0c46-4e49-9a32-f0b01ecdd6b2 tempest-VolumesTransfersV357Test-1460105389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e198f741-5d5f-4cf7-a979-63909b0e4237 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:47 devstack sudo[96180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e198f741-5d5f-4cf7-a979-63909b0e4237 Sep 28 17:16:47 devstack sudo[96180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-5532048b-96b2-4dfa-a5fe-a627e3dbdb14 req-4f323e2b-27fa-43c3-ada0-ab4f28d660db tempest-AttachVolumeTestJSON-1638983725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:48 devstack sudo[96180]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5af1523b-0c46-4e49-9a32-f0b01ecdd6b2 tempest-VolumesTransfersV357Test-1460105389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e198f741-5d5f-4cf7-a979-63909b0e4237" returned: 0 in 0.557s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:48 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-5af1523b-0c46-4e49-9a32-f0b01ecdd6b2 tempest-VolumesTransfersV357Test-1460105389 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:16:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5af1523b-0c46-4e49-9a32-f0b01ecdd6b2 tempest-VolumesTransfersV357Test-1460105389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-5532048b-96b2-4dfa-a5fe-a627e3dbdb14 req-4f323e2b-27fa-43c3-ada0-ab4f28d660db tempest-AttachVolumeTestJSON-1638983725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.164s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5af1523b-0c46-4e49-9a32-f0b01ecdd6b2 tempest-VolumesTransfersV357Test-1460105389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4985037-3445-4ad0-b4c1-56d31248b792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e198f741-5d5f-4cf7-a979-63909b0e4237', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5af1523b-0c46-4e49-9a32-f0b01ecdd6b2 tempest-VolumesTransfersV357Test-1460105389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (890ef973-092a-4ff8-8345-4a358ccb3f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-5532048b-96b2-4dfa-a5fe-a627e3dbdb14 req-4f323e2b-27fa-43c3-ada0-ab4f28d660db tempest-AttachVolumeTestJSON-1638983725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.078s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:48 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-5af1523b-0c46-4e49-9a32-f0b01ecdd6b2 tempest-VolumesTransfersV357Test-1460105389 None] Volume volume-e198f741-5d5f-4cf7-a979-63909b0e4237 (e198f741-5d5f-4cf7-a979-63909b0e4237): created successfully Sep 28 17:16:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5af1523b-0c46-4e49-9a32-f0b01ecdd6b2 tempest-VolumesTransfersV357Test-1460105389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (890ef973-092a-4ff8-8345-4a358ccb3f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5af1523b-0c46-4e49-9a32-f0b01ecdd6b2 tempest-VolumesTransfersV357Test-1460105389 None] Flow 'volume_create_manager' (e2dbf7f8-8a28-42f4-b8ef-7bdb50ac0603) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:48 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-5af1523b-0c46-4e49-9a32-f0b01ecdd6b2 tempest-VolumesTransfersV357Test-1460105389 None] Created volume successfully. Sep 28 17:16:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-5532048b-96b2-4dfa-a5fe-a627e3dbdb14 req-4f323e2b-27fa-43c3-ada0-ab4f28d660db tempest-AttachVolumeTestJSON-1638983725 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069', 'name': 'volume-f75ed8d6-3d7b-410d-95cf-aa24a0ce5fdf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ac561e11-0710-4cbe-a8cd-aaa63f894142', 'enforce_multipath': True} {{(pid=86917) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:16:48 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-5532048b-96b2-4dfa-a5fe-a627e3dbdb14 req-4f323e2b-27fa-43c3-ada0-ab4f28d660db tempest-AttachVolumeTestJSON-1638983725 None] attachment_update completed successfully. Sep 28 17:16:49 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-93036e1a-2a51-4469-994d-21461a5c03b4 tempest-VolumesTransfersV357Test-184260223 None] Acquiring lock "cinder-e198f741-5d5f-4cf7-a979-63909b0e4237-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:49 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-93036e1a-2a51-4469-994d-21461a5c03b4 tempest-VolumesTransfersV357Test-184260223 None] Lock "cinder-e198f741-5d5f-4cf7-a979-63909b0e4237-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:49 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-93036e1a-2a51-4469-994d-21461a5c03b4 tempest-VolumesTransfersV357Test-184260223 None] Acquiring lock "cinder-quobyte-e198f741-5d5f-4cf7-a979-63909b0e4237" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:49 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-93036e1a-2a51-4469-994d-21461a5c03b4 tempest-VolumesTransfersV357Test-184260223 None] Lock "cinder-quobyte-e198f741-5d5f-4cf7-a979-63909b0e4237" acquired by "delete_volume" :: waited 0.020s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:49 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[689358b5-80e1-49b2-8029-a2982eb37fca]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-93036e1a-2a51-4469-994d-21461a5c03b4 tempest-VolumesTransfersV357Test-184260223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e198f741-5d5f-4cf7-a979-63909b0e4237 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:16:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:49 devstack sudo[96197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:16:49 devstack sudo[96197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:49 devstack sudo[96196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e198f741-5d5f-4cf7-a979-63909b0e4237 Sep 28 17:16:49 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:50 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-93036e1a-2a51-4469-994d-21461a5c03b4 tempest-VolumesTransfersV357Test-184260223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e198f741-5d5f-4cf7-a979-63909b0e4237" returned: 0 in 0.813s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-93036e1a-2a51-4469-994d-21461a5c03b4 tempest-VolumesTransfersV357Test-184260223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e198f741-5d5f-4cf7-a979-63909b0e4237 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:50 devstack sudo[96205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e198f741-5d5f-4cf7-a979-63909b0e4237 Sep 28 17:16:50 devstack sudo[96205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:50 devstack sudo[96197]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.767s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:50 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:16:50 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager._thread_info {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:16:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread count: 28 {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:16:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread info: [<_MainThread(MainThread, started 132915553284224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:16:50 devstack sudo[96205]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-93036e1a-2a51-4469-994d-21461a5c03b4 tempest-VolumesTransfersV357Test-184260223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e198f741-5d5f-4cf7-a979-63909b0e4237" returned: 0 in 0.446s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:50 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-93036e1a-2a51-4469-994d-21461a5c03b4 tempest-VolumesTransfersV357Test-184260223 None] Lock "cinder-quobyte-e198f741-5d5f-4cf7-a979-63909b0e4237" released by "delete_volume" :: held 1.349s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:50 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-93036e1a-2a51-4469-994d-21461a5c03b4 tempest-VolumesTransfersV357Test-184260223 None] Created reservations ['41f5a514-85d2-4210-a25c-ce8ef6a5cda8', '05027141-9eb8-4f1e-9c51-0dc21993df35', '15012eb7-0905-4a55-be58-b73d719a9be3', '70e78f5d-c14c-4bcb-9988-27d7d3590a5e'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-93036e1a-2a51-4469-994d-21461a5c03b4 tempest-VolumesTransfersV357Test-184260223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-93036e1a-2a51-4469-994d-21461a5c03b4 tempest-VolumesTransfersV357Test-184260223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:50 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-93036e1a-2a51-4469-994d-21461a5c03b4 tempest-VolumesTransfersV357Test-184260223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:51 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-93036e1a-2a51-4469-994d-21461a5c03b4 tempest-VolumesTransfersV357Test-184260223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-93036e1a-2a51-4469-994d-21461a5c03b4 tempest-VolumesTransfersV357Test-184260223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-93036e1a-2a51-4469-994d-21461a5c03b4 tempest-VolumesTransfersV357Test-184260223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:51 devstack sudo[96211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:16:51 devstack sudo[96211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:51 devstack sudo[96211]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-93036e1a-2a51-4469-994d-21461a5c03b4 tempest-VolumesTransfersV357Test-184260223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.503s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:51 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-93036e1a-2a51-4469-994d-21461a5c03b4 tempest-VolumesTransfersV357Test-184260223 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:16:51 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-93036e1a-2a51-4469-994d-21461a5c03b4 tempest-VolumesTransfersV357Test-184260223 None] Deleted volume successfully. Sep 28 17:16:51 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-93036e1a-2a51-4469-994d-21461a5c03b4 tempest-VolumesTransfersV357Test-184260223 None] Lock "cinder-e198f741-5d5f-4cf7-a979-63909b0e4237-delete_volume" released by "delete_volume" :: held 2.332s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:51 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-d9a23d5e-0cc7-4f7c-ad97-cde527a1758f req-613b4a6d-7f5a-4130-9304-bc3f6d811e1b tempest-AttachVolumeTestJSON-1638983725 None] Terminate volume connection completed successfully. Sep 28 17:16:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-d9a23d5e-0cc7-4f7c-ad97-cde527a1758f req-613b4a6d-7f5a-4130-9304-bc3f6d811e1b tempest-AttachVolumeTestJSON-1638983725 None] Deleting attachment a59c893b-587d-4a98-b5b7-145ae2893f63. {{(pid=86917) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:16:53 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-182d1ab7-06a0-4db4-9403-f14d73afa4eb req-b7a849c5-ac99-4270-b856-4ee30e31ce80 tempest-AttachVolumeTestJSON-1638983725 None] Terminate volume connection completed successfully. Sep 28 17:16:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-182d1ab7-06a0-4db4-9403-f14d73afa4eb req-b7a849c5-ac99-4270-b856-4ee30e31ce80 tempest-AttachVolumeTestJSON-1638983725 None] Deleting attachment ac561e11-0710-4cbe-a8cd-aaa63f894142. {{(pid=86917) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:17:03 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=61,cinder:UPDATE=71,cinder:DELETE=8,cinder:INSERT=14 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:17:03 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-b80d73d2-3cc3-4ad3-971f-8b4ca08e5dd8 tempest-VolumesCloneTest-1473385021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:17:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b80d73d2-3cc3-4ad3-971f-8b4ca08e5dd8 tempest-VolumesCloneTest-1473385021 None] Flow 'volume_create_manager' (e910525e-3fd5-4e27-90be-571d21eee8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b80d73d2-3cc3-4ad3-971f-8b4ca08e5dd8 tempest-VolumesCloneTest-1473385021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58d4e4d8-8dd4-4a01-bd0f-77cd269b2dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b80d73d2-3cc3-4ad3-971f-8b4ca08e5dd8 tempest-VolumesCloneTest-1473385021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58d4e4d8-8dd4-4a01-bd0f-77cd269b2dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1422443459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=082ccd45-6daf-4ce9-ac1a-ad79fb8374c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6f533db6bf34a2f81bfe89dc0e0c2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:04Z,use_quota=True,user_id='61851b50ad5d4c2ebd141986edd61776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b80d73d2-3cc3-4ad3-971f-8b4ca08e5dd8 tempest-VolumesCloneTest-1473385021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f55dd8b2-4c20-49ef-80ca-3bd71ceed7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b80d73d2-3cc3-4ad3-971f-8b4ca08e5dd8 tempest-VolumesCloneTest-1473385021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f55dd8b2-4c20-49ef-80ca-3bd71ceed7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b80d73d2-3cc3-4ad3-971f-8b4ca08e5dd8 tempest-VolumesCloneTest-1473385021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65918c73-531d-4edb-8d4a-8fa0ae5baac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b80d73d2-3cc3-4ad3-971f-8b4ca08e5dd8 tempest-VolumesCloneTest-1473385021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65918c73-531d-4edb-8d4a-8fa0ae5baac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '082ccd45-6daf-4ce9-ac1a-ad79fb8374c9', 'volume_name': 'volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b80d73d2-3cc3-4ad3-971f-8b4ca08e5dd8 tempest-VolumesCloneTest-1473385021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a24040b9-9a63-4217-bd86-e03b497a6c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b80d73d2-3cc3-4ad3-971f-8b4ca08e5dd8 tempest-VolumesCloneTest-1473385021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a24040b9-9a63-4217-bd86-e03b497a6c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b80d73d2-3cc3-4ad3-971f-8b4ca08e5dd8 tempest-VolumesCloneTest-1473385021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bccdc0b5-05d1-4df5-8eeb-84a365783908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:03 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-b80d73d2-3cc3-4ad3-971f-8b4ca08e5dd8 tempest-VolumesCloneTest-1473385021 None] Volume 082ccd45-6daf-4ce9-ac1a-ad79fb8374c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9', 'volume_size': 1} Sep 28 17:17:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b80d73d2-3cc3-4ad3-971f-8b4ca08e5dd8 tempest-VolumesCloneTest-1473385021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b80d73d2-3cc3-4ad3-971f-8b4ca08e5dd8 tempest-VolumesCloneTest-1473385021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:03 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b80d73d2-3cc3-4ad3-971f-8b4ca08e5dd8 tempest-VolumesCloneTest-1473385021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1422443459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=082ccd45-6daf-4ce9-ac1a-ad79fb8374c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6f533db6bf34a2f81bfe89dc0e0c2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:04Z,use_quota=True,user_id='61851b50ad5d4c2ebd141986edd61776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:17:03 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-b80d73d2-3cc3-4ad3-971f-8b4ca08e5dd8 tempest-VolumesCloneTest-1473385021 None] Creating volume 082ccd45-6daf-4ce9-ac1a-ad79fb8374c9 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:17:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b80d73d2-3cc3-4ad3-971f-8b4ca08e5dd8 tempest-VolumesCloneTest-1473385021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b80d73d2-3cc3-4ad3-971f-8b4ca08e5dd8 tempest-VolumesCloneTest-1473385021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:03 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b80d73d2-3cc3-4ad3-971f-8b4ca08e5dd8 tempest-VolumesCloneTest-1473385021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:03 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b80d73d2-3cc3-4ad3-971f-8b4ca08e5dd8 tempest-VolumesCloneTest-1473385021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b80d73d2-3cc3-4ad3-971f-8b4ca08e5dd8 tempest-VolumesCloneTest-1473385021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:03 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b80d73d2-3cc3-4ad3-971f-8b4ca08e5dd8 tempest-VolumesCloneTest-1473385021 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:17:03 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-b80d73d2-3cc3-4ad3-971f-8b4ca08e5dd8 tempest-VolumesCloneTest-1473385021 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:17:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b80d73d2-3cc3-4ad3-971f-8b4ca08e5dd8 tempest-VolumesCloneTest-1473385021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:04 devstack sudo[96283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9 1073741824 Sep 28 17:17:04 devstack sudo[96283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:04 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1362abb2-70b5-4c0d-b336-372488063171 tempest-AttachVolumeTestJSON-1638983725 None] Acquiring lock "cinder-f75ed8d6-3d7b-410d-95cf-aa24a0ce5fdf-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:04 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1362abb2-70b5-4c0d-b336-372488063171 tempest-AttachVolumeTestJSON-1638983725 None] Lock "cinder-f75ed8d6-3d7b-410d-95cf-aa24a0ce5fdf-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:04 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1362abb2-70b5-4c0d-b336-372488063171 tempest-AttachVolumeTestJSON-1638983725 None] Acquiring lock "cinder-quobyte-f75ed8d6-3d7b-410d-95cf-aa24a0ce5fdf" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:04 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1362abb2-70b5-4c0d-b336-372488063171 tempest-AttachVolumeTestJSON-1638983725 None] Lock "cinder-quobyte-f75ed8d6-3d7b-410d-95cf-aa24a0ce5fdf" acquired by "delete_volume" :: waited 0.037s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:04 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b5e179-f535-4a1b-836b-aa31a095e2c6]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1362abb2-70b5-4c0d-b336-372488063171 tempest-AttachVolumeTestJSON-1638983725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f75ed8d6-3d7b-410d-95cf-aa24a0ce5fdf {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:04 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f75ed8d6-3d7b-410d-95cf-aa24a0ce5fdf Sep 28 17:17:04 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:04 devstack sudo[96283]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b80d73d2-3cc3-4ad3-971f-8b4ca08e5dd8 tempest-VolumesCloneTest-1473385021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9 1073741824" returned: 0 in 0.863s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b80d73d2-3cc3-4ad3-971f-8b4ca08e5dd8 tempest-VolumesCloneTest-1473385021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:04 devstack sudo[96292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9 Sep 28 17:17:04 devstack sudo[96292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:05 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1362abb2-70b5-4c0d-b336-372488063171 tempest-AttachVolumeTestJSON-1638983725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f75ed8d6-3d7b-410d-95cf-aa24a0ce5fdf" returned: 0 in 0.637s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1362abb2-70b5-4c0d-b336-372488063171 tempest-AttachVolumeTestJSON-1638983725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f75ed8d6-3d7b-410d-95cf-aa24a0ce5fdf {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:05 devstack sudo[96296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f75ed8d6-3d7b-410d-95cf-aa24a0ce5fdf Sep 28 17:17:05 devstack sudo[96296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:05 devstack sudo[96292]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b80d73d2-3cc3-4ad3-971f-8b4ca08e5dd8 tempest-VolumesCloneTest-1473385021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9" returned: 0 in 0.454s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b80d73d2-3cc3-4ad3-971f-8b4ca08e5dd8 tempest-VolumesCloneTest-1473385021 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:17:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b80d73d2-3cc3-4ad3-971f-8b4ca08e5dd8 tempest-VolumesCloneTest-1473385021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b80d73d2-3cc3-4ad3-971f-8b4ca08e5dd8 tempest-VolumesCloneTest-1473385021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bccdc0b5-05d1-4df5-8eeb-84a365783908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b80d73d2-3cc3-4ad3-971f-8b4ca08e5dd8 tempest-VolumesCloneTest-1473385021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8b9e407-0601-4606-af3a-65859eb73eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:05 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-b80d73d2-3cc3-4ad3-971f-8b4ca08e5dd8 tempest-VolumesCloneTest-1473385021 None] Volume volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9 (082ccd45-6daf-4ce9-ac1a-ad79fb8374c9): created successfully Sep 28 17:17:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b80d73d2-3cc3-4ad3-971f-8b4ca08e5dd8 tempest-VolumesCloneTest-1473385021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8b9e407-0601-4606-af3a-65859eb73eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b80d73d2-3cc3-4ad3-971f-8b4ca08e5dd8 tempest-VolumesCloneTest-1473385021 None] Flow 'volume_create_manager' (e910525e-3fd5-4e27-90be-571d21eee8d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:05 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-b80d73d2-3cc3-4ad3-971f-8b4ca08e5dd8 tempest-VolumesCloneTest-1473385021 None] Created volume successfully. Sep 28 17:17:05 devstack sudo[96296]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1362abb2-70b5-4c0d-b336-372488063171 tempest-AttachVolumeTestJSON-1638983725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f75ed8d6-3d7b-410d-95cf-aa24a0ce5fdf" returned: 0 in 0.476s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:05 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1362abb2-70b5-4c0d-b336-372488063171 tempest-AttachVolumeTestJSON-1638983725 None] Lock "cinder-quobyte-f75ed8d6-3d7b-410d-95cf-aa24a0ce5fdf" released by "delete_volume" :: held 1.185s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:05 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-1362abb2-70b5-4c0d-b336-372488063171 tempest-AttachVolumeTestJSON-1638983725 None] Created reservations ['05a7ee7c-6384-4914-8576-40606fee5a43', 'af96c063-063b-4537-9502-cd8af6142b81', 'd3c4583c-5aa6-452e-bdbd-38e2e458449d', '5d6ce5fd-fdb2-4035-8b04-50f28e1c484c'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1362abb2-70b5-4c0d-b336-372488063171 tempest-AttachVolumeTestJSON-1638983725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1362abb2-70b5-4c0d-b336-372488063171 tempest-AttachVolumeTestJSON-1638983725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-1362abb2-70b5-4c0d-b336-372488063171 tempest-AttachVolumeTestJSON-1638983725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-1362abb2-70b5-4c0d-b336-372488063171 tempest-AttachVolumeTestJSON-1638983725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1362abb2-70b5-4c0d-b336-372488063171 tempest-AttachVolumeTestJSON-1638983725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1362abb2-70b5-4c0d-b336-372488063171 tempest-AttachVolumeTestJSON-1638983725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:05 devstack sudo[96300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:17:05 devstack sudo[96300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:06 devstack sudo[96300]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1362abb2-70b5-4c0d-b336-372488063171 tempest-AttachVolumeTestJSON-1638983725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.563s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:06 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-1362abb2-70b5-4c0d-b336-372488063171 tempest-AttachVolumeTestJSON-1638983725 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:06 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-1362abb2-70b5-4c0d-b336-372488063171 tempest-AttachVolumeTestJSON-1638983725 None] Deleted volume successfully. Sep 28 17:17:06 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1362abb2-70b5-4c0d-b336-372488063171 tempest-AttachVolumeTestJSON-1638983725 None] Lock "cinder-f75ed8d6-3d7b-410d-95cf-aa24a0ce5fdf-delete_volume" released by "delete_volume" :: held 2.242s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:06 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d9c3a581-0709-4410-9575-3e556779f026 tempest-AttachVolumeTestJSON-1638983725 None] Acquiring lock "cinder-08d2b783-c1a4-4e37-8ce8-02755130b87c-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:06 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d9c3a581-0709-4410-9575-3e556779f026 tempest-AttachVolumeTestJSON-1638983725 None] Lock "cinder-08d2b783-c1a4-4e37-8ce8-02755130b87c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:06 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d9c3a581-0709-4410-9575-3e556779f026 tempest-AttachVolumeTestJSON-1638983725 None] Acquiring lock "cinder-quobyte-08d2b783-c1a4-4e37-8ce8-02755130b87c" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:06 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d9c3a581-0709-4410-9575-3e556779f026 tempest-AttachVolumeTestJSON-1638983725 None] Lock "cinder-quobyte-08d2b783-c1a4-4e37-8ce8-02755130b87c" acquired by "delete_volume" :: waited 0.032s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:06 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3732e406-a331-49ce-ac58-17b31a1eef3b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d9c3a581-0709-4410-9575-3e556779f026 tempest-AttachVolumeTestJSON-1638983725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-08d2b783-c1a4-4e37-8ce8-02755130b87c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:07 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:17:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Flow 'volume_create_manager' (2c1516e0-a208-404b-a8eb-072cdf5c9547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2060e4a6-d33c-43ac-9059-28b6cd9f1ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:07 devstack sudo[96303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-08d2b783-c1a4-4e37-8ce8-02755130b87c Sep 28 17:17:07 devstack sudo[96303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2060e4a6-d33c-43ac-9059-28b6cd9f1ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1499994147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=667e84fb-35aa-455f-96d6-3edab3d1df32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6f533db6bf34a2f81bfe89dc0e0c2cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=082ccd45-6daf-4ce9-ac1a-ad79fb8374c9,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:07Z,use_quota=True,user_id='61851b50ad5d4c2ebd141986edd61776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a182346d-98f8-473f-b7f2-79c2addda0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a182346d-98f8-473f-b7f2-79c2addda0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e3a6609-ff2f-4650-aff4-446a102fbe05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e3a6609-ff2f-4650-aff4-446a102fbe05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '667e84fb-35aa-455f-96d6-3edab3d1df32', 'volume_name': 'volume-667e84fb-35aa-455f-96d6-3edab3d1df32', 'volume_size': 2, 'source_volid': '082ccd45-6daf-4ce9-ac1a-ad79fb8374c9', 'source_volstatus': 'available'}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be5891a1-257d-483a-a7f6-4c02498f536c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be5891a1-257d-483a-a7f6-4c02498f536c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4778996d-7025-4c70-b44f-f5da9b98bb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:07 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Volume 667e84fb-35aa-455f-96d6-3edab3d1df32: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-667e84fb-35aa-455f-96d6-3edab3d1df32', 'volume_size': 2, 'source_volid': '082ccd45-6daf-4ce9-ac1a-ad79fb8374c9', 'source_volstatus': 'available'} Sep 28 17:17:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:07 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Cloning volume 082ccd45-6daf-4ce9-ac1a-ad79fb8374c9 to volume 667e84fb-35aa-455f-96d6-3edab3d1df32 Sep 28 17:17:07 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Creating offline snapshot a231f5d0-e4d4-4290-9962-0e1e28e9ace3 of volume 082ccd45-6daf-4ce9-ac1a-ad79fb8374c9 {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:17:07 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7562538c-8766-40ab-b93e-c3d897bc91b3]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:07 devstack sudo[96305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9 Sep 28 17:17:07 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:07 devstack sudo[96303]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d9c3a581-0709-4410-9575-3e556779f026 tempest-AttachVolumeTestJSON-1638983725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-08d2b783-c1a4-4e37-8ce8-02755130b87c" returned: 0 in 0.730s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d9c3a581-0709-4410-9575-3e556779f026 tempest-AttachVolumeTestJSON-1638983725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-08d2b783-c1a4-4e37-8ce8-02755130b87c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:07 devstack sudo[96311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-08d2b783-c1a4-4e37-8ce8-02755130b87c Sep 28 17:17:07 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:08 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9" returned: 0 in 0.611s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9.a231f5d0-e4d4-4290-9962-0e1e28e9ace3 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:08 devstack sudo[96316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9.a231f5d0-e4d4-4290-9962-0e1e28e9ace3 1G Sep 28 17:17:08 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:08 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d9c3a581-0709-4410-9575-3e556779f026 tempest-AttachVolumeTestJSON-1638983725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-08d2b783-c1a4-4e37-8ce8-02755130b87c" returned: 0 in 0.575s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:08 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d9c3a581-0709-4410-9575-3e556779f026 tempest-AttachVolumeTestJSON-1638983725 None] Lock "cinder-quobyte-08d2b783-c1a4-4e37-8ce8-02755130b87c" released by "delete_volume" :: held 1.392s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:08 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-d9c3a581-0709-4410-9575-3e556779f026 tempest-AttachVolumeTestJSON-1638983725 None] Created reservations ['544bd762-daad-4314-a2c3-35fbb048c0fd', '1aa1e7c9-fa74-4441-bc05-145c8e354211', '5ae835b8-cb6d-4274-a969-9f0846910d3c', '974628b2-2b15-4a93-9b9d-67edfcb6899a'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d9c3a581-0709-4410-9575-3e556779f026 tempest-AttachVolumeTestJSON-1638983725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d9c3a581-0709-4410-9575-3e556779f026 tempest-AttachVolumeTestJSON-1638983725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:08 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d9c3a581-0709-4410-9575-3e556779f026 tempest-AttachVolumeTestJSON-1638983725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:08 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d9c3a581-0709-4410-9575-3e556779f026 tempest-AttachVolumeTestJSON-1638983725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d9c3a581-0709-4410-9575-3e556779f026 tempest-AttachVolumeTestJSON-1638983725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d9c3a581-0709-4410-9575-3e556779f026 tempest-AttachVolumeTestJSON-1638983725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:08 devstack sudo[96324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:17:08 devstack sudo[96324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:08 devstack sudo[96316]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9.a231f5d0-e4d4-4290-9962-0e1e28e9ace3 1G" returned: 0 in 0.844s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9.a231f5d0-e4d4-4290-9962-0e1e28e9ace3 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:08 devstack sudo[96326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9.a231f5d0-e4d4-4290-9962-0e1e28e9ace3 Sep 28 17:17:08 devstack sudo[96326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:09 devstack sudo[96324]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d9c3a581-0709-4410-9575-3e556779f026 tempest-AttachVolumeTestJSON-1638983725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.503s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:09 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-d9c3a581-0709-4410-9575-3e556779f026 tempest-AttachVolumeTestJSON-1638983725 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:09 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-d9c3a581-0709-4410-9575-3e556779f026 tempest-AttachVolumeTestJSON-1638983725 None] Deleted volume successfully. Sep 28 17:17:09 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d9c3a581-0709-4410-9575-3e556779f026 tempest-AttachVolumeTestJSON-1638983725 None] Lock "cinder-08d2b783-c1a4-4e37-8ce8-02755130b87c-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:09 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a6f28789-2531-4edc-adcb-0df9197c9179 tempest-AttachVolumeTestJSON-1638983725 None] Acquiring lock "cinder-6b3cb530-5362-49ee-a7dd-30369961399f-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:09 devstack sudo[96326]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9.a231f5d0-e4d4-4290-9962-0e1e28e9ace3" returned: 0 in 0.724s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:09 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9.a231f5d0-e4d4-4290-9962-0e1e28e9ace3 is being set with open permissions: ugo+rw Sep 28 17:17:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9.a231f5d0-e4d4-4290-9962-0e1e28e9ace3 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:09 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a6f28789-2531-4edc-adcb-0df9197c9179 tempest-AttachVolumeTestJSON-1638983725 None] Lock "cinder-6b3cb530-5362-49ee-a7dd-30369961399f-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:09 devstack sudo[96334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9.a231f5d0-e4d4-4290-9962-0e1e28e9ace3 Sep 28 17:17:09 devstack sudo[96334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:09 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a6f28789-2531-4edc-adcb-0df9197c9179 tempest-AttachVolumeTestJSON-1638983725 None] Acquiring lock "cinder-quobyte-6b3cb530-5362-49ee-a7dd-30369961399f" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:09 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a6f28789-2531-4edc-adcb-0df9197c9179 tempest-AttachVolumeTestJSON-1638983725 None] Lock "cinder-quobyte-6b3cb530-5362-49ee-a7dd-30369961399f" acquired by "delete_volume" :: waited 0.022s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:09 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[11260890-d4ee-4d58-9da7-8f388ed8ff6f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a6f28789-2531-4edc-adcb-0df9197c9179 tempest-AttachVolumeTestJSON-1638983725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6b3cb530-5362-49ee-a7dd-30369961399f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:09 devstack sudo[96336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6b3cb530-5362-49ee-a7dd-30369961399f Sep 28 17:17:09 devstack sudo[96336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:10 devstack sudo[96334]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9.a231f5d0-e4d4-4290-9962-0e1e28e9ace3" returned: 0 in 0.435s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:10 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9.info Sep 28 17:17:10 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:10 devstack sudo[96336]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a6f28789-2531-4edc-adcb-0df9197c9179 tempest-AttachVolumeTestJSON-1638983725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6b3cb530-5362-49ee-a7dd-30369961399f" returned: 0 in 0.614s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a6f28789-2531-4edc-adcb-0df9197c9179 tempest-AttachVolumeTestJSON-1638983725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6b3cb530-5362-49ee-a7dd-30369961399f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:10 devstack sudo[96345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6b3cb530-5362-49ee-a7dd-30369961399f Sep 28 17:17:10 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:10 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9.info" returned: 0 in 0.426s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:10 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9.info is being set with open permissions: ugo+rw Sep 28 17:17:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:10 devstack sudo[96348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9.info Sep 28 17:17:10 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:10 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a6f28789-2531-4edc-adcb-0df9197c9179 tempest-AttachVolumeTestJSON-1638983725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6b3cb530-5362-49ee-a7dd-30369961399f" returned: 0 in 0.546s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:10 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a6f28789-2531-4edc-adcb-0df9197c9179 tempest-AttachVolumeTestJSON-1638983725 None] Lock "cinder-quobyte-6b3cb530-5362-49ee-a7dd-30369961399f" released by "delete_volume" :: held 1.239s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:11 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9.info" returned: 0 in 0.527s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:11 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Acquiring lock "cinder-quobyte-667e84fb-35aa-455f-96d6-3edab3d1df32" by "_copy_volume_from_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:11 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Lock "cinder-quobyte-667e84fb-35aa-455f-96d6-3edab3d1df32" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] snapshot: a231f5d0-e4d4-4290-9962-0e1e28e9ace3, volume: 667e84fb-35aa-455f-96d6-3edab3d1df32, {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:17:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:11 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[191b32ce-0dda-4537-9dfb-571573632fe0]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9.a231f5d0-e4d4-4290-9962-0e1e28e9ace3 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:11 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-a6f28789-2531-4edc-adcb-0df9197c9179 tempest-AttachVolumeTestJSON-1638983725 None] Created reservations ['20aab285-be2e-4e92-a2f0-79514025ec77', '2cfda8de-2490-4076-a9d6-04bf04d8e845', 'fb127aff-59eb-4083-8881-39a04cbf6ff1', '4eedad20-bcdb-4d90-92a2-7d7cc33627a9'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a6f28789-2531-4edc-adcb-0df9197c9179 tempest-AttachVolumeTestJSON-1638983725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a6f28789-2531-4edc-adcb-0df9197c9179 tempest-AttachVolumeTestJSON-1638983725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a6f28789-2531-4edc-adcb-0df9197c9179 tempest-AttachVolumeTestJSON-1638983725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a6f28789-2531-4edc-adcb-0df9197c9179 tempest-AttachVolumeTestJSON-1638983725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a6f28789-2531-4edc-adcb-0df9197c9179 tempest-AttachVolumeTestJSON-1638983725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a6f28789-2531-4edc-adcb-0df9197c9179 tempest-AttachVolumeTestJSON-1638983725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:11 devstack sudo[96353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:17:11 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:11 devstack sudo[96352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9.a231f5d0-e4d4-4290-9962-0e1e28e9ace3 Sep 28 17:17:11 devstack sudo[96352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:11 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a6f28789-2531-4edc-adcb-0df9197c9179 tempest-AttachVolumeTestJSON-1638983725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.531s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:11 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-a6f28789-2531-4edc-adcb-0df9197c9179 tempest-AttachVolumeTestJSON-1638983725 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:11 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-a6f28789-2531-4edc-adcb-0df9197c9179 tempest-AttachVolumeTestJSON-1638983725 None] Deleted volume successfully. Sep 28 17:17:12 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a6f28789-2531-4edc-adcb-0df9197c9179 tempest-AttachVolumeTestJSON-1638983725 None] Lock "cinder-6b3cb530-5362-49ee-a7dd-30369961399f-delete_volume" released by "delete_volume" :: held 2.363s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:12 devstack sudo[96352]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9.a231f5d0-e4d4-4290-9962-0e1e28e9ace3" returned: 0 in 0.883s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:12 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:17:12 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a35f2d7-a770-4784-a53b-c731f762beba]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:12 devstack sudo[96360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9 Sep 28 17:17:12 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:12 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9" returned: 0 in 0.770s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:12 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9 {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:17:12 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Creating direct copy from snapshot {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:17:12 devstack cinder-volume[86917]: DEBUG cinder.utils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Path /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-667e84fb-35aa-455f-96d6-3edab3d1df32 not found in is_blk_device check {{(pid=86917) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:17:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-667e84fb-35aa-455f-96d6-3edab3d1df32 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:12 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-667e84fb-35aa-455f-96d6-3edab3d1df32 Sep 28 17:17:12 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:21 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=21,cinder:UPDATE=32,cinder:INSERT=10,cinder:DELETE=1 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:17:21 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=84,cinder:UPDATE=89,cinder:INSERT=22,cinder:DELETE=7 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:17:24 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-667e84fb-35aa-455f-96d6-3edab3d1df32" returned: 0 in 11.442s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:24 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Image conversion details: src /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9, size 1024.00 MB, duration 11.45 sec, destination /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-667e84fb-35aa-455f-96d6-3edab3d1df32 {{(pid=86917) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:17:24 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Converted 1024.00 MB image at 89.47 MB/s Sep 28 17:17:24 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-667e84fb-35aa-455f-96d6-3edab3d1df32 is being set with open permissions: ugo+rw Sep 28 17:17:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-667e84fb-35aa-455f-96d6-3edab3d1df32 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:24 devstack sudo[96423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-667e84fb-35aa-455f-96d6-3edab3d1df32 Sep 28 17:17:24 devstack sudo[96423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:24 devstack sudo[96423]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-667e84fb-35aa-455f-96d6-3edab3d1df32" returned: 0 in 0.429s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Lock "cinder-quobyte-667e84fb-35aa-455f-96d6-3edab3d1df32" released by "_copy_volume_from_snapshot" :: held 13.668s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Acquiring lock "cinder-quobyte-a231f5d0-e4d4-4290-9962-0e1e28e9ace3" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Lock "cinder-quobyte-a231f5d0-e4d4-4290-9962-0e1e28e9ace3" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Deleting offline snapshot a231f5d0-e4d4-4290-9962-0e1e28e9ace3 of volume 082ccd45-6daf-4ce9-ac1a-ad79fb8374c9 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:17:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] snapshot_file for this snap is: volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9.a231f5d0-e4d4-4290-9962-0e1e28e9ace3 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:17:24 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f28ac8-b396-499c-8e69-e3e423d11767]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9.a231f5d0-e4d4-4290-9962-0e1e28e9ace3 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:25 devstack sudo[96426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9.a231f5d0-e4d4-4290-9962-0e1e28e9ace3 Sep 28 17:17:25 devstack sudo[96426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:25 devstack sudo[96426]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9.a231f5d0-e4d4-4290-9962-0e1e28e9ace3" returned: 0 in 0.654s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:25 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:17:25 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd519cfa-3391-4a5c-887e-07255282c67f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:25 devstack sudo[96435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9 Sep 28 17:17:25 devstack sudo[96435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:26 devstack sudo[96435]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9" returned: 0 in 0.941s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9.a231f5d0-e4d4-4290-9962-0e1e28e9ace3 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:26 devstack sudo[96440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9.a231f5d0-e4d4-4290-9962-0e1e28e9ace3 Sep 28 17:17:26 devstack sudo[96440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:27 devstack sudo[96440]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9.a231f5d0-e4d4-4290-9962-0e1e28e9ace3" returned: 0 in 0.915s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9.a231f5d0-e4d4-4290-9962-0e1e28e9ace3 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:27 devstack sudo[96445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9.a231f5d0-e4d4-4290-9962-0e1e28e9ace3 Sep 28 17:17:27 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:28 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9.a231f5d0-e4d4-4290-9962-0e1e28e9ace3" returned: 0 in 0.700s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:28 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Lock "cinder-quobyte-a231f5d0-e4d4-4290-9962-0e1e28e9ace3" released by "_delete_snapshot" :: held 3.406s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.023s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:28 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4778996d-7025-4c70-b44f-f5da9b98bb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-667e84fb-35aa-455f-96d6-3edab3d1df32', 'volume_size': 2, 'source_volid': '082ccd45-6daf-4ce9-ac1a-ad79fb8374c9', 'source_volstatus': 'available'}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:28 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b706fc-8913-4cf0-a39b-4729ef715be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:28 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Volume volume-667e84fb-35aa-455f-96d6-3edab3d1df32 (667e84fb-35aa-455f-96d6-3edab3d1df32): created successfully Sep 28 17:17:28 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b706fc-8913-4cf0-a39b-4729ef715be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:28 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Flow 'volume_create_manager' (2c1516e0-a208-404b-a8eb-072cdf5c9547) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:28 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-fa24be6a-458b-4f77-b8b4-70af0aeb4fba tempest-VolumesCloneTest-1473385021 None] Created volume successfully. Sep 28 17:17:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5adfe425-9a8b-4aa9-a206-7fee59c2b770 tempest-VolumesCloneTest-1473385021 None] Acquiring lock "cinder-667e84fb-35aa-455f-96d6-3edab3d1df32-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5adfe425-9a8b-4aa9-a206-7fee59c2b770 tempest-VolumesCloneTest-1473385021 None] Lock "cinder-667e84fb-35aa-455f-96d6-3edab3d1df32-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5adfe425-9a8b-4aa9-a206-7fee59c2b770 tempest-VolumesCloneTest-1473385021 None] Acquiring lock "cinder-quobyte-667e84fb-35aa-455f-96d6-3edab3d1df32" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5adfe425-9a8b-4aa9-a206-7fee59c2b770 tempest-VolumesCloneTest-1473385021 None] Lock "cinder-quobyte-667e84fb-35aa-455f-96d6-3edab3d1df32" acquired by "delete_volume" :: waited 0.034s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:30 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45fa959-75e0-4895-b9ee-d3194d4f3e3d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5adfe425-9a8b-4aa9-a206-7fee59c2b770 tempest-VolumesCloneTest-1473385021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-667e84fb-35aa-455f-96d6-3edab3d1df32 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:30 devstack sudo[96452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-667e84fb-35aa-455f-96d6-3edab3d1df32 Sep 28 17:17:30 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:30 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5adfe425-9a8b-4aa9-a206-7fee59c2b770 tempest-VolumesCloneTest-1473385021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-667e84fb-35aa-455f-96d6-3edab3d1df32" returned: 0 in 0.593s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5adfe425-9a8b-4aa9-a206-7fee59c2b770 tempest-VolumesCloneTest-1473385021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-667e84fb-35aa-455f-96d6-3edab3d1df32 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:30 devstack sudo[96466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-667e84fb-35aa-455f-96d6-3edab3d1df32 Sep 28 17:17:30 devstack sudo[96466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:31 devstack sudo[96466]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5adfe425-9a8b-4aa9-a206-7fee59c2b770 tempest-VolumesCloneTest-1473385021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-667e84fb-35aa-455f-96d6-3edab3d1df32" returned: 0 in 0.474s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:31 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5adfe425-9a8b-4aa9-a206-7fee59c2b770 tempest-VolumesCloneTest-1473385021 None] Lock "cinder-quobyte-667e84fb-35aa-455f-96d6-3edab3d1df32" released by "delete_volume" :: held 1.182s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:31 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-5adfe425-9a8b-4aa9-a206-7fee59c2b770 tempest-VolumesCloneTest-1473385021 None] Created reservations ['7b4fed3c-7440-458a-af48-b4e48ede0c21', 'b30d6087-aa36-4d5e-abd1-d36831a6f7fa', '85fc624d-085c-4464-a876-a415169faf9c', '83a42540-198d-4ca1-bb6a-720ae0d35122'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5adfe425-9a8b-4aa9-a206-7fee59c2b770 tempest-VolumesCloneTest-1473385021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5adfe425-9a8b-4aa9-a206-7fee59c2b770 tempest-VolumesCloneTest-1473385021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-5adfe425-9a8b-4aa9-a206-7fee59c2b770 tempest-VolumesCloneTest-1473385021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-5adfe425-9a8b-4aa9-a206-7fee59c2b770 tempest-VolumesCloneTest-1473385021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5adfe425-9a8b-4aa9-a206-7fee59c2b770 tempest-VolumesCloneTest-1473385021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5adfe425-9a8b-4aa9-a206-7fee59c2b770 tempest-VolumesCloneTest-1473385021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:31 devstack sudo[96482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:17:31 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:31 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5adfe425-9a8b-4aa9-a206-7fee59c2b770 tempest-VolumesCloneTest-1473385021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.351s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:31 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-5adfe425-9a8b-4aa9-a206-7fee59c2b770 tempest-VolumesCloneTest-1473385021 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:31 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-5adfe425-9a8b-4aa9-a206-7fee59c2b770 tempest-VolumesCloneTest-1473385021 None] Deleted volume successfully. Sep 28 17:17:31 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5adfe425-9a8b-4aa9-a206-7fee59c2b770 tempest-VolumesCloneTest-1473385021 None] Lock "cinder-667e84fb-35aa-455f-96d6-3edab3d1df32-delete_volume" released by "delete_volume" :: held 2.002s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2d5ca1bd-1a6b-41a7-ae0c-0ee5f71153b9 tempest-VolumesCloneTest-1473385021 None] Acquiring lock "cinder-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2d5ca1bd-1a6b-41a7-ae0c-0ee5f71153b9 tempest-VolumesCloneTest-1473385021 None] Lock "cinder-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2d5ca1bd-1a6b-41a7-ae0c-0ee5f71153b9 tempest-VolumesCloneTest-1473385021 None] Acquiring lock "cinder-quobyte-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2d5ca1bd-1a6b-41a7-ae0c-0ee5f71153b9 tempest-VolumesCloneTest-1473385021 None] Lock "cinder-quobyte-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9" acquired by "delete_volume" :: waited 0.031s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:32 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b33e404-5976-467e-bcab-8a4b44912284]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2d5ca1bd-1a6b-41a7-ae0c-0ee5f71153b9 tempest-VolumesCloneTest-1473385021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:32 devstack sudo[96488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9 Sep 28 17:17:32 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:33 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2d5ca1bd-1a6b-41a7-ae0c-0ee5f71153b9 tempest-VolumesCloneTest-1473385021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9" returned: 0 in 0.563s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2d5ca1bd-1a6b-41a7-ae0c-0ee5f71153b9 tempest-VolumesCloneTest-1473385021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:33 devstack sudo[96495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9 Sep 28 17:17:33 devstack sudo[96495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:33 devstack sudo[96495]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2d5ca1bd-1a6b-41a7-ae0c-0ee5f71153b9 tempest-VolumesCloneTest-1473385021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9" returned: 0 in 0.423s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:33 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2d5ca1bd-1a6b-41a7-ae0c-0ee5f71153b9 tempest-VolumesCloneTest-1473385021 None] Lock "cinder-quobyte-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9" released by "delete_volume" :: held 1.103s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:33 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-2d5ca1bd-1a6b-41a7-ae0c-0ee5f71153b9 tempest-VolumesCloneTest-1473385021 None] Created reservations ['95178469-818d-4746-8dae-3fa5d789a387', '6bfdf8e0-9216-4cc4-abb9-ebe79e68bba4', '5d107cff-d66a-44fc-953c-2b486e3bc84a', 'a8d816a9-9107-4fda-ad02-17a5d2ed6b1f'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2d5ca1bd-1a6b-41a7-ae0c-0ee5f71153b9 tempest-VolumesCloneTest-1473385021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2d5ca1bd-1a6b-41a7-ae0c-0ee5f71153b9 tempest-VolumesCloneTest-1473385021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:33 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-2d5ca1bd-1a6b-41a7-ae0c-0ee5f71153b9 tempest-VolumesCloneTest-1473385021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:33 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-2d5ca1bd-1a6b-41a7-ae0c-0ee5f71153b9 tempest-VolumesCloneTest-1473385021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2d5ca1bd-1a6b-41a7-ae0c-0ee5f71153b9 tempest-VolumesCloneTest-1473385021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2d5ca1bd-1a6b-41a7-ae0c-0ee5f71153b9 tempest-VolumesCloneTest-1473385021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:33 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:17:33 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:34 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2d5ca1bd-1a6b-41a7-ae0c-0ee5f71153b9 tempest-VolumesCloneTest-1473385021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.493s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:34 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-2d5ca1bd-1a6b-41a7-ae0c-0ee5f71153b9 tempest-VolumesCloneTest-1473385021 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:34 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-2d5ca1bd-1a6b-41a7-ae0c-0ee5f71153b9 tempest-VolumesCloneTest-1473385021 None] Deleted volume successfully. Sep 28 17:17:34 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2d5ca1bd-1a6b-41a7-ae0c-0ee5f71153b9 tempest-VolumesCloneTest-1473385021 None] Lock "cinder-082ccd45-6daf-4ce9-ac1a-ad79fb8374c9-delete_volume" released by "delete_volume" :: held 1.984s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:43 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:UPDATE=22,cinder:SELECT=10,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:17:44 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:17:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Flow 'volume_create_manager' (23d23a93-d2df-4d72-814e-8f52d83e917c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (402965dd-82c9-4076-a0cf-a7d22a89e3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (402965dd-82c9-4076-a0cf-a7d22a89e3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-790028423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aefa38df-a4b6-4289-9158-3d07e2856e08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42def9e9e44641e38a9900d444bd86b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:44Z,use_quota=True,user_id='8bffdce75d7a4cc1b30d9f0e32663098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc8bda65-f7ea-441b-bc7a-da0cfc35c283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc8bda65-f7ea-441b-bc7a-da0cfc35c283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (663fbff9-4309-44a4-9f05-b3135323ec49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:44 devstack cinder-volume[86917]: DEBUG cinder.image.glance [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Creating Keystone auth plugin from conf {{(pid=86917) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:17:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (663fbff9-4309-44a4-9f05-b3135323ec49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'aefa38df-a4b6-4289-9158-3d07e2856e08', 'volume_name': 'volume-aefa38df-a4b6-4289-9158-3d07e2856e08', 'volume_size': 1, 'image_id': '19d24755-5fa8-4e1d-aef6-b5fdde452855', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19d24755-5fa8-4e1d-aef6-b5fdde452855', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '307b831956a2452b912f3a0d37f5ee84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '19d24755-5fa8-4e1d-aef6-b5fdde452855', 'created_at': datetime.datetime(2026, 9, 28, 15, 0, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 0, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19d24755-5fa8-4e1d-aef6-b5fdde452855/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f3caa65-56d2-4a23-a228-eda6b9ddf276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f3caa65-56d2-4a23-a228-eda6b9ddf276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc0e49a8-232b-4b1c-8bd0-66275b0cd9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:44 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Volume aefa38df-a4b6-4289-9158-3d07e2856e08: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-aefa38df-a4b6-4289-9158-3d07e2856e08', 'volume_size': 1, 'image_id': '19d24755-5fa8-4e1d-aef6-b5fdde452855', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19d24755-5fa8-4e1d-aef6-b5fdde452855', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '307b831956a2452b912f3a0d37f5ee84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '19d24755-5fa8-4e1d-aef6-b5fdde452855', 'created_at': datetime.datetime(2026, 9, 28, 15, 0, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 0, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19d24755-5fa8-4e1d-aef6-b5fdde452855/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 17:17:44 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Trying to clone aefa38df-a4b6-4289-9158-3d07e2856e08 from image 19d24755-5fa8-4e1d-aef6-b5fdde452855 at location (None, [{'url': 'file:///opt/stack/data/glance/images/19d24755-5fa8-4e1d-aef6-b5fdde452855', 'metadata': {}}]). {{(pid=86917) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:17:45 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_wexvt3xidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86917) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:17:45 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Image download 20.69 MB at 20.69 MB/s Sep 28 17:17:45 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff97ab1-eb08-4100-8ca6-ebb9bbba6272]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_wexvt3xidevstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:45 devstack sudo[96507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_wexvt3xidevstack@QuobyteHD Sep 28 17:17:45 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:45 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_wexvt3xidevstack@QuobyteHD" returned: 0 in 0.424s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:45 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Temporary image 19d24755-5fa8-4e1d-aef6-b5fdde452855 is fetched for user 8bffdce75d7a4cc1b30d9f0e32663098. {{(pid=86917) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:17:45 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[879bcd5e-dc55-4184-a099-718f595cca5b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_wexvt3xidevstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:45 devstack sudo[96514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_wexvt3xidevstack@QuobyteHD Sep 28 17:17:45 devstack sudo[96514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:46 devstack sudo[96514]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_wexvt3xidevstack@QuobyteHD" returned: 0 in 0.509s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:46 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-790028423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aefa38df-a4b6-4289-9158-3d07e2856e08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42def9e9e44641e38a9900d444bd86b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:44Z,use_quota=True,user_id='8bffdce75d7a4cc1b30d9f0e32663098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:17:46 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Creating volume aefa38df-a4b6-4289-9158-3d07e2856e08 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:17:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:46 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:46 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:46 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:17:46 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:17:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aefa38df-a4b6-4289-9158-3d07e2856e08 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:46 devstack sudo[96519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aefa38df-a4b6-4289-9158-3d07e2856e08 1073741824 Sep 28 17:17:46 devstack sudo[96519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:47 devstack sudo[96519]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aefa38df-a4b6-4289-9158-3d07e2856e08 1073741824" returned: 0 in 0.688s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aefa38df-a4b6-4289-9158-3d07e2856e08 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:47 devstack sudo[96525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aefa38df-a4b6-4289-9158-3d07e2856e08 Sep 28 17:17:47 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:47 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aefa38df-a4b6-4289-9158-3d07e2856e08" returned: 0 in 0.401s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:47 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:17:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:47 devstack cinder-volume[86917]: DEBUG cinder.volume.volume_utils [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Attempting download of 19d24755-5fa8-4e1d-aef6-b5fdde452855 ((None, [{'url': 'file:///opt/stack/data/glance/images/19d24755-5fa8-4e1d-aef6-b5fdde452855', 'metadata': {}}])) to volume aefa38df-a4b6-4289-9158-3d07e2856e08. {{(pid=86917) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:17:47 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd81a15-9cbf-4c05-83a8-3b51066d8524]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19d24755-5fa8-4e1d-aef6-b5fdde452855_73yx50r1 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:47 devstack sudo[96528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19d24755-5fa8-4e1d-aef6-b5fdde452855_73yx50r1 Sep 28 17:17:47 devstack sudo[96528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:48 devstack sudo[96528]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19d24755-5fa8-4e1d-aef6-b5fdde452855_73yx50r1" returned: 0 in 0.556s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19d24755-5fa8-4e1d-aef6-b5fdde452855_73yx50r1 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:48 devstack sudo[96532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19d24755-5fa8-4e1d-aef6-b5fdde452855_73yx50r1 Sep 28 17:17:48 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:48 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19d24755-5fa8-4e1d-aef6-b5fdde452855_73yx50r1" returned: 1 in 0.437s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19d24755-5fa8-4e1d-aef6-b5fdde452855_73yx50r1' failed. Not Retrying. {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:17:48 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30b5335-89ae-436d-bba9-f7de84d6fe18]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_wexvt3xidevstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:48 devstack sudo[96536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_wexvt3xidevstack@QuobyteHD Sep 28 17:17:48 devstack sudo[96536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:49 devstack sudo[96536]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_wexvt3xidevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:49 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] 19d24755-5fa8-4e1d-aef6-b5fdde452855 was qcow2, converting to qcow2 {{(pid=86917) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:17:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_wexvt3xidevstack@QuobyteHD /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aefa38df-a4b6-4289-9158-3d07e2856e08 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:49 devstack sudo[96541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_wexvt3xidevstack@QuobyteHD /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aefa38df-a4b6-4289-9158-3d07e2856e08 Sep 28 17:17:49 devstack sudo[96541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:17:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:49 devstack sudo[96547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:17:49 devstack sudo[96547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:49 devstack sudo[96547]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.450s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:49 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager._thread_info {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:17:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread count: 28 {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:17:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread info: [<_MainThread(MainThread, started 132915553284224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:17:52 devstack sudo[96541]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_wexvt3xidevstack@QuobyteHD /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aefa38df-a4b6-4289-9158-3d07e2856e08" returned: 0 in 3.413s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:52 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_wexvt3xidevstack@QuobyteHD, size 112.00 MB, duration 3.41 sec, destination /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aefa38df-a4b6-4289-9158-3d07e2856e08 {{(pid=86917) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:17:52 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Converted 112.00 MB image at 32.81 MB/s Sep 28 17:17:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aefa38df-a4b6-4289-9158-3d07e2856e08 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:52 devstack sudo[96553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aefa38df-a4b6-4289-9158-3d07e2856e08 1G Sep 28 17:17:52 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:53 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aefa38df-a4b6-4289-9158-3d07e2856e08 1G" returned: 0 in 0.972s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:53 devstack cinder-volume[86917]: DEBUG cinder.volume.volume_utils [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Downloaded image 19d24755-5fa8-4e1d-aef6-b5fdde452855 ((None, [{'url': 'file:///opt/stack/data/glance/images/19d24755-5fa8-4e1d-aef6-b5fdde452855', 'metadata': {}}])) to volume aefa38df-a4b6-4289-9158-3d07e2856e08 successfully. {{(pid=86917) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:17:53 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Temporary image 19d24755-5fa8-4e1d-aef6-b5fdde452855 for user 8bffdce75d7a4cc1b30d9f0e32663098 is deleted. {{(pid=86917) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:17:53 devstack cinder-volume[86917]: DEBUG cinder.volume.volume_utils [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Marking volume aefa38df-a4b6-4289-9158-3d07e2856e08 as bootable. {{(pid=86917) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:17:53 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Copying metadata from image 19d24755-5fa8-4e1d-aef6-b5fdde452855 to aefa38df-a4b6-4289-9158-3d07e2856e08. {{(pid=86917) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:17:53 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Creating volume glance metadata for volume aefa38df-a4b6-4289-9158-3d07e2856e08 backed by image 19d24755-5fa8-4e1d-aef6-b5fdde452855 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '19d24755-5fa8-4e1d-aef6-b5fdde452855', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86917) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:17:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc0e49a8-232b-4b1c-8bd0-66275b0cd9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aefa38df-a4b6-4289-9158-3d07e2856e08', 'volume_size': 1, 'image_id': '19d24755-5fa8-4e1d-aef6-b5fdde452855', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19d24755-5fa8-4e1d-aef6-b5fdde452855', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '307b831956a2452b912f3a0d37f5ee84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '19d24755-5fa8-4e1d-aef6-b5fdde452855', 'created_at': datetime.datetime(2026, 9, 28, 15, 0, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 0, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19d24755-5fa8-4e1d-aef6-b5fdde452855/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df7ddd2-3045-47ef-b03c-6bd036812e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:53 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Volume volume-aefa38df-a4b6-4289-9158-3d07e2856e08 (aefa38df-a4b6-4289-9158-3d07e2856e08): created successfully Sep 28 17:17:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df7ddd2-3045-47ef-b03c-6bd036812e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Flow 'volume_create_manager' (23d23a93-d2df-4d72-814e-8f52d83e917c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:53 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-ed9e62ff-0f6a-4822-b607-acb2f0953dc7 tempest-VolumesExtendTest-1652299505 None] Created volume successfully. Sep 28 17:17:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b81c287b-a947-41c2-8f67-df8dfde38536 tempest-VolumesExtendTest-1652299505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b81c287b-a947-41c2-8f67-df8dfde38536 tempest-VolumesExtendTest-1652299505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:54 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e692a6c3-da07-4d3d-bc41-225b583c9b61]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b81c287b-a947-41c2-8f67-df8dfde38536 tempest-VolumesExtendTest-1652299505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aefa38df-a4b6-4289-9158-3d07e2856e08 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:54 devstack sudo[96623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aefa38df-a4b6-4289-9158-3d07e2856e08 Sep 28 17:17:54 devstack sudo[96623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:55 devstack sudo[96623]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b81c287b-a947-41c2-8f67-df8dfde38536 tempest-VolumesExtendTest-1652299505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aefa38df-a4b6-4289-9158-3d07e2856e08" returned: 0 in 0.781s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b81c287b-a947-41c2-8f67-df8dfde38536 tempest-VolumesExtendTest-1652299505 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aefa38df-a4b6-4289-9158-3d07e2856e08 2G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b81c287b-a947-41c2-8f67-df8dfde38536 tempest-VolumesExtendTest-1652299505 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aefa38df-a4b6-4289-9158-3d07e2856e08 2G" returned: 0 in 0.186s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b81c287b-a947-41c2-8f67-df8dfde38536 tempest-VolumesExtendTest-1652299505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.012s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:55 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-b81c287b-a947-41c2-8f67-df8dfde38536 tempest-VolumesExtendTest-1652299505 None] Extend volume completed successfully. Sep 28 17:17:56 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e09c47ee-1176-4b3f-9fec-c75fb7bb0558 tempest-VolumesExtendTest-1652299505 None] Acquiring lock "cinder-aefa38df-a4b6-4289-9158-3d07e2856e08-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:56 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e09c47ee-1176-4b3f-9fec-c75fb7bb0558 tempest-VolumesExtendTest-1652299505 None] Lock "cinder-aefa38df-a4b6-4289-9158-3d07e2856e08-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:57 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e09c47ee-1176-4b3f-9fec-c75fb7bb0558 tempest-VolumesExtendTest-1652299505 None] Acquiring lock "cinder-quobyte-aefa38df-a4b6-4289-9158-3d07e2856e08" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:57 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e09c47ee-1176-4b3f-9fec-c75fb7bb0558 tempest-VolumesExtendTest-1652299505 None] Lock "cinder-quobyte-aefa38df-a4b6-4289-9158-3d07e2856e08" acquired by "delete_volume" :: waited 0.049s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:57 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c0926e-a42f-4156-b547-6140072b4fe5]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e09c47ee-1176-4b3f-9fec-c75fb7bb0558 tempest-VolumesExtendTest-1652299505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aefa38df-a4b6-4289-9158-3d07e2856e08 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:57 devstack sudo[96649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aefa38df-a4b6-4289-9158-3d07e2856e08 Sep 28 17:17:57 devstack sudo[96649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:58 devstack sudo[96649]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e09c47ee-1176-4b3f-9fec-c75fb7bb0558 tempest-VolumesExtendTest-1652299505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aefa38df-a4b6-4289-9158-3d07e2856e08" returned: 0 in 0.812s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e09c47ee-1176-4b3f-9fec-c75fb7bb0558 tempest-VolumesExtendTest-1652299505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aefa38df-a4b6-4289-9158-3d07e2856e08 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:58 devstack sudo[96654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aefa38df-a4b6-4289-9158-3d07e2856e08 Sep 28 17:17:58 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:58 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e09c47ee-1176-4b3f-9fec-c75fb7bb0558 tempest-VolumesExtendTest-1652299505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aefa38df-a4b6-4289-9158-3d07e2856e08" returned: 0 in 0.644s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:58 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e09c47ee-1176-4b3f-9fec-c75fb7bb0558 tempest-VolumesExtendTest-1652299505 None] Lock "cinder-quobyte-aefa38df-a4b6-4289-9158-3d07e2856e08" released by "delete_volume" :: held 1.612s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:58 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-e09c47ee-1176-4b3f-9fec-c75fb7bb0558 tempest-VolumesExtendTest-1652299505 None] Created reservations ['efc3ce76-884f-4aa3-a14c-d92765bd8ade', '061b421b-5be8-4858-bb59-dbc7517bc00e', 'a2046452-cae2-4055-9b4a-fbe76e0f8caf', '3918463d-e14d-4835-b783-ae8a14add235'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e09c47ee-1176-4b3f-9fec-c75fb7bb0558 tempest-VolumesExtendTest-1652299505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e09c47ee-1176-4b3f-9fec-c75fb7bb0558 tempest-VolumesExtendTest-1652299505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:58 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-e09c47ee-1176-4b3f-9fec-c75fb7bb0558 tempest-VolumesExtendTest-1652299505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:58 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-e09c47ee-1176-4b3f-9fec-c75fb7bb0558 tempest-VolumesExtendTest-1652299505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e09c47ee-1176-4b3f-9fec-c75fb7bb0558 tempest-VolumesExtendTest-1652299505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e09c47ee-1176-4b3f-9fec-c75fb7bb0558 tempest-VolumesExtendTest-1652299505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:58 devstack sudo[96657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:17:59 devstack sudo[96657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:59 devstack sudo[96657]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e09c47ee-1176-4b3f-9fec-c75fb7bb0558 tempest-VolumesExtendTest-1652299505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.439s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:59 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-e09c47ee-1176-4b3f-9fec-c75fb7bb0558 tempest-VolumesExtendTest-1652299505 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:59 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-e09c47ee-1176-4b3f-9fec-c75fb7bb0558 tempest-VolumesExtendTest-1652299505 None] Deleted volume successfully. Sep 28 17:17:59 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e09c47ee-1176-4b3f-9fec-c75fb7bb0558 tempest-VolumesExtendTest-1652299505 None] Lock "cinder-aefa38df-a4b6-4289-9158-3d07e2856e08-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:00 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-54387f50-ee27-49a2-8a23-a44883f3cdfc tempest-VolumesExtendTest-1652299505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:18:00 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-54387f50-ee27-49a2-8a23-a44883f3cdfc tempest-VolumesExtendTest-1652299505 None] Flow 'volume_create_manager' (391dd3d3-faf6-4453-a48e-509b3582b765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:00 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-54387f50-ee27-49a2-8a23-a44883f3cdfc tempest-VolumesExtendTest-1652299505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3267f09-da2b-4649-ac6a-8abe974c0a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:00 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-54387f50-ee27-49a2-8a23-a44883f3cdfc tempest-VolumesExtendTest-1652299505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3267f09-da2b-4649-ac6a-8abe974c0a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1605297727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18dde790-bbc4-4c24-93c3-eee144ed246e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42def9e9e44641e38a9900d444bd86b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:01Z,use_quota=True,user_id='8bffdce75d7a4cc1b30d9f0e32663098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:00 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-54387f50-ee27-49a2-8a23-a44883f3cdfc tempest-VolumesExtendTest-1652299505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ec750c-73bc-4d2f-9e38-b4add9f43095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:00 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-54387f50-ee27-49a2-8a23-a44883f3cdfc tempest-VolumesExtendTest-1652299505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ec750c-73bc-4d2f-9e38-b4add9f43095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:00 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-54387f50-ee27-49a2-8a23-a44883f3cdfc tempest-VolumesExtendTest-1652299505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (081f9878-dd6f-4abb-ab93-898b41f07e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:00 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-54387f50-ee27-49a2-8a23-a44883f3cdfc tempest-VolumesExtendTest-1652299505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (081f9878-dd6f-4abb-ab93-898b41f07e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18dde790-bbc4-4c24-93c3-eee144ed246e', 'volume_name': 'volume-18dde790-bbc4-4c24-93c3-eee144ed246e', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:00 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-54387f50-ee27-49a2-8a23-a44883f3cdfc tempest-VolumesExtendTest-1652299505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32fee06d-35ad-4c16-b147-3dec89f3338a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:00 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-54387f50-ee27-49a2-8a23-a44883f3cdfc tempest-VolumesExtendTest-1652299505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32fee06d-35ad-4c16-b147-3dec89f3338a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:00 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-54387f50-ee27-49a2-8a23-a44883f3cdfc tempest-VolumesExtendTest-1652299505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5419dfd4-c3e0-4bfd-a501-62ab1e7239ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:00 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-54387f50-ee27-49a2-8a23-a44883f3cdfc tempest-VolumesExtendTest-1652299505 None] Volume 18dde790-bbc4-4c24-93c3-eee144ed246e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18dde790-bbc4-4c24-93c3-eee144ed246e', 'volume_size': 1} Sep 28 17:18:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-54387f50-ee27-49a2-8a23-a44883f3cdfc tempest-VolumesExtendTest-1652299505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-54387f50-ee27-49a2-8a23-a44883f3cdfc tempest-VolumesExtendTest-1652299505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:00 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-54387f50-ee27-49a2-8a23-a44883f3cdfc tempest-VolumesExtendTest-1652299505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1605297727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18dde790-bbc4-4c24-93c3-eee144ed246e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42def9e9e44641e38a9900d444bd86b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:01Z,use_quota=True,user_id='8bffdce75d7a4cc1b30d9f0e32663098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:18:00 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-54387f50-ee27-49a2-8a23-a44883f3cdfc tempest-VolumesExtendTest-1652299505 None] Creating volume 18dde790-bbc4-4c24-93c3-eee144ed246e {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:18:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-54387f50-ee27-49a2-8a23-a44883f3cdfc tempest-VolumesExtendTest-1652299505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-54387f50-ee27-49a2-8a23-a44883f3cdfc tempest-VolumesExtendTest-1652299505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:00 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-54387f50-ee27-49a2-8a23-a44883f3cdfc tempest-VolumesExtendTest-1652299505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:00 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-54387f50-ee27-49a2-8a23-a44883f3cdfc tempest-VolumesExtendTest-1652299505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-54387f50-ee27-49a2-8a23-a44883f3cdfc tempest-VolumesExtendTest-1652299505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:00 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-54387f50-ee27-49a2-8a23-a44883f3cdfc tempest-VolumesExtendTest-1652299505 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:18:00 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-54387f50-ee27-49a2-8a23-a44883f3cdfc tempest-VolumesExtendTest-1652299505 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:18:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-54387f50-ee27-49a2-8a23-a44883f3cdfc tempest-VolumesExtendTest-1652299505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:00 devstack sudo[96662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e 1073741824 Sep 28 17:18:00 devstack sudo[96662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:01 devstack sudo[96662]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-54387f50-ee27-49a2-8a23-a44883f3cdfc tempest-VolumesExtendTest-1652299505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e 1073741824" returned: 0 in 0.809s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-54387f50-ee27-49a2-8a23-a44883f3cdfc tempest-VolumesExtendTest-1652299505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:01 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e Sep 28 17:18:01 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:02 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-54387f50-ee27-49a2-8a23-a44883f3cdfc tempest-VolumesExtendTest-1652299505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e" returned: 0 in 0.500s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:02 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-54387f50-ee27-49a2-8a23-a44883f3cdfc tempest-VolumesExtendTest-1652299505 None] <== create_volume: return (1387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:18:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-54387f50-ee27-49a2-8a23-a44883f3cdfc tempest-VolumesExtendTest-1652299505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:02 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-54387f50-ee27-49a2-8a23-a44883f3cdfc tempest-VolumesExtendTest-1652299505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5419dfd4-c3e0-4bfd-a501-62ab1e7239ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18dde790-bbc4-4c24-93c3-eee144ed246e', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:02 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-54387f50-ee27-49a2-8a23-a44883f3cdfc tempest-VolumesExtendTest-1652299505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (213ba1e5-aac4-4b70-88d9-bc0c52dc85b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:02 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-54387f50-ee27-49a2-8a23-a44883f3cdfc tempest-VolumesExtendTest-1652299505 None] Volume volume-18dde790-bbc4-4c24-93c3-eee144ed246e (18dde790-bbc4-4c24-93c3-eee144ed246e): created successfully Sep 28 17:18:02 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-54387f50-ee27-49a2-8a23-a44883f3cdfc tempest-VolumesExtendTest-1652299505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (213ba1e5-aac4-4b70-88d9-bc0c52dc85b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:02 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-54387f50-ee27-49a2-8a23-a44883f3cdfc tempest-VolumesExtendTest-1652299505 None] Flow 'volume_create_manager' (391dd3d3-faf6-4453-a48e-509b3582b765) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:02 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-54387f50-ee27-49a2-8a23-a44883f3cdfc tempest-VolumesExtendTest-1652299505 None] Created volume successfully. Sep 28 17:18:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3355f958-81ed-4ebe-80f1-cd46b01e47d6 tempest-VolumesExtendTest-1652299505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3355f958-81ed-4ebe-80f1-cd46b01e47d6 tempest-VolumesExtendTest-1652299505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:03 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-3355f958-81ed-4ebe-80f1-cd46b01e47d6 tempest-VolumesExtendTest-1652299505 None] Creating offline snapshot 846a8541-9cac-4ed6-a472-4e3d0585ac2b of volume 18dde790-bbc4-4c24-93c3-eee144ed246e {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:18:03 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7058c09e-f33f-4c46-a14a-1a34f6c65e80]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3355f958-81ed-4ebe-80f1-cd46b01e47d6 tempest-VolumesExtendTest-1652299505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:03 devstack sudo[96672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e Sep 28 17:18:03 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:04 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3355f958-81ed-4ebe-80f1-cd46b01e47d6 tempest-VolumesExtendTest-1652299505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e" returned: 0 in 1.053s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3355f958-81ed-4ebe-80f1-cd46b01e47d6 tempest-VolumesExtendTest-1652299505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e.846a8541-9cac-4ed6-a472-4e3d0585ac2b 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:04 devstack sudo[96679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e.846a8541-9cac-4ed6-a472-4e3d0585ac2b 1G Sep 28 17:18:04 devstack sudo[96679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:05 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-19355ebd-fcee-478b-8456-44d29be14c9e tempest-TestMinimumBasicScenario-1504157030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:18:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-19355ebd-fcee-478b-8456-44d29be14c9e tempest-TestMinimumBasicScenario-1504157030 None] Flow 'volume_create_manager' (d4afec19-0fdd-46ea-8ec9-b246010bee78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-19355ebd-fcee-478b-8456-44d29be14c9e tempest-TestMinimumBasicScenario-1504157030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac22d78c-942e-485c-9f5c-7d45f8aa687c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-19355ebd-fcee-478b-8456-44d29be14c9e tempest-TestMinimumBasicScenario-1504157030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac22d78c-942e-485c-9f5c-7d45f8aa687c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-182054571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5998d670-b6bd-4c9f-a606-a8fa0391abea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0d2fd27079044848d0abefae75cac63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:05Z,use_quota=True,user_id='e3fbf04b8b98427c96a2de3dd770bc60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-19355ebd-fcee-478b-8456-44d29be14c9e tempest-TestMinimumBasicScenario-1504157030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16609593-7999-49cf-9e58-89798d892510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-19355ebd-fcee-478b-8456-44d29be14c9e tempest-TestMinimumBasicScenario-1504157030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16609593-7999-49cf-9e58-89798d892510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-19355ebd-fcee-478b-8456-44d29be14c9e tempest-TestMinimumBasicScenario-1504157030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d40c0e02-9fbc-4783-9829-8b3dd8b9f218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-19355ebd-fcee-478b-8456-44d29be14c9e tempest-TestMinimumBasicScenario-1504157030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d40c0e02-9fbc-4783-9829-8b3dd8b9f218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5998d670-b6bd-4c9f-a606-a8fa0391abea', 'volume_name': 'volume-5998d670-b6bd-4c9f-a606-a8fa0391abea', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-19355ebd-fcee-478b-8456-44d29be14c9e tempest-TestMinimumBasicScenario-1504157030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b07077c0-570c-4675-888b-52454a178357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-19355ebd-fcee-478b-8456-44d29be14c9e tempest-TestMinimumBasicScenario-1504157030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b07077c0-570c-4675-888b-52454a178357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-19355ebd-fcee-478b-8456-44d29be14c9e tempest-TestMinimumBasicScenario-1504157030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2af76427-7af6-4cf4-b256-36df01812ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:05 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-19355ebd-fcee-478b-8456-44d29be14c9e tempest-TestMinimumBasicScenario-1504157030 None] Volume 5998d670-b6bd-4c9f-a606-a8fa0391abea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5998d670-b6bd-4c9f-a606-a8fa0391abea', 'volume_size': 1} Sep 28 17:18:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-19355ebd-fcee-478b-8456-44d29be14c9e tempest-TestMinimumBasicScenario-1504157030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:05 devstack sudo[96679]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3355f958-81ed-4ebe-80f1-cd46b01e47d6 tempest-VolumesExtendTest-1652299505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e.846a8541-9cac-4ed6-a472-4e3d0585ac2b 1G" returned: 0 in 1.006s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3355f958-81ed-4ebe-80f1-cd46b01e47d6 tempest-VolumesExtendTest-1652299505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18dde790-bbc4-4c24-93c3-eee144ed246e -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e.846a8541-9cac-4ed6-a472-4e3d0585ac2b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:05 devstack sudo[96684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18dde790-bbc4-4c24-93c3-eee144ed246e -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e.846a8541-9cac-4ed6-a472-4e3d0585ac2b Sep 28 17:18:05 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:06 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3355f958-81ed-4ebe-80f1-cd46b01e47d6 tempest-VolumesExtendTest-1652299505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18dde790-bbc4-4c24-93c3-eee144ed246e -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e.846a8541-9cac-4ed6-a472-4e3d0585ac2b" returned: 0 in 0.525s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:06 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-3355f958-81ed-4ebe-80f1-cd46b01e47d6 tempest-VolumesExtendTest-1652299505 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e.846a8541-9cac-4ed6-a472-4e3d0585ac2b is being set with open permissions: ugo+rw Sep 28 17:18:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3355f958-81ed-4ebe-80f1-cd46b01e47d6 tempest-VolumesExtendTest-1652299505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e.846a8541-9cac-4ed6-a472-4e3d0585ac2b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:06 devstack sudo[96690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e.846a8541-9cac-4ed6-a472-4e3d0585ac2b Sep 28 17:18:06 devstack sudo[96690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:07 devstack sudo[96690]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3355f958-81ed-4ebe-80f1-cd46b01e47d6 tempest-VolumesExtendTest-1652299505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e.846a8541-9cac-4ed6-a472-4e3d0585ac2b" returned: 0 in 0.852s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3355f958-81ed-4ebe-80f1-cd46b01e47d6 tempest-VolumesExtendTest-1652299505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:07 devstack sudo[96694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e.info Sep 28 17:18:07 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:07 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3355f958-81ed-4ebe-80f1-cd46b01e47d6 tempest-VolumesExtendTest-1652299505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e.info" returned: 0 in 0.555s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:07 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-3355f958-81ed-4ebe-80f1-cd46b01e47d6 tempest-VolumesExtendTest-1652299505 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e.info is being set with open permissions: ugo+rw Sep 28 17:18:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3355f958-81ed-4ebe-80f1-cd46b01e47d6 tempest-VolumesExtendTest-1652299505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:07 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e.info Sep 28 17:18:07 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:08 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea1578e3-3995-4cd7-97ef-884205711bdb tempest-TestStampPattern-1988873608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:18:08 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:08 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ea1578e3-3995-4cd7-97ef-884205711bdb tempest-TestStampPattern-1988873608 None] Flow 'volume_create_manager' (0a669a3f-7bb9-45fe-ac93-23ec675715f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:08 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ea1578e3-3995-4cd7-97ef-884205711bdb tempest-TestStampPattern-1988873608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (720d0453-8780-4ec3-8af3-513d90652174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3355f958-81ed-4ebe-80f1-cd46b01e47d6 tempest-VolumesExtendTest-1652299505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e.info" returned: 0 in 0.721s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3355f958-81ed-4ebe-80f1-cd46b01e47d6 tempest-VolumesExtendTest-1652299505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.061s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-19355ebd-fcee-478b-8456-44d29be14c9e tempest-TestMinimumBasicScenario-1504157030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.248s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:08 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-19355ebd-fcee-478b-8456-44d29be14c9e tempest-TestMinimumBasicScenario-1504157030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-182054571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5998d670-b6bd-4c9f-a606-a8fa0391abea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0d2fd27079044848d0abefae75cac63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:05Z,use_quota=True,user_id='e3fbf04b8b98427c96a2de3dd770bc60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:18:08 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-19355ebd-fcee-478b-8456-44d29be14c9e tempest-TestMinimumBasicScenario-1504157030 None] Creating volume 5998d670-b6bd-4c9f-a606-a8fa0391abea {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:18:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-19355ebd-fcee-478b-8456-44d29be14c9e tempest-TestMinimumBasicScenario-1504157030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-19355ebd-fcee-478b-8456-44d29be14c9e tempest-TestMinimumBasicScenario-1504157030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:08 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-19355ebd-fcee-478b-8456-44d29be14c9e tempest-TestMinimumBasicScenario-1504157030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:08 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-19355ebd-fcee-478b-8456-44d29be14c9e tempest-TestMinimumBasicScenario-1504157030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-19355ebd-fcee-478b-8456-44d29be14c9e tempest-TestMinimumBasicScenario-1504157030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:08 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-19355ebd-fcee-478b-8456-44d29be14c9e tempest-TestMinimumBasicScenario-1504157030 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:18:08 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-19355ebd-fcee-478b-8456-44d29be14c9e tempest-TestMinimumBasicScenario-1504157030 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:18:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-19355ebd-fcee-478b-8456-44d29be14c9e tempest-TestMinimumBasicScenario-1504157030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5998d670-b6bd-4c9f-a606-a8fa0391abea 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:08 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ea1578e3-3995-4cd7-97ef-884205711bdb tempest-TestStampPattern-1988873608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (720d0453-8780-4ec3-8af3-513d90652174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-161409065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3035682a-178b-4675-8d92-5ba3a79dc306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a91ab04283a84867b0b761b67122134e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:08Z,use_quota=True,user_id='89f4bb8180604d35bd5944f8f8edfca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:08 devstack sudo[96715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5998d670-b6bd-4c9f-a606-a8fa0391abea 1073741824 Sep 28 17:18:08 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ea1578e3-3995-4cd7-97ef-884205711bdb tempest-TestStampPattern-1988873608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbf6b300-4010-4714-adcb-8a327ef52070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:08 devstack sudo[96715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:08 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ea1578e3-3995-4cd7-97ef-884205711bdb tempest-TestStampPattern-1988873608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbf6b300-4010-4714-adcb-8a327ef52070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:08 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ea1578e3-3995-4cd7-97ef-884205711bdb tempest-TestStampPattern-1988873608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c6acc2-82f0-4b13-9a54-c33748f2a6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:08 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ea1578e3-3995-4cd7-97ef-884205711bdb tempest-TestStampPattern-1988873608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c6acc2-82f0-4b13-9a54-c33748f2a6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3035682a-178b-4675-8d92-5ba3a79dc306', 'volume_name': 'volume-3035682a-178b-4675-8d92-5ba3a79dc306', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:08 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ea1578e3-3995-4cd7-97ef-884205711bdb tempest-TestStampPattern-1988873608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0038f107-c8a7-40b9-ad19-bff34367dc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:08 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ea1578e3-3995-4cd7-97ef-884205711bdb tempest-TestStampPattern-1988873608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0038f107-c8a7-40b9-ad19-bff34367dc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:08 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ea1578e3-3995-4cd7-97ef-884205711bdb tempest-TestStampPattern-1988873608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00757fa3-704e-4003-b17c-451b7fe99ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:08 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-ea1578e3-3995-4cd7-97ef-884205711bdb tempest-TestStampPattern-1988873608 None] Volume 3035682a-178b-4675-8d92-5ba3a79dc306: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3035682a-178b-4675-8d92-5ba3a79dc306', 'volume_size': 1} Sep 28 17:18:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ea1578e3-3995-4cd7-97ef-884205711bdb tempest-TestStampPattern-1988873608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:08 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-3355f958-81ed-4ebe-80f1-cd46b01e47d6 tempest-VolumesExtendTest-1652299505 None] Create snapshot completed successfully Sep 28 17:18:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6c72699f-3aea-4d18-8c92-9698618c88ec tempest-VolumesExtendTest-1652299505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:09 devstack sudo[96715]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-19355ebd-fcee-478b-8456-44d29be14c9e tempest-TestMinimumBasicScenario-1504157030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5998d670-b6bd-4c9f-a606-a8fa0391abea 1073741824" returned: 0 in 0.910s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-19355ebd-fcee-478b-8456-44d29be14c9e tempest-TestMinimumBasicScenario-1504157030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5998d670-b6bd-4c9f-a606-a8fa0391abea {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:09 devstack sudo[96727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5998d670-b6bd-4c9f-a606-a8fa0391abea Sep 28 17:18:09 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:10 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-19355ebd-fcee-478b-8456-44d29be14c9e tempest-TestMinimumBasicScenario-1504157030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5998d670-b6bd-4c9f-a606-a8fa0391abea" returned: 0 in 0.539s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:10 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-19355ebd-fcee-478b-8456-44d29be14c9e tempest-TestMinimumBasicScenario-1504157030 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:18:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-19355ebd-fcee-478b-8456-44d29be14c9e tempest-TestMinimumBasicScenario-1504157030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ea1578e3-3995-4cd7-97ef-884205711bdb tempest-TestStampPattern-1988873608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.409s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:10 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ea1578e3-3995-4cd7-97ef-884205711bdb tempest-TestStampPattern-1988873608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-161409065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3035682a-178b-4675-8d92-5ba3a79dc306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a91ab04283a84867b0b761b67122134e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:08Z,use_quota=True,user_id='89f4bb8180604d35bd5944f8f8edfca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:18:10 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-ea1578e3-3995-4cd7-97ef-884205711bdb tempest-TestStampPattern-1988873608 None] Creating volume 3035682a-178b-4675-8d92-5ba3a79dc306 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:18:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ea1578e3-3995-4cd7-97ef-884205711bdb tempest-TestStampPattern-1988873608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ea1578e3-3995-4cd7-97ef-884205711bdb tempest-TestStampPattern-1988873608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:10 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ea1578e3-3995-4cd7-97ef-884205711bdb tempest-TestStampPattern-1988873608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:10 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ea1578e3-3995-4cd7-97ef-884205711bdb tempest-TestStampPattern-1988873608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ea1578e3-3995-4cd7-97ef-884205711bdb tempest-TestStampPattern-1988873608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:10 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ea1578e3-3995-4cd7-97ef-884205711bdb tempest-TestStampPattern-1988873608 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:18:10 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-ea1578e3-3995-4cd7-97ef-884205711bdb tempest-TestStampPattern-1988873608 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:18:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ea1578e3-3995-4cd7-97ef-884205711bdb tempest-TestStampPattern-1988873608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:10 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-19355ebd-fcee-478b-8456-44d29be14c9e tempest-TestMinimumBasicScenario-1504157030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2af76427-7af6-4cf4-b256-36df01812ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5998d670-b6bd-4c9f-a606-a8fa0391abea', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:10 devstack sudo[96733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306 1073741824 Sep 28 17:18:10 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:10 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-19355ebd-fcee-478b-8456-44d29be14c9e tempest-TestMinimumBasicScenario-1504157030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31983eb5-d93e-413f-a59d-dc800e448cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:10 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-19355ebd-fcee-478b-8456-44d29be14c9e tempest-TestMinimumBasicScenario-1504157030 None] Volume volume-5998d670-b6bd-4c9f-a606-a8fa0391abea (5998d670-b6bd-4c9f-a606-a8fa0391abea): created successfully Sep 28 17:18:10 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-19355ebd-fcee-478b-8456-44d29be14c9e tempest-TestMinimumBasicScenario-1504157030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31983eb5-d93e-413f-a59d-dc800e448cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:10 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-19355ebd-fcee-478b-8456-44d29be14c9e tempest-TestMinimumBasicScenario-1504157030 None] Flow 'volume_create_manager' (d4afec19-0fdd-46ea-8ec9-b246010bee78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:10 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-19355ebd-fcee-478b-8456-44d29be14c9e tempest-TestMinimumBasicScenario-1504157030 None] Created volume successfully. Sep 28 17:18:11 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ea1578e3-3995-4cd7-97ef-884205711bdb tempest-TestStampPattern-1988873608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306 1073741824" returned: 0 in 1.266s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ea1578e3-3995-4cd7-97ef-884205711bdb tempest-TestStampPattern-1988873608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:11 devstack sudo[96762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306 Sep 28 17:18:11 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:12 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ea1578e3-3995-4cd7-97ef-884205711bdb tempest-TestStampPattern-1988873608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306" returned: 0 in 0.542s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:12 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ea1578e3-3995-4cd7-97ef-884205711bdb tempest-TestStampPattern-1988873608 None] <== create_volume: return (1933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:18:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ea1578e3-3995-4cd7-97ef-884205711bdb tempest-TestStampPattern-1988873608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6c72699f-3aea-4d18-8c92-9698618c88ec tempest-VolumesExtendTest-1652299505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.733s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:12 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[882b2c7a-b30f-462c-965f-ea0ca2c5f296]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6c72699f-3aea-4d18-8c92-9698618c88ec tempest-VolumesExtendTest-1652299505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ea1578e3-3995-4cd7-97ef-884205711bdb tempest-TestStampPattern-1988873608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00757fa3-704e-4003-b17c-451b7fe99ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3035682a-178b-4675-8d92-5ba3a79dc306', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ea1578e3-3995-4cd7-97ef-884205711bdb tempest-TestStampPattern-1988873608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faf4c0fb-0b37-4a41-b410-6f6eeaa06ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:12 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-ea1578e3-3995-4cd7-97ef-884205711bdb tempest-TestStampPattern-1988873608 None] Volume volume-3035682a-178b-4675-8d92-5ba3a79dc306 (3035682a-178b-4675-8d92-5ba3a79dc306): created successfully Sep 28 17:18:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ea1578e3-3995-4cd7-97ef-884205711bdb tempest-TestStampPattern-1988873608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faf4c0fb-0b37-4a41-b410-6f6eeaa06ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ea1578e3-3995-4cd7-97ef-884205711bdb tempest-TestStampPattern-1988873608 None] Flow 'volume_create_manager' (0a669a3f-7bb9-45fe-ac93-23ec675715f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:12 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-ea1578e3-3995-4cd7-97ef-884205711bdb tempest-TestStampPattern-1988873608 None] Created volume successfully. Sep 28 17:18:12 devstack sudo[96766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e Sep 28 17:18:12 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:12 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6c72699f-3aea-4d18-8c92-9698618c88ec tempest-VolumesExtendTest-1652299505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e" returned: 0 in 0.781s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6c72699f-3aea-4d18-8c92-9698618c88ec tempest-VolumesExtendTest-1652299505 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e.846a8541-9cac-4ed6-a472-4e3d0585ac2b 2G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6c72699f-3aea-4d18-8c92-9698618c88ec tempest-VolumesExtendTest-1652299505 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e.846a8541-9cac-4ed6-a472-4e3d0585ac2b 2G" returned: 0 in 0.534s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6c72699f-3aea-4d18-8c92-9698618c88ec tempest-VolumesExtendTest-1652299505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.406s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:13 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-6c72699f-3aea-4d18-8c92-9698618c88ec tempest-VolumesExtendTest-1652299505 None] Extend volume completed successfully. Sep 28 17:18:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-e8e9c897-351e-40d6-872b-cd023ae96278 req-9ff09ae2-f9a4-46dd-a2cf-ce157318ecae tempest-TestMinimumBasicScenario-1504157030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-e8e9c897-351e-40d6-872b-cd023ae96278 req-9ff09ae2-f9a4-46dd-a2cf-ce157318ecae tempest-TestMinimumBasicScenario-1504157030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-e8e9c897-351e-40d6-872b-cd023ae96278 req-9ff09ae2-f9a4-46dd-a2cf-ce157318ecae tempest-TestMinimumBasicScenario-1504157030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:13 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-e8e9c897-351e-40d6-872b-cd023ae96278 req-9ff09ae2-f9a4-46dd-a2cf-ce157318ecae tempest-TestMinimumBasicScenario-1504157030 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069', 'name': 'volume-5998d670-b6bd-4c9f-a606-a8fa0391abea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '388df04f-5943-41bb-9a3f-efc595955c0f', 'enforce_multipath': True} {{(pid=86917) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:18:14 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-e8e9c897-351e-40d6-872b-cd023ae96278 req-9ff09ae2-f9a4-46dd-a2cf-ce157318ecae tempest-TestMinimumBasicScenario-1504157030 None] attachment_update completed successfully. Sep 28 17:18:14 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-bcbd1d26-ad07-46e1-be9a-e8f6dc7df996 tempest-VolumesExtendTest-1652299505 None] Acquiring lock "cinder-846a8541-9cac-4ed6-a472-4e3d0585ac2b-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:14 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-bcbd1d26-ad07-46e1-be9a-e8f6dc7df996 tempest-VolumesExtendTest-1652299505 None] Lock "cinder-846a8541-9cac-4ed6-a472-4e3d0585ac2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:14 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-bcbd1d26-ad07-46e1-be9a-e8f6dc7df996 tempest-VolumesExtendTest-1652299505 None] Acquiring lock "cinder-quobyte-18dde790-bbc4-4c24-93c3-eee144ed246e" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:14 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-bcbd1d26-ad07-46e1-be9a-e8f6dc7df996 tempest-VolumesExtendTest-1652299505 None] Lock "cinder-quobyte-18dde790-bbc4-4c24-93c3-eee144ed246e" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:14 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-bcbd1d26-ad07-46e1-be9a-e8f6dc7df996 tempest-VolumesExtendTest-1652299505 None] Acquiring lock "cinder-quobyte-846a8541-9cac-4ed6-a472-4e3d0585ac2b" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:14 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-bcbd1d26-ad07-46e1-be9a-e8f6dc7df996 tempest-VolumesExtendTest-1652299505 None] Lock "cinder-quobyte-846a8541-9cac-4ed6-a472-4e3d0585ac2b" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:14 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-bcbd1d26-ad07-46e1-be9a-e8f6dc7df996 tempest-VolumesExtendTest-1652299505 None] Deleting offline snapshot 846a8541-9cac-4ed6-a472-4e3d0585ac2b of volume 18dde790-bbc4-4c24-93c3-eee144ed246e {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:18:14 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-bcbd1d26-ad07-46e1-be9a-e8f6dc7df996 tempest-VolumesExtendTest-1652299505 None] snapshot_file for this snap is: volume-18dde790-bbc4-4c24-93c3-eee144ed246e.846a8541-9cac-4ed6-a472-4e3d0585ac2b {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:18:14 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c7c531-5f1e-4e5e-8367-958656169f26]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bcbd1d26-ad07-46e1-be9a-e8f6dc7df996 tempest-VolumesExtendTest-1652299505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e.846a8541-9cac-4ed6-a472-4e3d0585ac2b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:15 devstack sudo[96956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e.846a8541-9cac-4ed6-a472-4e3d0585ac2b Sep 28 17:18:15 devstack sudo[96956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:15 devstack sudo[96956]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bcbd1d26-ad07-46e1-be9a-e8f6dc7df996 tempest-VolumesExtendTest-1652299505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e.846a8541-9cac-4ed6-a472-4e3d0585ac2b" returned: 0 in 0.707s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:15 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-bcbd1d26-ad07-46e1-be9a-e8f6dc7df996 tempest-VolumesExtendTest-1652299505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18dde790-bbc4-4c24-93c3-eee144ed246e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:18:15 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[135739b1-597c-49bb-a650-cd96f0e9bba9]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bcbd1d26-ad07-46e1-be9a-e8f6dc7df996 tempest-VolumesExtendTest-1652299505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:15 devstack sudo[97296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e Sep 28 17:18:15 devstack sudo[97296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:16 devstack sudo[97296]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bcbd1d26-ad07-46e1-be9a-e8f6dc7df996 tempest-VolumesExtendTest-1652299505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e" returned: 0 in 0.650s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bcbd1d26-ad07-46e1-be9a-e8f6dc7df996 tempest-VolumesExtendTest-1652299505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e.846a8541-9cac-4ed6-a472-4e3d0585ac2b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:16 devstack sudo[97312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e.846a8541-9cac-4ed6-a472-4e3d0585ac2b Sep 28 17:18:16 devstack sudo[97312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:17 devstack sudo[97312]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bcbd1d26-ad07-46e1-be9a-e8f6dc7df996 tempest-VolumesExtendTest-1652299505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e.846a8541-9cac-4ed6-a472-4e3d0585ac2b" returned: 0 in 0.898s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bcbd1d26-ad07-46e1-be9a-e8f6dc7df996 tempest-VolumesExtendTest-1652299505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e.846a8541-9cac-4ed6-a472-4e3d0585ac2b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:17 devstack sudo[97318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e.846a8541-9cac-4ed6-a472-4e3d0585ac2b Sep 28 17:18:17 devstack sudo[97318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:17 devstack sudo[97318]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bcbd1d26-ad07-46e1-be9a-e8f6dc7df996 tempest-VolumesExtendTest-1652299505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e.846a8541-9cac-4ed6-a472-4e3d0585ac2b" returned: 0 in 0.526s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:17 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-bcbd1d26-ad07-46e1-be9a-e8f6dc7df996 tempest-VolumesExtendTest-1652299505 None] Lock "cinder-quobyte-846a8541-9cac-4ed6-a472-4e3d0585ac2b" released by "_delete_snapshot" :: held 3.181s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:17 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-bcbd1d26-ad07-46e1-be9a-e8f6dc7df996 tempest-VolumesExtendTest-1652299505 None] Lock "cinder-quobyte-18dde790-bbc4-4c24-93c3-eee144ed246e" released by "delete_snapshot" :: held 3.234s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:18 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-bcbd1d26-ad07-46e1-be9a-e8f6dc7df996 tempest-VolumesExtendTest-1652299505 None] Created reservations ['540d64de-eb19-46a1-8c21-2b908816d196', 'b49c64fd-3c51-43a8-b883-5c6f8e6c472d', 'fd4d2ee0-f280-4b48-a410-3eb39c310fc3', 'dc2f6f5d-428b-41f6-9a32-e91ee6874985'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:18:18 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-bcbd1d26-ad07-46e1-be9a-e8f6dc7df996 tempest-VolumesExtendTest-1652299505 None] Delete snapshot completed successfully. Sep 28 17:18:18 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-bcbd1d26-ad07-46e1-be9a-e8f6dc7df996 tempest-VolumesExtendTest-1652299505 None] Lock "cinder-846a8541-9cac-4ed6-a472-4e3d0585ac2b-delete_snapshot" released by "delete_snapshot" :: held 3.665s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:19 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-3fd28fd5-aa59-4fda-a518-8f9f5b714f1c tempest-VolumesExtendTest-1652299505 None] Acquiring lock "cinder-18dde790-bbc4-4c24-93c3-eee144ed246e-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:19 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-3fd28fd5-aa59-4fda-a518-8f9f5b714f1c tempest-VolumesExtendTest-1652299505 None] Lock "cinder-18dde790-bbc4-4c24-93c3-eee144ed246e-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:19 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-3fd28fd5-aa59-4fda-a518-8f9f5b714f1c tempest-VolumesExtendTest-1652299505 None] Acquiring lock "cinder-quobyte-18dde790-bbc4-4c24-93c3-eee144ed246e" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:19 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-3fd28fd5-aa59-4fda-a518-8f9f5b714f1c tempest-VolumesExtendTest-1652299505 None] Lock "cinder-quobyte-18dde790-bbc4-4c24-93c3-eee144ed246e" acquired by "delete_volume" :: waited 0.075s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:19 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d940b8-e0fe-4cfd-9648-ae6fc79dba20]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3fd28fd5-aa59-4fda-a518-8f9f5b714f1c tempest-VolumesExtendTest-1652299505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:20 devstack sudo[97369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e Sep 28 17:18:20 devstack sudo[97369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:20 devstack sudo[97369]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3fd28fd5-aa59-4fda-a518-8f9f5b714f1c tempest-VolumesExtendTest-1652299505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e" returned: 0 in 0.906s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3fd28fd5-aa59-4fda-a518-8f9f5b714f1c tempest-VolumesExtendTest-1652299505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:20 devstack sudo[97378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e Sep 28 17:18:20 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:21 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3fd28fd5-aa59-4fda-a518-8f9f5b714f1c tempest-VolumesExtendTest-1652299505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18dde790-bbc4-4c24-93c3-eee144ed246e" returned: 0 in 0.609s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:21 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-3fd28fd5-aa59-4fda-a518-8f9f5b714f1c tempest-VolumesExtendTest-1652299505 None] Lock "cinder-quobyte-18dde790-bbc4-4c24-93c3-eee144ed246e" released by "delete_volume" :: held 1.708s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:21 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-3fd28fd5-aa59-4fda-a518-8f9f5b714f1c tempest-VolumesExtendTest-1652299505 None] Created reservations ['033b7fcf-18b6-47c0-bb95-9b1be462d062', 'e6b73140-4632-4114-a8a0-c8468624cdc7', '05280c95-4403-4914-b949-274e84916b27', 'e32bff35-0349-4948-ae3f-b92fb940d6d3'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:18:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3fd28fd5-aa59-4fda-a518-8f9f5b714f1c tempest-VolumesExtendTest-1652299505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3fd28fd5-aa59-4fda-a518-8f9f5b714f1c tempest-VolumesExtendTest-1652299505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:21 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-3fd28fd5-aa59-4fda-a518-8f9f5b714f1c tempest-VolumesExtendTest-1652299505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:21 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-3fd28fd5-aa59-4fda-a518-8f9f5b714f1c tempest-VolumesExtendTest-1652299505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3fd28fd5-aa59-4fda-a518-8f9f5b714f1c tempest-VolumesExtendTest-1652299505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.073s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3fd28fd5-aa59-4fda-a518-8f9f5b714f1c tempest-VolumesExtendTest-1652299505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:22 devstack sudo[97412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:18:22 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:22 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3fd28fd5-aa59-4fda-a518-8f9f5b714f1c tempest-VolumesExtendTest-1652299505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.871s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:22 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-3fd28fd5-aa59-4fda-a518-8f9f5b714f1c tempest-VolumesExtendTest-1652299505 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:18:22 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-3fd28fd5-aa59-4fda-a518-8f9f5b714f1c tempest-VolumesExtendTest-1652299505 None] Deleted volume successfully. Sep 28 17:18:22 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-3fd28fd5-aa59-4fda-a518-8f9f5b714f1c tempest-VolumesExtendTest-1652299505 None] Lock "cinder-18dde790-bbc4-4c24-93c3-eee144ed246e-delete_volume" released by "delete_volume" :: held 3.522s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:31 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:UPDATE=58,cinder:SELECT=52,cinder:DELETE=6,cinder:INSERT=17 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:18:32 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=49,cinder:INSERT=18,cinder:UPDATE=46,cinder:DELETE=3 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:18:34 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-49f68a98-5d27-4d42-b215-7ffe3441027e tempest-VolumesGetTest-991115499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:18:34 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-49f68a98-5d27-4d42-b215-7ffe3441027e tempest-VolumesGetTest-991115499 None] Flow 'volume_create_manager' (b133a70e-90de-4473-8951-a438073688a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:34 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-49f68a98-5d27-4d42-b215-7ffe3441027e tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b392a4e9-836b-47cf-92c0-94da99c37605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:34 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-49f68a98-5d27-4d42-b215-7ffe3441027e tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b392a4e9-836b-47cf-92c0-94da99c37605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1421485437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89354d25-6658-4df9-9261-50210d6a1df4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='dd3415289a214e76aa08bf911005d4b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:35Z,use_quota=True,user_id='6575b687682e46aaa1e2c968f24beae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:34 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-49f68a98-5d27-4d42-b215-7ffe3441027e tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca235ec-88a6-49e0-896b-78fd057c6a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:34 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-49f68a98-5d27-4d42-b215-7ffe3441027e tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca235ec-88a6-49e0-896b-78fd057c6a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:34 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-49f68a98-5d27-4d42-b215-7ffe3441027e tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61567dfd-c6cb-4262-86fb-605f5802135a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:34 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-49f68a98-5d27-4d42-b215-7ffe3441027e tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61567dfd-c6cb-4262-86fb-605f5802135a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89354d25-6658-4df9-9261-50210d6a1df4', 'volume_name': 'volume-89354d25-6658-4df9-9261-50210d6a1df4', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:34 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-49f68a98-5d27-4d42-b215-7ffe3441027e tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bce98ff-5d27-46eb-8c72-4c6650ebbedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:34 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-49f68a98-5d27-4d42-b215-7ffe3441027e tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bce98ff-5d27-46eb-8c72-4c6650ebbedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:34 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-49f68a98-5d27-4d42-b215-7ffe3441027e tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69393963-bf40-4ef5-8516-3d61278334d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:34 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-49f68a98-5d27-4d42-b215-7ffe3441027e tempest-VolumesGetTest-991115499 None] Volume 89354d25-6658-4df9-9261-50210d6a1df4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89354d25-6658-4df9-9261-50210d6a1df4', 'volume_size': 1} Sep 28 17:18:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-49f68a98-5d27-4d42-b215-7ffe3441027e tempest-VolumesGetTest-991115499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-49f68a98-5d27-4d42-b215-7ffe3441027e tempest-VolumesGetTest-991115499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:34 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-49f68a98-5d27-4d42-b215-7ffe3441027e tempest-VolumesGetTest-991115499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1421485437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89354d25-6658-4df9-9261-50210d6a1df4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='dd3415289a214e76aa08bf911005d4b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:35Z,use_quota=True,user_id='6575b687682e46aaa1e2c968f24beae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:18:34 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-49f68a98-5d27-4d42-b215-7ffe3441027e tempest-VolumesGetTest-991115499 None] Creating volume 89354d25-6658-4df9-9261-50210d6a1df4 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:18:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-49f68a98-5d27-4d42-b215-7ffe3441027e tempest-VolumesGetTest-991115499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-49f68a98-5d27-4d42-b215-7ffe3441027e tempest-VolumesGetTest-991115499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:34 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-49f68a98-5d27-4d42-b215-7ffe3441027e tempest-VolumesGetTest-991115499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:34 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-49f68a98-5d27-4d42-b215-7ffe3441027e tempest-VolumesGetTest-991115499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-49f68a98-5d27-4d42-b215-7ffe3441027e tempest-VolumesGetTest-991115499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:34 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-49f68a98-5d27-4d42-b215-7ffe3441027e tempest-VolumesGetTest-991115499 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:18:34 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-49f68a98-5d27-4d42-b215-7ffe3441027e tempest-VolumesGetTest-991115499 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:18:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-49f68a98-5d27-4d42-b215-7ffe3441027e tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-89354d25-6658-4df9-9261-50210d6a1df4 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:34 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-89354d25-6658-4df9-9261-50210d6a1df4 1073741824 Sep 28 17:18:34 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:35 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-49f68a98-5d27-4d42-b215-7ffe3441027e tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-89354d25-6658-4df9-9261-50210d6a1df4 1073741824" returned: 0 in 0.795s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-49f68a98-5d27-4d42-b215-7ffe3441027e tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-89354d25-6658-4df9-9261-50210d6a1df4 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:35 devstack sudo[97543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-89354d25-6658-4df9-9261-50210d6a1df4 Sep 28 17:18:35 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:36 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-49f68a98-5d27-4d42-b215-7ffe3441027e tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-89354d25-6658-4df9-9261-50210d6a1df4" returned: 0 in 0.457s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:36 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-49f68a98-5d27-4d42-b215-7ffe3441027e tempest-VolumesGetTest-991115499 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:18:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-49f68a98-5d27-4d42-b215-7ffe3441027e tempest-VolumesGetTest-991115499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-49f68a98-5d27-4d42-b215-7ffe3441027e tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69393963-bf40-4ef5-8516-3d61278334d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89354d25-6658-4df9-9261-50210d6a1df4', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-49f68a98-5d27-4d42-b215-7ffe3441027e tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (438eda3f-fae7-4981-9598-6db14713f51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:36 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-49f68a98-5d27-4d42-b215-7ffe3441027e tempest-VolumesGetTest-991115499 None] Volume volume-89354d25-6658-4df9-9261-50210d6a1df4 (89354d25-6658-4df9-9261-50210d6a1df4): created successfully Sep 28 17:18:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-49f68a98-5d27-4d42-b215-7ffe3441027e tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (438eda3f-fae7-4981-9598-6db14713f51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-49f68a98-5d27-4d42-b215-7ffe3441027e tempest-VolumesGetTest-991115499 None] Flow 'volume_create_manager' (b133a70e-90de-4473-8951-a438073688a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:36 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-49f68a98-5d27-4d42-b215-7ffe3441027e tempest-VolumesGetTest-991115499 None] Created volume successfully. Sep 28 17:18:38 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fa31c82-c6ab-4b64-95c8-99f61cd68b8f tempest-VolumesGetTest-991115499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:18:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4fa31c82-c6ab-4b64-95c8-99f61cd68b8f tempest-VolumesGetTest-991115499 None] Flow 'volume_create_manager' (557fefaa-b952-404a-ba07-9d66d113da16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4fa31c82-c6ab-4b64-95c8-99f61cd68b8f tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd4a2ef-887d-4f39-9873-c888b1eab047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4fa31c82-c6ab-4b64-95c8-99f61cd68b8f tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd4a2ef-887d-4f39-9873-c888b1eab047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-382216072',display_name='tempest-VolumesGetTest-Volume-1458091223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b4a3124-34b6-4e03-bb13-1709abb4930d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3415289a214e76aa08bf911005d4b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:39Z,use_quota=True,user_id='6575b687682e46aaa1e2c968f24beae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4fa31c82-c6ab-4b64-95c8-99f61cd68b8f tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa80d51-5af2-4ebb-b805-6d3f12dc5ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4fa31c82-c6ab-4b64-95c8-99f61cd68b8f tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa80d51-5af2-4ebb-b805-6d3f12dc5ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4fa31c82-c6ab-4b64-95c8-99f61cd68b8f tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5446c0c4-8b3b-4963-bcc4-c63523734123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4fa31c82-c6ab-4b64-95c8-99f61cd68b8f tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5446c0c4-8b3b-4963-bcc4-c63523734123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b4a3124-34b6-4e03-bb13-1709abb4930d', 'volume_name': 'volume-2b4a3124-34b6-4e03-bb13-1709abb4930d', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4fa31c82-c6ab-4b64-95c8-99f61cd68b8f tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cbcbce7-f3c7-4aed-b0f5-a8961b0b7367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4fa31c82-c6ab-4b64-95c8-99f61cd68b8f tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cbcbce7-f3c7-4aed-b0f5-a8961b0b7367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4fa31c82-c6ab-4b64-95c8-99f61cd68b8f tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82357e36-e0c5-42a4-90a6-71cf5c6a1be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:38 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-4fa31c82-c6ab-4b64-95c8-99f61cd68b8f tempest-VolumesGetTest-991115499 None] Volume 2b4a3124-34b6-4e03-bb13-1709abb4930d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b4a3124-34b6-4e03-bb13-1709abb4930d', 'volume_size': 1} Sep 28 17:18:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4fa31c82-c6ab-4b64-95c8-99f61cd68b8f tempest-VolumesGetTest-991115499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4fa31c82-c6ab-4b64-95c8-99f61cd68b8f tempest-VolumesGetTest-991115499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:38 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4fa31c82-c6ab-4b64-95c8-99f61cd68b8f tempest-VolumesGetTest-991115499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-382216072',display_name='tempest-VolumesGetTest-Volume-1458091223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b4a3124-34b6-4e03-bb13-1709abb4930d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3415289a214e76aa08bf911005d4b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:39Z,use_quota=True,user_id='6575b687682e46aaa1e2c968f24beae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:18:38 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-4fa31c82-c6ab-4b64-95c8-99f61cd68b8f tempest-VolumesGetTest-991115499 None] Creating volume 2b4a3124-34b6-4e03-bb13-1709abb4930d {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:18:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4fa31c82-c6ab-4b64-95c8-99f61cd68b8f tempest-VolumesGetTest-991115499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4fa31c82-c6ab-4b64-95c8-99f61cd68b8f tempest-VolumesGetTest-991115499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:38 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4fa31c82-c6ab-4b64-95c8-99f61cd68b8f tempest-VolumesGetTest-991115499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:39 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4fa31c82-c6ab-4b64-95c8-99f61cd68b8f tempest-VolumesGetTest-991115499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4fa31c82-c6ab-4b64-95c8-99f61cd68b8f tempest-VolumesGetTest-991115499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:39 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4fa31c82-c6ab-4b64-95c8-99f61cd68b8f tempest-VolumesGetTest-991115499 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:18:39 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-4fa31c82-c6ab-4b64-95c8-99f61cd68b8f tempest-VolumesGetTest-991115499 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:18:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4fa31c82-c6ab-4b64-95c8-99f61cd68b8f tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2b4a3124-34b6-4e03-bb13-1709abb4930d 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:39 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2b4a3124-34b6-4e03-bb13-1709abb4930d 1073741824 Sep 28 17:18:39 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:39 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4fa31c82-c6ab-4b64-95c8-99f61cd68b8f tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2b4a3124-34b6-4e03-bb13-1709abb4930d 1073741824" returned: 0 in 0.838s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4fa31c82-c6ab-4b64-95c8-99f61cd68b8f tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2b4a3124-34b6-4e03-bb13-1709abb4930d {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:39 devstack sudo[97557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2b4a3124-34b6-4e03-bb13-1709abb4930d Sep 28 17:18:39 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:40 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4fa31c82-c6ab-4b64-95c8-99f61cd68b8f tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2b4a3124-34b6-4e03-bb13-1709abb4930d" returned: 0 in 0.342s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:40 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4fa31c82-c6ab-4b64-95c8-99f61cd68b8f tempest-VolumesGetTest-991115499 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:18:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4fa31c82-c6ab-4b64-95c8-99f61cd68b8f tempest-VolumesGetTest-991115499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4fa31c82-c6ab-4b64-95c8-99f61cd68b8f tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82357e36-e0c5-42a4-90a6-71cf5c6a1be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b4a3124-34b6-4e03-bb13-1709abb4930d', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4fa31c82-c6ab-4b64-95c8-99f61cd68b8f tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (829c098a-7930-4e93-9743-2c44f8bf8537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:40 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-4fa31c82-c6ab-4b64-95c8-99f61cd68b8f tempest-VolumesGetTest-991115499 None] Volume volume-2b4a3124-34b6-4e03-bb13-1709abb4930d (2b4a3124-34b6-4e03-bb13-1709abb4930d): created successfully Sep 28 17:18:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4fa31c82-c6ab-4b64-95c8-99f61cd68b8f tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (829c098a-7930-4e93-9743-2c44f8bf8537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4fa31c82-c6ab-4b64-95c8-99f61cd68b8f tempest-VolumesGetTest-991115499 None] Flow 'volume_create_manager' (557fefaa-b952-404a-ba07-9d66d113da16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:40 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-4fa31c82-c6ab-4b64-95c8-99f61cd68b8f tempest-VolumesGetTest-991115499 None] Created volume successfully. Sep 28 17:18:41 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5edfe813-b57c-48da-9501-284d99e5a683 tempest-VolumesGetTest-991115499 None] Acquiring lock "cinder-2b4a3124-34b6-4e03-bb13-1709abb4930d-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:41 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5edfe813-b57c-48da-9501-284d99e5a683 tempest-VolumesGetTest-991115499 None] Lock "cinder-2b4a3124-34b6-4e03-bb13-1709abb4930d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:41 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5edfe813-b57c-48da-9501-284d99e5a683 tempest-VolumesGetTest-991115499 None] Acquiring lock "cinder-quobyte-2b4a3124-34b6-4e03-bb13-1709abb4930d" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:41 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5edfe813-b57c-48da-9501-284d99e5a683 tempest-VolumesGetTest-991115499 None] Lock "cinder-quobyte-2b4a3124-34b6-4e03-bb13-1709abb4930d" acquired by "delete_volume" :: waited 0.025s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:41 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a8db91-2b99-4380-b639-51d9b9e44989]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5edfe813-b57c-48da-9501-284d99e5a683 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2b4a3124-34b6-4e03-bb13-1709abb4930d {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:41 devstack sudo[97561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2b4a3124-34b6-4e03-bb13-1709abb4930d Sep 28 17:18:41 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:41 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5edfe813-b57c-48da-9501-284d99e5a683 tempest-VolumesGetTest-991115499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2b4a3124-34b6-4e03-bb13-1709abb4930d" returned: 0 in 0.507s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5edfe813-b57c-48da-9501-284d99e5a683 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2b4a3124-34b6-4e03-bb13-1709abb4930d {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:41 devstack sudo[97566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2b4a3124-34b6-4e03-bb13-1709abb4930d Sep 28 17:18:41 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:42 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5edfe813-b57c-48da-9501-284d99e5a683 tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2b4a3124-34b6-4e03-bb13-1709abb4930d" returned: 0 in 0.485s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:42 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5edfe813-b57c-48da-9501-284d99e5a683 tempest-VolumesGetTest-991115499 None] Lock "cinder-quobyte-2b4a3124-34b6-4e03-bb13-1709abb4930d" released by "delete_volume" :: held 1.060s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:42 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-5edfe813-b57c-48da-9501-284d99e5a683 tempest-VolumesGetTest-991115499 None] Created reservations ['b2d5279e-5de4-4be9-98ed-ed6f9e0ae48a', 'f00e696c-27a5-4725-b4cf-903efce3b2f6', '36bd7ae3-3f65-4c51-84ae-769b49f592e8', '78eb7c88-72d2-4db0-8ab4-15fa610126e3'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:18:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5edfe813-b57c-48da-9501-284d99e5a683 tempest-VolumesGetTest-991115499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5edfe813-b57c-48da-9501-284d99e5a683 tempest-VolumesGetTest-991115499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:42 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-5edfe813-b57c-48da-9501-284d99e5a683 tempest-VolumesGetTest-991115499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:42 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-5edfe813-b57c-48da-9501-284d99e5a683 tempest-VolumesGetTest-991115499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5edfe813-b57c-48da-9501-284d99e5a683 tempest-VolumesGetTest-991115499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5edfe813-b57c-48da-9501-284d99e5a683 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:42 devstack sudo[97597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:18:42 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:43 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5edfe813-b57c-48da-9501-284d99e5a683 tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.341s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:43 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-5edfe813-b57c-48da-9501-284d99e5a683 tempest-VolumesGetTest-991115499 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:18:43 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-5edfe813-b57c-48da-9501-284d99e5a683 tempest-VolumesGetTest-991115499 None] Deleted volume successfully. Sep 28 17:18:43 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5edfe813-b57c-48da-9501-284d99e5a683 tempest-VolumesGetTest-991115499 None] Lock "cinder-2b4a3124-34b6-4e03-bb13-1709abb4930d-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:43 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1a6bb4ed-9b52-4e2a-b0e1-6038e2227bda tempest-VolumesGetTest-991115499 None] Acquiring lock "cinder-89354d25-6658-4df9-9261-50210d6a1df4-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:43 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1a6bb4ed-9b52-4e2a-b0e1-6038e2227bda tempest-VolumesGetTest-991115499 None] Lock "cinder-89354d25-6658-4df9-9261-50210d6a1df4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:43 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1a6bb4ed-9b52-4e2a-b0e1-6038e2227bda tempest-VolumesGetTest-991115499 None] Acquiring lock "cinder-quobyte-89354d25-6658-4df9-9261-50210d6a1df4" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:43 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1a6bb4ed-9b52-4e2a-b0e1-6038e2227bda tempest-VolumesGetTest-991115499 None] Lock "cinder-quobyte-89354d25-6658-4df9-9261-50210d6a1df4" acquired by "delete_volume" :: waited 0.021s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:43 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ec8019-2475-4bca-847d-3610afdc1793]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1a6bb4ed-9b52-4e2a-b0e1-6038e2227bda tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-89354d25-6658-4df9-9261-50210d6a1df4 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:44 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-89354d25-6658-4df9-9261-50210d6a1df4 Sep 28 17:18:44 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:44 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba0b8284-b978-4a31-ab70-0ba10f32274d tempest-AttachVolumeNegativeTest-158509557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:18:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ba0b8284-b978-4a31-ab70-0ba10f32274d tempest-AttachVolumeNegativeTest-158509557 None] Flow 'volume_create_manager' (8259c3cc-83b9-498a-8b9f-47f4ae82ed44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ba0b8284-b978-4a31-ab70-0ba10f32274d tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35ea1946-422d-4fab-903a-b8d376696bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ba0b8284-b978-4a31-ab70-0ba10f32274d tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35ea1946-422d-4fab-903a-b8d376696bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1223110312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67182fbe-2e00-4b26-bf42-e2edf0d5d39c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e41dab614240d2b055b96b240d7125',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:44Z,use_quota=True,user_id='f95bafa9537c4a559275623e6bb50109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ba0b8284-b978-4a31-ab70-0ba10f32274d tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (117ce85f-8f5b-433f-bf07-02eb89208ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ba0b8284-b978-4a31-ab70-0ba10f32274d tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (117ce85f-8f5b-433f-bf07-02eb89208ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ba0b8284-b978-4a31-ab70-0ba10f32274d tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf4d736-8a62-469e-bb09-9111d4b131d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ba0b8284-b978-4a31-ab70-0ba10f32274d tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf4d736-8a62-469e-bb09-9111d4b131d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67182fbe-2e00-4b26-bf42-e2edf0d5d39c', 'volume_name': 'volume-67182fbe-2e00-4b26-bf42-e2edf0d5d39c', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ba0b8284-b978-4a31-ab70-0ba10f32274d tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d738ab-1068-4f7c-8516-8894da5c8fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ba0b8284-b978-4a31-ab70-0ba10f32274d tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d738ab-1068-4f7c-8516-8894da5c8fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ba0b8284-b978-4a31-ab70-0ba10f32274d tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f8306eb-c011-4a4a-a78c-8a3c8ab1eb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:44 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-ba0b8284-b978-4a31-ab70-0ba10f32274d tempest-AttachVolumeNegativeTest-158509557 None] Volume 67182fbe-2e00-4b26-bf42-e2edf0d5d39c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67182fbe-2e00-4b26-bf42-e2edf0d5d39c', 'volume_size': 1} Sep 28 17:18:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ba0b8284-b978-4a31-ab70-0ba10f32274d tempest-AttachVolumeNegativeTest-158509557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ba0b8284-b978-4a31-ab70-0ba10f32274d tempest-AttachVolumeNegativeTest-158509557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:44 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ba0b8284-b978-4a31-ab70-0ba10f32274d tempest-AttachVolumeNegativeTest-158509557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1223110312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67182fbe-2e00-4b26-bf42-e2edf0d5d39c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e41dab614240d2b055b96b240d7125',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:44Z,use_quota=True,user_id='f95bafa9537c4a559275623e6bb50109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:18:44 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-ba0b8284-b978-4a31-ab70-0ba10f32274d tempest-AttachVolumeNegativeTest-158509557 None] Creating volume 67182fbe-2e00-4b26-bf42-e2edf0d5d39c {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:18:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ba0b8284-b978-4a31-ab70-0ba10f32274d tempest-AttachVolumeNegativeTest-158509557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ba0b8284-b978-4a31-ab70-0ba10f32274d tempest-AttachVolumeNegativeTest-158509557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:44 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ba0b8284-b978-4a31-ab70-0ba10f32274d tempest-AttachVolumeNegativeTest-158509557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:44 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ba0b8284-b978-4a31-ab70-0ba10f32274d tempest-AttachVolumeNegativeTest-158509557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ba0b8284-b978-4a31-ab70-0ba10f32274d tempest-AttachVolumeNegativeTest-158509557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:44 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ba0b8284-b978-4a31-ab70-0ba10f32274d tempest-AttachVolumeNegativeTest-158509557 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:18:44 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-ba0b8284-b978-4a31-ab70-0ba10f32274d tempest-AttachVolumeNegativeTest-158509557 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:18:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ba0b8284-b978-4a31-ab70-0ba10f32274d tempest-AttachVolumeNegativeTest-158509557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-67182fbe-2e00-4b26-bf42-e2edf0d5d39c 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:44 devstack sudo[97607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-67182fbe-2e00-4b26-bf42-e2edf0d5d39c 1073741824 Sep 28 17:18:44 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:44 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1a6bb4ed-9b52-4e2a-b0e1-6038e2227bda tempest-VolumesGetTest-991115499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-89354d25-6658-4df9-9261-50210d6a1df4" returned: 0 in 0.562s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1a6bb4ed-9b52-4e2a-b0e1-6038e2227bda tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-89354d25-6658-4df9-9261-50210d6a1df4 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:44 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-89354d25-6658-4df9-9261-50210d6a1df4 Sep 28 17:18:44 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:44 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1a6bb4ed-9b52-4e2a-b0e1-6038e2227bda tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-89354d25-6658-4df9-9261-50210d6a1df4" returned: 0 in 0.287s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:44 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1a6bb4ed-9b52-4e2a-b0e1-6038e2227bda tempest-VolumesGetTest-991115499 None] Lock "cinder-quobyte-89354d25-6658-4df9-9261-50210d6a1df4" released by "delete_volume" :: held 0.918s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:44 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-1a6bb4ed-9b52-4e2a-b0e1-6038e2227bda tempest-VolumesGetTest-991115499 None] Created reservations ['262bc88e-0730-412c-bfa0-5ee16f854ace', 'bba16de9-562f-40d9-a4a7-7f49942d0c26', '1d63562c-9070-4e49-b48c-824f0a4241b3', '12b3fcfb-c223-423f-ac60-2c1c1e4f4743'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:18:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1a6bb4ed-9b52-4e2a-b0e1-6038e2227bda tempest-VolumesGetTest-991115499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1a6bb4ed-9b52-4e2a-b0e1-6038e2227bda tempest-VolumesGetTest-991115499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:44 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-1a6bb4ed-9b52-4e2a-b0e1-6038e2227bda tempest-VolumesGetTest-991115499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:44 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-1a6bb4ed-9b52-4e2a-b0e1-6038e2227bda tempest-VolumesGetTest-991115499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1a6bb4ed-9b52-4e2a-b0e1-6038e2227bda tempest-VolumesGetTest-991115499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1a6bb4ed-9b52-4e2a-b0e1-6038e2227bda tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:45 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ba0b8284-b978-4a31-ab70-0ba10f32274d tempest-AttachVolumeNegativeTest-158509557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-67182fbe-2e00-4b26-bf42-e2edf0d5d39c 1073741824" returned: 0 in 0.724s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:45 devstack sudo[97617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:18:45 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ba0b8284-b978-4a31-ab70-0ba10f32274d tempest-AttachVolumeNegativeTest-158509557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-67182fbe-2e00-4b26-bf42-e2edf0d5d39c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:45 devstack sudo[97622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-67182fbe-2e00-4b26-bf42-e2edf0d5d39c Sep 28 17:18:45 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:45 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1a6bb4ed-9b52-4e2a-b0e1-6038e2227bda tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.521s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:45 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-1a6bb4ed-9b52-4e2a-b0e1-6038e2227bda tempest-VolumesGetTest-991115499 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:18:45 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ba0b8284-b978-4a31-ab70-0ba10f32274d tempest-AttachVolumeNegativeTest-158509557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-67182fbe-2e00-4b26-bf42-e2edf0d5d39c" returned: 0 in 0.362s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ba0b8284-b978-4a31-ab70-0ba10f32274d tempest-AttachVolumeNegativeTest-158509557 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:18:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ba0b8284-b978-4a31-ab70-0ba10f32274d tempest-AttachVolumeNegativeTest-158509557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:45 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-1a6bb4ed-9b52-4e2a-b0e1-6038e2227bda tempest-VolumesGetTest-991115499 None] Deleted volume successfully. Sep 28 17:18:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ba0b8284-b978-4a31-ab70-0ba10f32274d tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f8306eb-c011-4a4a-a78c-8a3c8ab1eb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67182fbe-2e00-4b26-bf42-e2edf0d5d39c', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ba0b8284-b978-4a31-ab70-0ba10f32274d tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13d05a0-f580-42c4-b928-6f87d723318d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:45 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1a6bb4ed-9b52-4e2a-b0e1-6038e2227bda tempest-VolumesGetTest-991115499 None] Lock "cinder-89354d25-6658-4df9-9261-50210d6a1df4-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:45 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-ba0b8284-b978-4a31-ab70-0ba10f32274d tempest-AttachVolumeNegativeTest-158509557 None] Volume volume-67182fbe-2e00-4b26-bf42-e2edf0d5d39c (67182fbe-2e00-4b26-bf42-e2edf0d5d39c): created successfully Sep 28 17:18:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ba0b8284-b978-4a31-ab70-0ba10f32274d tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13d05a0-f580-42c4-b928-6f87d723318d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ba0b8284-b978-4a31-ab70-0ba10f32274d tempest-AttachVolumeNegativeTest-158509557 None] Flow 'volume_create_manager' (8259c3cc-83b9-498a-8b9f-47f4ae82ed44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:45 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-ba0b8284-b978-4a31-ab70-0ba10f32274d tempest-AttachVolumeNegativeTest-158509557 None] Created volume successfully. Sep 28 17:18:45 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-84cc8018-4d16-4516-b3e9-d59b7f674467 tempest-VolumesGetTest-991115499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:18:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-84cc8018-4d16-4516-b3e9-d59b7f674467 tempest-VolumesGetTest-991115499 None] Flow 'volume_create_manager' (86a238c8-bb35-4403-a2e2-36e97b04cbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-84cc8018-4d16-4516-b3e9-d59b7f674467 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8422d55-e109-4f01-8122-edcf12d0ef7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-84cc8018-4d16-4516-b3e9-d59b7f674467 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8422d55-e109-4f01-8122-edcf12d0ef7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-253493816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3415289a214e76aa08bf911005d4b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:46Z,use_quota=True,user_id='6575b687682e46aaa1e2c968f24beae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-84cc8018-4d16-4516-b3e9-d59b7f674467 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a41be10b-cd8a-4a78-ab77-52de1048c132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-84cc8018-4d16-4516-b3e9-d59b7f674467 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a41be10b-cd8a-4a78-ab77-52de1048c132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-84cc8018-4d16-4516-b3e9-d59b7f674467 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25bc1e10-1564-4410-ae5d-376aeafbd912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-84cc8018-4d16-4516-b3e9-d59b7f674467 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25bc1e10-1564-4410-ae5d-376aeafbd912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b', 'volume_name': 'volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-84cc8018-4d16-4516-b3e9-d59b7f674467 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c78e0ca-587c-4d56-b141-592b56261912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-84cc8018-4d16-4516-b3e9-d59b7f674467 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c78e0ca-587c-4d56-b141-592b56261912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-84cc8018-4d16-4516-b3e9-d59b7f674467 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba760024-891e-46a4-b946-037436eafb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:45 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-84cc8018-4d16-4516-b3e9-d59b7f674467 tempest-VolumesGetTest-991115499 None] Volume 56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b', 'volume_size': 1} Sep 28 17:18:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-84cc8018-4d16-4516-b3e9-d59b7f674467 tempest-VolumesGetTest-991115499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-84cc8018-4d16-4516-b3e9-d59b7f674467 tempest-VolumesGetTest-991115499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-84cc8018-4d16-4516-b3e9-d59b7f674467 tempest-VolumesGetTest-991115499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-253493816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3415289a214e76aa08bf911005d4b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:46Z,use_quota=True,user_id='6575b687682e46aaa1e2c968f24beae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:18:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-84cc8018-4d16-4516-b3e9-d59b7f674467 tempest-VolumesGetTest-991115499 None] Creating volume 56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:18:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-84cc8018-4d16-4516-b3e9-d59b7f674467 tempest-VolumesGetTest-991115499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-84cc8018-4d16-4516-b3e9-d59b7f674467 tempest-VolumesGetTest-991115499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-84cc8018-4d16-4516-b3e9-d59b7f674467 tempest-VolumesGetTest-991115499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-84cc8018-4d16-4516-b3e9-d59b7f674467 tempest-VolumesGetTest-991115499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-84cc8018-4d16-4516-b3e9-d59b7f674467 tempest-VolumesGetTest-991115499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-84cc8018-4d16-4516-b3e9-d59b7f674467 tempest-VolumesGetTest-991115499 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:18:45 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-84cc8018-4d16-4516-b3e9-d59b7f674467 tempest-VolumesGetTest-991115499 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:18:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-84cc8018-4d16-4516-b3e9-d59b7f674467 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:45 devstack sudo[97639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b 1073741824 Sep 28 17:18:45 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:46 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-84cc8018-4d16-4516-b3e9-d59b7f674467 tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b 1073741824" returned: 0 in 0.717s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-84cc8018-4d16-4516-b3e9-d59b7f674467 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:46 devstack sudo[97659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b Sep 28 17:18:46 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:47 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-84cc8018-4d16-4516-b3e9-d59b7f674467 tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b" returned: 0 in 0.354s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:47 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-84cc8018-4d16-4516-b3e9-d59b7f674467 tempest-VolumesGetTest-991115499 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:18:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-84cc8018-4d16-4516-b3e9-d59b7f674467 tempest-VolumesGetTest-991115499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:47 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-84cc8018-4d16-4516-b3e9-d59b7f674467 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba760024-891e-46a4-b946-037436eafb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:47 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-84cc8018-4d16-4516-b3e9-d59b7f674467 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af94ecc5-8080-4b52-9eb1-ff05e2d3753e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:47 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-84cc8018-4d16-4516-b3e9-d59b7f674467 tempest-VolumesGetTest-991115499 None] Volume volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b (56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b): created successfully Sep 28 17:18:47 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-84cc8018-4d16-4516-b3e9-d59b7f674467 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af94ecc5-8080-4b52-9eb1-ff05e2d3753e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:47 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-84cc8018-4d16-4516-b3e9-d59b7f674467 tempest-VolumesGetTest-991115499 None] Flow 'volume_create_manager' (86a238c8-bb35-4403-a2e2-36e97b04cbd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:47 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-84cc8018-4d16-4516-b3e9-d59b7f674467 tempest-VolumesGetTest-991115499 None] Created volume successfully. Sep 28 17:18:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-1b74fc59-772d-4d62-91da-8bb8896c0450 req-567e7381-7212-409d-ba62-693b7561961f tempest-AttachVolumeNegativeTest-158509557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-1b74fc59-772d-4d62-91da-8bb8896c0450 req-567e7381-7212-409d-ba62-693b7561961f tempest-AttachVolumeNegativeTest-158509557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-1b74fc59-772d-4d62-91da-8bb8896c0450 req-567e7381-7212-409d-ba62-693b7561961f tempest-AttachVolumeNegativeTest-158509557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:47 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-1b74fc59-772d-4d62-91da-8bb8896c0450 req-567e7381-7212-409d-ba62-693b7561961f tempest-AttachVolumeNegativeTest-158509557 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069', 'name': 'volume-67182fbe-2e00-4b26-bf42-e2edf0d5d39c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c01ce6c7-c5b1-4a40-ade3-f580a0122a78', 'enforce_multipath': True} {{(pid=86917) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:18:47 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-1b74fc59-772d-4d62-91da-8bb8896c0450 req-567e7381-7212-409d-ba62-693b7561961f tempest-AttachVolumeNegativeTest-158509557 None] attachment_update completed successfully. Sep 28 17:18:48 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:18:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Flow 'volume_create_manager' (1d05676a-9b75-46e2-b728-d88a9acba69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f753ce5-cc2a-4f9a-8f19-6dbdb0dab7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f753ce5-cc2a-4f9a-8f19-6dbdb0dab7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1056358375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6783540e-648f-4e7a-ad8f-20e4f6149ac5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='dd3415289a214e76aa08bf911005d4b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:49Z,use_quota=True,user_id='6575b687682e46aaa1e2c968f24beae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f702f5a-dca8-4690-b364-6f8ff5988be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f702f5a-dca8-4690-b364-6f8ff5988be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28b900f2-e2fa-486b-9c37-5311727966b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28b900f2-e2fa-486b-9c37-5311727966b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6783540e-648f-4e7a-ad8f-20e4f6149ac5', 'volume_name': 'volume-6783540e-648f-4e7a-ad8f-20e4f6149ac5', 'volume_size': 1, 'source_volid': '56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b', 'source_volstatus': 'available'}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b54223-12aa-4453-8f36-550864da1c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b54223-12aa-4453-8f36-550864da1c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83b48796-2201-4cbe-babd-2533013afeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:48 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Volume 6783540e-648f-4e7a-ad8f-20e4f6149ac5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6783540e-648f-4e7a-ad8f-20e4f6149ac5', 'volume_size': 1, 'source_volid': '56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b', 'source_volstatus': 'available'} Sep 28 17:18:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:48 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Cloning volume 56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b to volume 6783540e-648f-4e7a-ad8f-20e4f6149ac5 Sep 28 17:18:48 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Creating offline snapshot ac8966e2-c681-4a8b-82be-4d61b0cedeb5 of volume 56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:18:48 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bcc6e1-ffc0-4773-b687-454a3fcd5b3e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:48 devstack sudo[97698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b Sep 28 17:18:48 devstack sudo[97698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:49 devstack sudo[97698]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b" returned: 0 in 0.396s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b.ac8966e2-c681-4a8b-82be-4d61b0cedeb5 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:49 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b.ac8966e2-c681-4a8b-82be-4d61b0cedeb5 1G Sep 28 17:18:49 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:18:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:49 devstack sudo[97708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:18:49 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:49 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.433s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:49 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:18:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager._thread_info {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:18:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread count: 28 {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:18:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread info: [<_MainThread(MainThread, started 132915553284224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:18:49 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b.ac8966e2-c681-4a8b-82be-4d61b0cedeb5 1G" returned: 0 in 0.753s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b.ac8966e2-c681-4a8b-82be-4d61b0cedeb5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:50 devstack sudo[97713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b.ac8966e2-c681-4a8b-82be-4d61b0cedeb5 Sep 28 17:18:50 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:50 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b.ac8966e2-c681-4a8b-82be-4d61b0cedeb5" returned: 0 in 0.787s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:50 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b.ac8966e2-c681-4a8b-82be-4d61b0cedeb5 is being set with open permissions: ugo+rw Sep 28 17:18:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b.ac8966e2-c681-4a8b-82be-4d61b0cedeb5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:50 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b.ac8966e2-c681-4a8b-82be-4d61b0cedeb5 Sep 28 17:18:50 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:51 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b.ac8966e2-c681-4a8b-82be-4d61b0cedeb5" returned: 0 in 0.477s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:51 devstack sudo[97724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b.info Sep 28 17:18:51 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:51 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b.info" returned: 0 in 0.457s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:51 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b.info is being set with open permissions: ugo+rw Sep 28 17:18:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:51 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b.info Sep 28 17:18:51 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:52 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b.info" returned: 0 in 0.466s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:52 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Acquiring lock "cinder-quobyte-6783540e-648f-4e7a-ad8f-20e4f6149ac5" by "_copy_volume_from_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:52 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Lock "cinder-quobyte-6783540e-648f-4e7a-ad8f-20e4f6149ac5" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] snapshot: ac8966e2-c681-4a8b-82be-4d61b0cedeb5, volume: 6783540e-648f-4e7a-ad8f-20e4f6149ac5, {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:18:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:52 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1864bcc3-0d10-4409-b6e5-20fa589df92f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b.ac8966e2-c681-4a8b-82be-4d61b0cedeb5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:52 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b.ac8966e2-c681-4a8b-82be-4d61b0cedeb5 Sep 28 17:18:52 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:52 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b.ac8966e2-c681-4a8b-82be-4d61b0cedeb5" returned: 0 in 0.557s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:18:52 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a1f85b-a150-4e9d-a441-923fd4b8b903]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:53 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b Sep 28 17:18:53 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:53 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b" returned: 0 in 0.536s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:53 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:18:53 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Creating direct copy from snapshot {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:18:53 devstack cinder-volume[86917]: DEBUG cinder.utils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Path /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6783540e-648f-4e7a-ad8f-20e4f6149ac5 not found in is_blk_device check {{(pid=86917) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:18:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6783540e-648f-4e7a-ad8f-20e4f6149ac5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:53 devstack sudo[97741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6783540e-648f-4e7a-ad8f-20e4f6149ac5 Sep 28 17:18:53 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-a37fbdcd-e630-40b1-b6c6-cde663131a04 req-ae5f4b90-ef10-4c94-a716-790957752256 tempest-TestStampPattern-1988873608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:05 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6783540e-648f-4e7a-ad8f-20e4f6149ac5" returned: 0 in 11.718s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:05 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Image conversion details: src /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b, size 1024.00 MB, duration 11.72 sec, destination /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6783540e-648f-4e7a-ad8f-20e4f6149ac5 {{(pid=86917) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:19:05 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Converted 1024.00 MB image at 87.38 MB/s Sep 28 17:19:05 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6783540e-648f-4e7a-ad8f-20e4f6149ac5 is being set with open permissions: ugo+rw Sep 28 17:19:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6783540e-648f-4e7a-ad8f-20e4f6149ac5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:05 devstack sudo[97794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6783540e-648f-4e7a-ad8f-20e4f6149ac5 Sep 28 17:19:05 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:05 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6783540e-648f-4e7a-ad8f-20e4f6149ac5" returned: 0 in 0.304s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:05 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Lock "cinder-quobyte-6783540e-648f-4e7a-ad8f-20e4f6149ac5" released by "_copy_volume_from_snapshot" :: held 13.253s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:05 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Acquiring lock "cinder-quobyte-ac8966e2-c681-4a8b-82be-4d61b0cedeb5" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:05 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Lock "cinder-quobyte-ac8966e2-c681-4a8b-82be-4d61b0cedeb5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Deleting offline snapshot ac8966e2-c681-4a8b-82be-4d61b0cedeb5 of volume 56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:19:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] snapshot_file for this snap is: volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b.ac8966e2-c681-4a8b-82be-4d61b0cedeb5 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:19:05 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[443580e2-8f41-47be-a27f-c214baa5e149]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b.ac8966e2-c681-4a8b-82be-4d61b0cedeb5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:05 devstack sudo[97797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b.ac8966e2-c681-4a8b-82be-4d61b0cedeb5 Sep 28 17:19:05 devstack sudo[97797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:06 devstack sudo[97797]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b.ac8966e2-c681-4a8b-82be-4d61b0cedeb5" returned: 0 in 0.513s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:06 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:19:06 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbd0c53-76f2-4325-a916-2e4a7a9d95f1]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:06 devstack sudo[97803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b Sep 28 17:19:06 devstack sudo[97803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:07 devstack sudo[97803]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b" returned: 0 in 0.965s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b.ac8966e2-c681-4a8b-82be-4d61b0cedeb5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:07 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b.ac8966e2-c681-4a8b-82be-4d61b0cedeb5 Sep 28 17:19:07 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:07 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b.ac8966e2-c681-4a8b-82be-4d61b0cedeb5" returned: 0 in 0.558s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b.ac8966e2-c681-4a8b-82be-4d61b0cedeb5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:07 devstack sudo[97848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b.ac8966e2-c681-4a8b-82be-4d61b0cedeb5 Sep 28 17:19:07 devstack sudo[97848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:08 devstack sudo[97848]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b.ac8966e2-c681-4a8b-82be-4d61b0cedeb5" returned: 0 in 0.388s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:08 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Lock "cinder-quobyte-ac8966e2-c681-4a8b-82be-4d61b0cedeb5" released by "_delete_snapshot" :: held 2.572s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.505s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-a37fbdcd-e630-40b1-b6c6-cde663131a04 req-ae5f4b90-ef10-4c94-a716-790957752256 tempest-TestStampPattern-1988873608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.031s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-a37fbdcd-e630-40b1-b6c6-cde663131a04 req-ae5f4b90-ef10-4c94-a716-790957752256 tempest-TestStampPattern-1988873608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:08 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83b48796-2201-4cbe-babd-2533013afeed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6783540e-648f-4e7a-ad8f-20e4f6149ac5', 'volume_size': 1, 'source_volid': '56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b', 'source_volstatus': 'available'}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:08 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ed50ca7-68dc-441e-92fa-ff7954fe3d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:08 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Volume volume-6783540e-648f-4e7a-ad8f-20e4f6149ac5 (6783540e-648f-4e7a-ad8f-20e4f6149ac5): created successfully Sep 28 17:19:08 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ed50ca7-68dc-441e-92fa-ff7954fe3d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:08 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Flow 'volume_create_manager' (1d05676a-9b75-46e2-b728-d88a9acba69d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:08 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-a37fbdcd-e630-40b1-b6c6-cde663131a04 req-ae5f4b90-ef10-4c94-a716-790957752256 tempest-TestStampPattern-1988873608 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069', 'name': 'volume-3035682a-178b-4675-8d92-5ba3a79dc306', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '006ca24f-31df-4d23-9445-5456e1eabdc9', 'enforce_multipath': True} {{(pid=86917) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:19:08 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-2404f74e-e9ba-45af-93f9-19d8acf8ff63 tempest-VolumesGetTest-991115499 None] Created volume successfully. Sep 28 17:19:08 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-a37fbdcd-e630-40b1-b6c6-cde663131a04 req-ae5f4b90-ef10-4c94-a716-790957752256 tempest-TestStampPattern-1988873608 None] attachment_update completed successfully. Sep 28 17:19:09 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-a74d78e8-9b6a-4344-9bbd-96a0dd6c11f1 tempest-VolumesGetTest-991115499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:19:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a74d78e8-9b6a-4344-9bbd-96a0dd6c11f1 tempest-VolumesGetTest-991115499 None] Flow 'volume_create_manager' (55170fda-dfb3-491a-b26a-f0f1fb50962e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a74d78e8-9b6a-4344-9bbd-96a0dd6c11f1 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71a33ed2-5ac9-4849-8e67-df9f7ac0b148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a74d78e8-9b6a-4344-9bbd-96a0dd6c11f1 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71a33ed2-5ac9-4849-8e67-df9f7ac0b148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-146427359',display_name='tempest-VolumesGetTest-Volume-624207823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2755945-2748-417c-972f-639e4a822a57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3415289a214e76aa08bf911005d4b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:10Z,use_quota=True,user_id='6575b687682e46aaa1e2c968f24beae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a74d78e8-9b6a-4344-9bbd-96a0dd6c11f1 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9adf048-e09c-4cd8-a307-54c3756a78c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a74d78e8-9b6a-4344-9bbd-96a0dd6c11f1 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9adf048-e09c-4cd8-a307-54c3756a78c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a74d78e8-9b6a-4344-9bbd-96a0dd6c11f1 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7074cbf-c1e3-4c57-82fe-3d3fa3bda6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a74d78e8-9b6a-4344-9bbd-96a0dd6c11f1 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7074cbf-c1e3-4c57-82fe-3d3fa3bda6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2755945-2748-417c-972f-639e4a822a57', 'volume_name': 'volume-a2755945-2748-417c-972f-639e4a822a57', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a74d78e8-9b6a-4344-9bbd-96a0dd6c11f1 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80883c45-e15c-4896-a3ff-6a00875e9cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a74d78e8-9b6a-4344-9bbd-96a0dd6c11f1 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80883c45-e15c-4896-a3ff-6a00875e9cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a74d78e8-9b6a-4344-9bbd-96a0dd6c11f1 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a245143d-8c7c-4627-8421-a85f72c68698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:09 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-a74d78e8-9b6a-4344-9bbd-96a0dd6c11f1 tempest-VolumesGetTest-991115499 None] Volume a2755945-2748-417c-972f-639e4a822a57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2755945-2748-417c-972f-639e4a822a57', 'volume_size': 1} Sep 28 17:19:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a74d78e8-9b6a-4344-9bbd-96a0dd6c11f1 tempest-VolumesGetTest-991115499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a74d78e8-9b6a-4344-9bbd-96a0dd6c11f1 tempest-VolumesGetTest-991115499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a74d78e8-9b6a-4344-9bbd-96a0dd6c11f1 tempest-VolumesGetTest-991115499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-146427359',display_name='tempest-VolumesGetTest-Volume-624207823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2755945-2748-417c-972f-639e4a822a57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3415289a214e76aa08bf911005d4b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:10Z,use_quota=True,user_id='6575b687682e46aaa1e2c968f24beae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:19:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-a74d78e8-9b6a-4344-9bbd-96a0dd6c11f1 tempest-VolumesGetTest-991115499 None] Creating volume a2755945-2748-417c-972f-639e4a822a57 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:19:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a74d78e8-9b6a-4344-9bbd-96a0dd6c11f1 tempest-VolumesGetTest-991115499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a74d78e8-9b6a-4344-9bbd-96a0dd6c11f1 tempest-VolumesGetTest-991115499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a74d78e8-9b6a-4344-9bbd-96a0dd6c11f1 tempest-VolumesGetTest-991115499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a74d78e8-9b6a-4344-9bbd-96a0dd6c11f1 tempest-VolumesGetTest-991115499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a74d78e8-9b6a-4344-9bbd-96a0dd6c11f1 tempest-VolumesGetTest-991115499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a74d78e8-9b6a-4344-9bbd-96a0dd6c11f1 tempest-VolumesGetTest-991115499 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:19:09 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-a74d78e8-9b6a-4344-9bbd-96a0dd6c11f1 tempest-VolumesGetTest-991115499 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:19:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a74d78e8-9b6a-4344-9bbd-96a0dd6c11f1 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a2755945-2748-417c-972f-639e4a822a57 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:10 devstack sudo[97885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a2755945-2748-417c-972f-639e4a822a57 1073741824 Sep 28 17:19:10 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:10 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a74d78e8-9b6a-4344-9bbd-96a0dd6c11f1 tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a2755945-2748-417c-972f-639e4a822a57 1073741824" returned: 0 in 0.744s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a74d78e8-9b6a-4344-9bbd-96a0dd6c11f1 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a2755945-2748-417c-972f-639e4a822a57 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:10 devstack sudo[97907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a2755945-2748-417c-972f-639e4a822a57 Sep 28 17:19:10 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:11 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a74d78e8-9b6a-4344-9bbd-96a0dd6c11f1 tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a2755945-2748-417c-972f-639e4a822a57" returned: 0 in 0.606s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a74d78e8-9b6a-4344-9bbd-96a0dd6c11f1 tempest-VolumesGetTest-991115499 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:19:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a74d78e8-9b6a-4344-9bbd-96a0dd6c11f1 tempest-VolumesGetTest-991115499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a74d78e8-9b6a-4344-9bbd-96a0dd6c11f1 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a245143d-8c7c-4627-8421-a85f72c68698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2755945-2748-417c-972f-639e4a822a57', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a74d78e8-9b6a-4344-9bbd-96a0dd6c11f1 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2b19b1f-3455-486c-bc0c-3a7f824d084c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:11 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-a74d78e8-9b6a-4344-9bbd-96a0dd6c11f1 tempest-VolumesGetTest-991115499 None] Volume volume-a2755945-2748-417c-972f-639e4a822a57 (a2755945-2748-417c-972f-639e4a822a57): created successfully Sep 28 17:19:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a74d78e8-9b6a-4344-9bbd-96a0dd6c11f1 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2b19b1f-3455-486c-bc0c-3a7f824d084c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a74d78e8-9b6a-4344-9bbd-96a0dd6c11f1 tempest-VolumesGetTest-991115499 None] Flow 'volume_create_manager' (55170fda-dfb3-491a-b26a-f0f1fb50962e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:11 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-a74d78e8-9b6a-4344-9bbd-96a0dd6c11f1 tempest-VolumesGetTest-991115499 None] Created volume successfully. Sep 28 17:19:12 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-4b1bc104-7cbc-4e05-b148-ed9ff044d9eb tempest-VolumesGetTest-991115499 None] Acquiring lock "cinder-a2755945-2748-417c-972f-639e4a822a57-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:12 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-4b1bc104-7cbc-4e05-b148-ed9ff044d9eb tempest-VolumesGetTest-991115499 None] Lock "cinder-a2755945-2748-417c-972f-639e4a822a57-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:12 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-4b1bc104-7cbc-4e05-b148-ed9ff044d9eb tempest-VolumesGetTest-991115499 None] Acquiring lock "cinder-quobyte-a2755945-2748-417c-972f-639e4a822a57" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:12 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-4b1bc104-7cbc-4e05-b148-ed9ff044d9eb tempest-VolumesGetTest-991115499 None] Lock "cinder-quobyte-a2755945-2748-417c-972f-639e4a822a57" acquired by "delete_volume" :: waited 0.021s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:12 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[580ed4ef-0588-429b-b1c6-e437f8491d50]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4b1bc104-7cbc-4e05-b148-ed9ff044d9eb tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a2755945-2748-417c-972f-639e4a822a57 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:12 devstack sudo[97925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a2755945-2748-417c-972f-639e4a822a57 Sep 28 17:19:12 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:13 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4b1bc104-7cbc-4e05-b148-ed9ff044d9eb tempest-VolumesGetTest-991115499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a2755945-2748-417c-972f-639e4a822a57" returned: 0 in 0.864s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4b1bc104-7cbc-4e05-b148-ed9ff044d9eb tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a2755945-2748-417c-972f-639e4a822a57 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:13 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a2755945-2748-417c-972f-639e4a822a57 Sep 28 17:19:13 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:13 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4b1bc104-7cbc-4e05-b148-ed9ff044d9eb tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a2755945-2748-417c-972f-639e4a822a57" returned: 0 in 0.579s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:13 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-4b1bc104-7cbc-4e05-b148-ed9ff044d9eb tempest-VolumesGetTest-991115499 None] Lock "cinder-quobyte-a2755945-2748-417c-972f-639e4a822a57" released by "delete_volume" :: held 1.613s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:14 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-4b1bc104-7cbc-4e05-b148-ed9ff044d9eb tempest-VolumesGetTest-991115499 None] Created reservations ['ff0974fe-9602-46c8-88b6-463abc163ae3', '12961aab-1647-45e3-a8c9-92169e1690cf', '5697f281-2750-4987-a643-5385162e3a52', '6c8ec17f-2011-49c1-9959-63823dfc669f'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4b1bc104-7cbc-4e05-b148-ed9ff044d9eb tempest-VolumesGetTest-991115499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4b1bc104-7cbc-4e05-b148-ed9ff044d9eb tempest-VolumesGetTest-991115499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:14 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4b1bc104-7cbc-4e05-b148-ed9ff044d9eb tempest-VolumesGetTest-991115499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:14 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4b1bc104-7cbc-4e05-b148-ed9ff044d9eb tempest-VolumesGetTest-991115499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4b1bc104-7cbc-4e05-b148-ed9ff044d9eb tempest-VolumesGetTest-991115499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4b1bc104-7cbc-4e05-b148-ed9ff044d9eb tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:14 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:19:14 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:14 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4b1bc104-7cbc-4e05-b148-ed9ff044d9eb tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.418s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:14 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-4b1bc104-7cbc-4e05-b148-ed9ff044d9eb tempest-VolumesGetTest-991115499 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:14 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-4b1bc104-7cbc-4e05-b148-ed9ff044d9eb tempest-VolumesGetTest-991115499 None] Deleted volume successfully. Sep 28 17:19:14 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-4b1bc104-7cbc-4e05-b148-ed9ff044d9eb tempest-VolumesGetTest-991115499 None] Lock "cinder-a2755945-2748-417c-972f-639e4a822a57-delete_volume" released by "delete_volume" :: held 2.488s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:14 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fc6e1015-ea95-4f88-a21d-95791f7a394a tempest-VolumesGetTest-991115499 None] Acquiring lock "cinder-6783540e-648f-4e7a-ad8f-20e4f6149ac5-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:14 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fc6e1015-ea95-4f88-a21d-95791f7a394a tempest-VolumesGetTest-991115499 None] Lock "cinder-6783540e-648f-4e7a-ad8f-20e4f6149ac5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:14 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fc6e1015-ea95-4f88-a21d-95791f7a394a tempest-VolumesGetTest-991115499 None] Acquiring lock "cinder-quobyte-6783540e-648f-4e7a-ad8f-20e4f6149ac5" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:14 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fc6e1015-ea95-4f88-a21d-95791f7a394a tempest-VolumesGetTest-991115499 None] Lock "cinder-quobyte-6783540e-648f-4e7a-ad8f-20e4f6149ac5" acquired by "delete_volume" :: waited 0.028s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:14 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a04227-68ee-4b0b-bb18-f4a10b46969e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fc6e1015-ea95-4f88-a21d-95791f7a394a tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6783540e-648f-4e7a-ad8f-20e4f6149ac5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:15 devstack sudo[97955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6783540e-648f-4e7a-ad8f-20e4f6149ac5 Sep 28 17:19:15 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:15 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fc6e1015-ea95-4f88-a21d-95791f7a394a tempest-VolumesGetTest-991115499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6783540e-648f-4e7a-ad8f-20e4f6149ac5" returned: 0 in 0.516s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fc6e1015-ea95-4f88-a21d-95791f7a394a tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6783540e-648f-4e7a-ad8f-20e4f6149ac5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:15 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6783540e-648f-4e7a-ad8f-20e4f6149ac5 Sep 28 17:19:15 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:15 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fc6e1015-ea95-4f88-a21d-95791f7a394a tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6783540e-648f-4e7a-ad8f-20e4f6149ac5" returned: 0 in 0.387s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:15 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fc6e1015-ea95-4f88-a21d-95791f7a394a tempest-VolumesGetTest-991115499 None] Lock "cinder-quobyte-6783540e-648f-4e7a-ad8f-20e4f6149ac5" released by "delete_volume" :: held 0.990s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:15 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-fc6e1015-ea95-4f88-a21d-95791f7a394a tempest-VolumesGetTest-991115499 None] Created reservations ['6fa96c81-0f16-4e02-bd3f-0e0d1f41b81c', 'eef3d4d3-d053-4087-a356-fb3cd5fde396', 'df538576-59ef-458d-9372-feeaacfe4828', '43551eb3-7cc6-47b5-98d2-ab689da8c0a4'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-fc6e1015-ea95-4f88-a21d-95791f7a394a tempest-VolumesGetTest-991115499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-fc6e1015-ea95-4f88-a21d-95791f7a394a tempest-VolumesGetTest-991115499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:16 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-fc6e1015-ea95-4f88-a21d-95791f7a394a tempest-VolumesGetTest-991115499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:16 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-fc6e1015-ea95-4f88-a21d-95791f7a394a tempest-VolumesGetTest-991115499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-fc6e1015-ea95-4f88-a21d-95791f7a394a tempest-VolumesGetTest-991115499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fc6e1015-ea95-4f88-a21d-95791f7a394a tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:16 devstack sudo[97970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:19:16 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:16 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-0ebb8537-3762-4d64-9d14-ec3c1c5c9968 req-f88a7d61-26bb-4e34-b102-cbf5c9ecc159 tempest-TestStampPattern-1988873608 None] Terminate volume connection completed successfully. Sep 28 17:19:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-0ebb8537-3762-4d64-9d14-ec3c1c5c9968 req-f88a7d61-26bb-4e34-b102-cbf5c9ecc159 tempest-TestStampPattern-1988873608 None] Deleting attachment 006ca24f-31df-4d23-9445-5456e1eabdc9. {{(pid=86917) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:19:16 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fc6e1015-ea95-4f88-a21d-95791f7a394a tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.357s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:16 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-fc6e1015-ea95-4f88-a21d-95791f7a394a tempest-VolumesGetTest-991115499 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:16 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-fc6e1015-ea95-4f88-a21d-95791f7a394a tempest-VolumesGetTest-991115499 None] Deleted volume successfully. Sep 28 17:19:16 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fc6e1015-ea95-4f88-a21d-95791f7a394a tempest-VolumesGetTest-991115499 None] Lock "cinder-6783540e-648f-4e7a-ad8f-20e4f6149ac5-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-50ce00e2-080e-425b-86df-44d543245d94 tempest-TestStampPattern-1988873608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-50ce00e2-080e-425b-86df-44d543245d94 tempest-TestStampPattern-1988873608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:17 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-50ce00e2-080e-425b-86df-44d543245d94 tempest-TestStampPattern-1988873608 None] Creating offline snapshot 43a61fa6-ea48-407c-81d8-811e6ebe2af0 of volume 3035682a-178b-4675-8d92-5ba3a79dc306 {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:19:17 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e097bd-dac3-4701-9a00-d0d3a1481d73]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-50ce00e2-080e-425b-86df-44d543245d94 tempest-TestStampPattern-1988873608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:17 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-bbb3e0cb-b677-4357-b56d-8bfb935ef5e5 tempest-VolumesGetTest-991115499 None] Acquiring lock "cinder-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:17 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-bbb3e0cb-b677-4357-b56d-8bfb935ef5e5 tempest-VolumesGetTest-991115499 None] Lock "cinder-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:17 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306 Sep 28 17:19:17 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:17 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-bbb3e0cb-b677-4357-b56d-8bfb935ef5e5 tempest-VolumesGetTest-991115499 None] Acquiring lock "cinder-quobyte-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:17 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-bbb3e0cb-b677-4357-b56d-8bfb935ef5e5 tempest-VolumesGetTest-991115499 None] Lock "cinder-quobyte-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b" acquired by "delete_volume" :: waited 0.024s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:17 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5dac3e8-c5ab-4cb1-9ed4-9337bee49367]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bbb3e0cb-b677-4357-b56d-8bfb935ef5e5 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:17 devstack sudo[97977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b Sep 28 17:19:17 devstack sudo[97977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:17 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-50ce00e2-080e-425b-86df-44d543245d94 tempest-TestStampPattern-1988873608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306" returned: 0 in 0.545s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-50ce00e2-080e-425b-86df-44d543245d94 tempest-TestStampPattern-1988873608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306.43a61fa6-ea48-407c-81d8-811e6ebe2af0 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:17 devstack sudo[97983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306.43a61fa6-ea48-407c-81d8-811e6ebe2af0 1G Sep 28 17:19:17 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:17 devstack sudo[97977]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bbb3e0cb-b677-4357-b56d-8bfb935ef5e5 tempest-VolumesGetTest-991115499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b" returned: 0 in 0.412s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bbb3e0cb-b677-4357-b56d-8bfb935ef5e5 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:17 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b Sep 28 17:19:17 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:18 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-50ce00e2-080e-425b-86df-44d543245d94 tempest-TestStampPattern-1988873608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306.43a61fa6-ea48-407c-81d8-811e6ebe2af0 1G" returned: 0 in 0.491s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-50ce00e2-080e-425b-86df-44d543245d94 tempest-TestStampPattern-1988873608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3035682a-178b-4675-8d92-5ba3a79dc306 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306.43a61fa6-ea48-407c-81d8-811e6ebe2af0 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:18 devstack sudo[98000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3035682a-178b-4675-8d92-5ba3a79dc306 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306.43a61fa6-ea48-407c-81d8-811e6ebe2af0 Sep 28 17:19:18 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:18 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bbb3e0cb-b677-4357-b56d-8bfb935ef5e5 tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b" returned: 0 in 0.344s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:18 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-bbb3e0cb-b677-4357-b56d-8bfb935ef5e5 tempest-VolumesGetTest-991115499 None] Lock "cinder-quobyte-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b" released by "delete_volume" :: held 0.872s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:18 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-bbb3e0cb-b677-4357-b56d-8bfb935ef5e5 tempest-VolumesGetTest-991115499 None] Created reservations ['a8d452cb-da20-47c1-98aa-a6920878fece', 'ca4ced52-d492-4c99-9c4a-1ae049e7de65', '506a5f40-c57c-4ff8-b7ed-4418fa53ef44', '13ba9121-7ca4-4c68-bbc1-d0868218bb4a'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-bbb3e0cb-b677-4357-b56d-8bfb935ef5e5 tempest-VolumesGetTest-991115499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-bbb3e0cb-b677-4357-b56d-8bfb935ef5e5 tempest-VolumesGetTest-991115499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-bbb3e0cb-b677-4357-b56d-8bfb935ef5e5 tempest-VolumesGetTest-991115499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-bbb3e0cb-b677-4357-b56d-8bfb935ef5e5 tempest-VolumesGetTest-991115499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-bbb3e0cb-b677-4357-b56d-8bfb935ef5e5 tempest-VolumesGetTest-991115499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bbb3e0cb-b677-4357-b56d-8bfb935ef5e5 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:18 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:19:18 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:18 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-50ce00e2-080e-425b-86df-44d543245d94 tempest-TestStampPattern-1988873608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3035682a-178b-4675-8d92-5ba3a79dc306 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306.43a61fa6-ea48-407c-81d8-811e6ebe2af0" returned: 0 in 0.464s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:18 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-50ce00e2-080e-425b-86df-44d543245d94 tempest-TestStampPattern-1988873608 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306.43a61fa6-ea48-407c-81d8-811e6ebe2af0 is being set with open permissions: ugo+rw Sep 28 17:19:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-50ce00e2-080e-425b-86df-44d543245d94 tempest-TestStampPattern-1988873608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306.43a61fa6-ea48-407c-81d8-811e6ebe2af0 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:18 devstack sudo[98008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306.43a61fa6-ea48-407c-81d8-811e6ebe2af0 Sep 28 17:19:18 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:18 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bbb3e0cb-b677-4357-b56d-8bfb935ef5e5 tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.345s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:18 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-bbb3e0cb-b677-4357-b56d-8bfb935ef5e5 tempest-VolumesGetTest-991115499 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:18 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-bbb3e0cb-b677-4357-b56d-8bfb935ef5e5 tempest-VolumesGetTest-991115499 None] Deleted volume successfully. Sep 28 17:19:18 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-bbb3e0cb-b677-4357-b56d-8bfb935ef5e5 tempest-VolumesGetTest-991115499 None] Lock "cinder-56b25d3c-d7bb-450c-ad84-9a1fe74f6b7b-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:18 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-50ce00e2-080e-425b-86df-44d543245d94 tempest-TestStampPattern-1988873608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306.43a61fa6-ea48-407c-81d8-811e6ebe2af0" returned: 0 in 0.318s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-50ce00e2-080e-425b-86df-44d543245d94 tempest-TestStampPattern-1988873608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:19 devstack sudo[98012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306.info Sep 28 17:19:19 devstack sudo[98012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:19 devstack sudo[98012]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-50ce00e2-080e-425b-86df-44d543245d94 tempest-TestStampPattern-1988873608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306.info" returned: 0 in 0.334s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:19 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-50ce00e2-080e-425b-86df-44d543245d94 tempest-TestStampPattern-1988873608 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306.info is being set with open permissions: ugo+rw Sep 28 17:19:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-50ce00e2-080e-425b-86df-44d543245d94 tempest-TestStampPattern-1988873608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:19 devstack sudo[98015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306.info Sep 28 17:19:19 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:19 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:19:19 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Flow 'volume_create_manager' (cb063821-43f6-48ae-97fe-583ae6793993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e26fde-9d6a-49cb-b261-6f63a1a4dba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-50ce00e2-080e-425b-86df-44d543245d94 tempest-TestStampPattern-1988873608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306.info" returned: 0 in 0.336s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-50ce00e2-080e-425b-86df-44d543245d94 tempest-TestStampPattern-1988873608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.624s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e26fde-9d6a-49cb-b261-6f63a1a4dba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-749211178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='dd3415289a214e76aa08bf911005d4b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:20Z,use_quota=True,user_id='6575b687682e46aaa1e2c968f24beae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be98e758-11d3-4fdf-8dc6-3b683a3117d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be98e758-11d3-4fdf-8dc6-3b683a3117d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0282958-c958-4d33-a720-a7ad7978a3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:19 devstack cinder-volume[86917]: DEBUG cinder.image.glance [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Creating Keystone auth plugin from conf {{(pid=86917) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:19:19 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-50ce00e2-080e-425b-86df-44d543245d94 tempest-TestStampPattern-1988873608 None] Create snapshot completed successfully Sep 28 17:19:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0282958-c958-4d33-a720-a7ad7978a3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd1becb20-e6ac-46e9-bad8-e0ccc57fbf0b', 'volume_name': 'volume-d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b', 'volume_size': 1, 'image_id': '19d24755-5fa8-4e1d-aef6-b5fdde452855', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19d24755-5fa8-4e1d-aef6-b5fdde452855', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '307b831956a2452b912f3a0d37f5ee84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '19d24755-5fa8-4e1d-aef6-b5fdde452855', 'created_at': datetime.datetime(2026, 9, 28, 15, 0, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 0, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19d24755-5fa8-4e1d-aef6-b5fdde452855/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (808041c7-2276-46de-83f9-aac7b9f22f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (808041c7-2276-46de-83f9-aac7b9f22f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c04e310-dbad-4a62-a9ac-a4fd3b6aa01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:20 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Volume d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b', 'volume_size': 1, 'image_id': '19d24755-5fa8-4e1d-aef6-b5fdde452855', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19d24755-5fa8-4e1d-aef6-b5fdde452855', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '307b831956a2452b912f3a0d37f5ee84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '19d24755-5fa8-4e1d-aef6-b5fdde452855', 'created_at': datetime.datetime(2026, 9, 28, 15, 0, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 0, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19d24755-5fa8-4e1d-aef6-b5fdde452855/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 17:19:20 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Trying to clone d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b from image 19d24755-5fa8-4e1d-aef6-b5fdde452855 at location (None, [{'url': 'file:///opt/stack/data/glance/images/19d24755-5fa8-4e1d-aef6-b5fdde452855', 'metadata': {}}]). {{(pid=86917) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:19:20 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_7m_7dlc8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86917) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:19:20 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Image download 20.69 MB at 20.69 MB/s Sep 28 17:19:20 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbc507d-ea45-4dd4-81fb-72318f34b198]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_7m_7dlc8devstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:21 devstack sudo[98054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_7m_7dlc8devstack@QuobyteHD Sep 28 17:19:21 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:21 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_7m_7dlc8devstack@QuobyteHD" returned: 0 in 0.477s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:21 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Temporary image 19d24755-5fa8-4e1d-aef6-b5fdde452855 is fetched for user 6575b687682e46aaa1e2c968f24beae8. {{(pid=86917) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:19:21 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf67992-949d-4f46-82ce-3ff6f9068a07]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_7m_7dlc8devstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:21 devstack sudo[98061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_7m_7dlc8devstack@QuobyteHD Sep 28 17:19:21 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:21 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_7m_7dlc8devstack@QuobyteHD" returned: 0 in 0.482s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:21 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-749211178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='dd3415289a214e76aa08bf911005d4b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:20Z,use_quota=True,user_id='6575b687682e46aaa1e2c968f24beae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:19:21 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Creating volume d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:19:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:21 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:21 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:22 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:19:22 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:19:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:22 devstack sudo[98066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b 1073741824 Sep 28 17:19:22 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:22 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b 1073741824" returned: 0 in 0.574s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:22 devstack sudo[98083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b Sep 28 17:19:22 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:22 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b" returned: 0 in 0.301s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:22 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:19:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:23 devstack cinder-volume[86917]: DEBUG cinder.volume.volume_utils [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Attempting download of 19d24755-5fa8-4e1d-aef6-b5fdde452855 ((None, [{'url': 'file:///opt/stack/data/glance/images/19d24755-5fa8-4e1d-aef6-b5fdde452855', 'metadata': {}}])) to volume d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b. {{(pid=86917) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:19:23 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d078a3b9-9c4d-4682-99b2-1e9c1244a815]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19d24755-5fa8-4e1d-aef6-b5fdde452855_3t8gij65 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:23 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19d24755-5fa8-4e1d-aef6-b5fdde452855_3t8gij65 Sep 28 17:19:23 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:23 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19d24755-5fa8-4e1d-aef6-b5fdde452855_3t8gij65" returned: 0 in 0.439s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19d24755-5fa8-4e1d-aef6-b5fdde452855_3t8gij65 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:23 devstack sudo[98105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19d24755-5fa8-4e1d-aef6-b5fdde452855_3t8gij65 Sep 28 17:19:23 devstack sudo[98105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:23 devstack sudo[98105]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19d24755-5fa8-4e1d-aef6-b5fdde452855_3t8gij65" returned: 1 in 0.449s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19d24755-5fa8-4e1d-aef6-b5fdde452855_3t8gij65' failed. Not Retrying. {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:19:23 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e9e9ce-7249-472f-8423-0f7459941193]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_7m_7dlc8devstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:24 devstack sudo[98134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_7m_7dlc8devstack@QuobyteHD Sep 28 17:19:24 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:24 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_7m_7dlc8devstack@QuobyteHD" returned: 0 in 0.443s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:24 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] 19d24755-5fa8-4e1d-aef6-b5fdde452855 was qcow2, converting to qcow2 {{(pid=86917) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:19:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_7m_7dlc8devstack@QuobyteHD /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:24 devstack sudo[98139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_7m_7dlc8devstack@QuobyteHD /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b Sep 28 17:19:24 devstack sudo[98139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:27 devstack sudo[98139]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_7m_7dlc8devstack@QuobyteHD /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b" returned: 0 in 2.730s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:27 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_7m_7dlc8devstack@QuobyteHD, size 112.00 MB, duration 2.73 sec, destination /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b {{(pid=86917) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:19:27 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Converted 112.00 MB image at 40.99 MB/s Sep 28 17:19:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:27 devstack sudo[98152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b 1G Sep 28 17:19:27 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:27 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b 1G" returned: 0 in 0.551s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:27 devstack cinder-volume[86917]: DEBUG cinder.volume.volume_utils [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Downloaded image 19d24755-5fa8-4e1d-aef6-b5fdde452855 ((None, [{'url': 'file:///opt/stack/data/glance/images/19d24755-5fa8-4e1d-aef6-b5fdde452855', 'metadata': {}}])) to volume d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b successfully. {{(pid=86917) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:19:27 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Temporary image 19d24755-5fa8-4e1d-aef6-b5fdde452855 for user 6575b687682e46aaa1e2c968f24beae8 is deleted. {{(pid=86917) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:19:27 devstack cinder-volume[86917]: DEBUG cinder.volume.volume_utils [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Marking volume d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b as bootable. {{(pid=86917) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:19:27 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Copying metadata from image 19d24755-5fa8-4e1d-aef6-b5fdde452855 to d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b. {{(pid=86917) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:19:27 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Creating volume glance metadata for volume d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b backed by image 19d24755-5fa8-4e1d-aef6-b5fdde452855 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '19d24755-5fa8-4e1d-aef6-b5fdde452855', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86917) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:19:27 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c04e310-dbad-4a62-a9ac-a4fd3b6aa01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b', 'volume_size': 1, 'image_id': '19d24755-5fa8-4e1d-aef6-b5fdde452855', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19d24755-5fa8-4e1d-aef6-b5fdde452855', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '307b831956a2452b912f3a0d37f5ee84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '19d24755-5fa8-4e1d-aef6-b5fdde452855', 'created_at': datetime.datetime(2026, 9, 28, 15, 0, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 0, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19d24755-5fa8-4e1d-aef6-b5fdde452855/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:27 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70b77d64-fe24-422c-a36c-de07bff10011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:27 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Volume volume-d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b (d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b): created successfully Sep 28 17:19:27 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70b77d64-fe24-422c-a36c-de07bff10011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:28 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Flow 'volume_create_manager' (cb063821-43f6-48ae-97fe-583ae6793993) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:28 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-1feb493d-a36e-432e-b3b8-79bec5266ca5 tempest-VolumesGetTest-991115499 None] Created volume successfully. Sep 28 17:19:29 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-9df9c7fd-38d3-4744-b967-87566d09ab80 req-b9198993-fee9-4f5f-8bb0-94db2606cab8 tempest-TestMinimumBasicScenario-1504157030 None] Terminate volume connection completed successfully. Sep 28 17:19:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-9df9c7fd-38d3-4744-b967-87566d09ab80 req-b9198993-fee9-4f5f-8bb0-94db2606cab8 tempest-TestMinimumBasicScenario-1504157030 None] Deleting attachment 388df04f-5943-41bb-9a3f-efc595955c0f. {{(pid=86917) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:19:29 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-650e5928-5806-4e22-be62-547b86b79863 tempest-VolumesGetTest-991115499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:19:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-650e5928-5806-4e22-be62-547b86b79863 tempest-VolumesGetTest-991115499 None] Flow 'volume_create_manager' (c0580050-4aaa-45a1-97cf-20b5f8f4c89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-650e5928-5806-4e22-be62-547b86b79863 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a24e4419-f187-4c4f-9b3e-d5564721eaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-650e5928-5806-4e22-be62-547b86b79863 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a24e4419-f187-4c4f-9b3e-d5564721eaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1078891689',display_name='tempest-VolumesGetTest-Volume-1618388268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18e1991-7eaa-447c-b277-a1c82cc3af2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3415289a214e76aa08bf911005d4b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:30Z,use_quota=True,user_id='6575b687682e46aaa1e2c968f24beae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-650e5928-5806-4e22-be62-547b86b79863 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43401690-3954-460e-b735-6f402e8e6246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-650e5928-5806-4e22-be62-547b86b79863 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43401690-3954-460e-b735-6f402e8e6246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-650e5928-5806-4e22-be62-547b86b79863 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab2226ba-6503-447e-84dc-0095b31d22fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-650e5928-5806-4e22-be62-547b86b79863 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab2226ba-6503-447e-84dc-0095b31d22fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd18e1991-7eaa-447c-b277-a1c82cc3af2a', 'volume_name': 'volume-d18e1991-7eaa-447c-b277-a1c82cc3af2a', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-650e5928-5806-4e22-be62-547b86b79863 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0146f8-4262-4493-a954-f7f46e5ba59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-650e5928-5806-4e22-be62-547b86b79863 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0146f8-4262-4493-a954-f7f46e5ba59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-650e5928-5806-4e22-be62-547b86b79863 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d20900ea-0d98-45ce-a5c0-1a93b4a6a70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:29 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-650e5928-5806-4e22-be62-547b86b79863 tempest-VolumesGetTest-991115499 None] Volume d18e1991-7eaa-447c-b277-a1c82cc3af2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d18e1991-7eaa-447c-b277-a1c82cc3af2a', 'volume_size': 1} Sep 28 17:19:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-650e5928-5806-4e22-be62-547b86b79863 tempest-VolumesGetTest-991115499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-650e5928-5806-4e22-be62-547b86b79863 tempest-VolumesGetTest-991115499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-650e5928-5806-4e22-be62-547b86b79863 tempest-VolumesGetTest-991115499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1078891689',display_name='tempest-VolumesGetTest-Volume-1618388268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18e1991-7eaa-447c-b277-a1c82cc3af2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3415289a214e76aa08bf911005d4b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:30Z,use_quota=True,user_id='6575b687682e46aaa1e2c968f24beae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:19:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-650e5928-5806-4e22-be62-547b86b79863 tempest-VolumesGetTest-991115499 None] Creating volume d18e1991-7eaa-447c-b277-a1c82cc3af2a {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:19:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-650e5928-5806-4e22-be62-547b86b79863 tempest-VolumesGetTest-991115499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-650e5928-5806-4e22-be62-547b86b79863 tempest-VolumesGetTest-991115499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-650e5928-5806-4e22-be62-547b86b79863 tempest-VolumesGetTest-991115499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-650e5928-5806-4e22-be62-547b86b79863 tempest-VolumesGetTest-991115499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-650e5928-5806-4e22-be62-547b86b79863 tempest-VolumesGetTest-991115499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-650e5928-5806-4e22-be62-547b86b79863 tempest-VolumesGetTest-991115499 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:19:29 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-650e5928-5806-4e22-be62-547b86b79863 tempest-VolumesGetTest-991115499 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:19:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-650e5928-5806-4e22-be62-547b86b79863 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d18e1991-7eaa-447c-b277-a1c82cc3af2a 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:29 devstack sudo[98165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d18e1991-7eaa-447c-b277-a1c82cc3af2a 1073741824 Sep 28 17:19:29 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:30 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:19:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Flow 'volume_create_manager' (833ef001-d758-46d4-a283-c82ff60f1f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a9a893-6379-47aa-bee7-125a778f61b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a9a893-6379-47aa-bee7-125a778f61b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1878365736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a91ab04283a84867b0b761b67122134e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=43a61fa6-ea48-407c-81d8-811e6ebe2af0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:30Z,use_quota=True,user_id='89f4bb8180604d35bd5944f8f8edfca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c156c97-ae12-46c9-af7d-1901f8134440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c156c97-ae12-46c9-af7d-1901f8134440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (201eb244-c30f-4521-83e0-8dfb6d5c8190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (201eb244-c30f-4521-83e0-8dfb6d5c8190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd18c9aec-8b40-4fbd-b7f1-7df205a6c9c9', 'volume_name': 'volume-d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9', 'volume_size': 1, 'snapshot_id': '43a61fa6-ea48-407c-81d8-811e6ebe2af0'}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25f156eb-ffcf-4f2b-8c00-8423c257c9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25f156eb-ffcf-4f2b-8c00-8423c257c9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13aef37f-e013-45fe-9235-fd86ca3bae25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:30 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Volume d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9', 'volume_size': 1, 'snapshot_id': '43a61fa6-ea48-407c-81d8-811e6ebe2af0'} Sep 28 17:19:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b6972187-e300-4f4e-9fb8-38a66abdbae0 tempest-TestMinimumBasicScenario-1504157030 None] Acquiring lock "cinder-5998d670-b6bd-4c9f-a606-a8fa0391abea-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b6972187-e300-4f4e-9fb8-38a66abdbae0 tempest-TestMinimumBasicScenario-1504157030 None] Lock "cinder-5998d670-b6bd-4c9f-a606-a8fa0391abea-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b6972187-e300-4f4e-9fb8-38a66abdbae0 tempest-TestMinimumBasicScenario-1504157030 None] Acquiring lock "cinder-quobyte-5998d670-b6bd-4c9f-a606-a8fa0391abea" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b6972187-e300-4f4e-9fb8-38a66abdbae0 tempest-TestMinimumBasicScenario-1504157030 None] Lock "cinder-quobyte-5998d670-b6bd-4c9f-a606-a8fa0391abea" acquired by "delete_volume" :: waited 0.032s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:30 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-650e5928-5806-4e22-be62-547b86b79863 tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d18e1991-7eaa-447c-b277-a1c82cc3af2a 1073741824" returned: 0 in 0.718s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:30 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[70faa861-7b29-44e5-8200-094d35cad175]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b6972187-e300-4f4e-9fb8-38a66abdbae0 tempest-TestMinimumBasicScenario-1504157030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5998d670-b6bd-4c9f-a606-a8fa0391abea {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-650e5928-5806-4e22-be62-547b86b79863 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d18e1991-7eaa-447c-b277-a1c82cc3af2a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:30 devstack sudo[98173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d18e1991-7eaa-447c-b277-a1c82cc3af2a Sep 28 17:19:30 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:30 devstack sudo[98171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5998d670-b6bd-4c9f-a606-a8fa0391abea Sep 28 17:19:30 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:30 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-650e5928-5806-4e22-be62-547b86b79863 tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d18e1991-7eaa-447c-b277-a1c82cc3af2a" returned: 0 in 0.345s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:30 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-650e5928-5806-4e22-be62-547b86b79863 tempest-VolumesGetTest-991115499 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:19:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-650e5928-5806-4e22-be62-547b86b79863 tempest-VolumesGetTest-991115499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.679s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Acquiring lock "cinder-quobyte-43a61fa6-ea48-407c-81d8-811e6ebe2af0-d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9" by "_create_volume_from_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-650e5928-5806-4e22-be62-547b86b79863 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d20900ea-0d98-45ce-a5c0-1a93b4a6a70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d18e1991-7eaa-447c-b277-a1c82cc3af2a', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:31 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-650e5928-5806-4e22-be62-547b86b79863 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99e11e0d-306d-4ca9-a98e-cf8e0f129f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:31 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Lock "cinder-quobyte-43a61fa6-ea48-407c-81d8-811e6ebe2af0-d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9" acquired by "_create_volume_from_snapshot" :: waited 0.052s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Creating volume d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9 from snapshot 43a61fa6-ea48-407c-81d8-811e6ebe2af0 {{(pid=86917) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:19:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:19:31 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Acquiring lock "cinder-quobyte-d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9" by "_copy_volume_from_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:31 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-650e5928-5806-4e22-be62-547b86b79863 tempest-VolumesGetTest-991115499 None] Volume volume-d18e1991-7eaa-447c-b277-a1c82cc3af2a (d18e1991-7eaa-447c-b277-a1c82cc3af2a): created successfully Sep 28 17:19:31 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-650e5928-5806-4e22-be62-547b86b79863 tempest-VolumesGetTest-991115499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99e11e0d-306d-4ca9-a98e-cf8e0f129f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:31 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-650e5928-5806-4e22-be62-547b86b79863 tempest-VolumesGetTest-991115499 None] Flow 'volume_create_manager' (c0580050-4aaa-45a1-97cf-20b5f8f4c89d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:31 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Lock "cinder-quobyte-d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9" acquired by "_copy_volume_from_snapshot" :: waited 0.048s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] snapshot: 43a61fa6-ea48-407c-81d8-811e6ebe2af0, volume: d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9, {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:19:31 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-650e5928-5806-4e22-be62-547b86b79863 tempest-VolumesGetTest-991115499 None] Created volume successfully. Sep 28 17:19:31 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b6972187-e300-4f4e-9fb8-38a66abdbae0 tempest-TestMinimumBasicScenario-1504157030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5998d670-b6bd-4c9f-a606-a8fa0391abea" returned: 0 in 0.591s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b6972187-e300-4f4e-9fb8-38a66abdbae0 tempest-TestMinimumBasicScenario-1504157030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5998d670-b6bd-4c9f-a606-a8fa0391abea {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:31 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f88e416-e0bb-4c18-86aa-e82c4a7d46b8]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306.43a61fa6-ea48-407c-81d8-811e6ebe2af0 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:31 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5998d670-b6bd-4c9f-a606-a8fa0391abea Sep 28 17:19:31 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:31 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306.43a61fa6-ea48-407c-81d8-811e6ebe2af0 Sep 28 17:19:31 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:31 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b6972187-e300-4f4e-9fb8-38a66abdbae0 tempest-TestMinimumBasicScenario-1504157030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5998d670-b6bd-4c9f-a606-a8fa0391abea" returned: 0 in 0.516s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:31 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b6972187-e300-4f4e-9fb8-38a66abdbae0 tempest-TestMinimumBasicScenario-1504157030 None] Lock "cinder-quobyte-5998d670-b6bd-4c9f-a606-a8fa0391abea" released by "delete_volume" :: held 1.209s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:31 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306.43a61fa6-ea48-407c-81d8-811e6ebe2af0" returned: 0 in 0.706s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3035682a-178b-4675-8d92-5ba3a79dc306(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:19:31 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-b6972187-e300-4f4e-9fb8-38a66abdbae0 tempest-TestMinimumBasicScenario-1504157030 None] Created reservations ['23f0bec2-df3a-467b-91bb-8194cafe2d70', '98edb950-5169-487f-ae8b-d6f93e82baf5', 'e4ceed5f-a437-4187-b6af-a89463e2882f', '64767bbe-307a-4064-9a33-3f2322334d4e'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:31 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56d0ced-15e3-4fc3-be5b-bcff8ebf3ced]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:31 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=77,cinder:INSERT=29,cinder:UPDATE=74,cinder:DELETE=7 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:19:32 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306 Sep 28 17:19:32 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b6972187-e300-4f4e-9fb8-38a66abdbae0 tempest-TestMinimumBasicScenario-1504157030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b6972187-e300-4f4e-9fb8-38a66abdbae0 tempest-TestMinimumBasicScenario-1504157030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b6972187-e300-4f4e-9fb8-38a66abdbae0 tempest-TestMinimumBasicScenario-1504157030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b6972187-e300-4f4e-9fb8-38a66abdbae0 tempest-TestMinimumBasicScenario-1504157030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b6972187-e300-4f4e-9fb8-38a66abdbae0 tempest-TestMinimumBasicScenario-1504157030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b6972187-e300-4f4e-9fb8-38a66abdbae0 tempest-TestMinimumBasicScenario-1504157030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:32 devstack sudo[98193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:19:32 devstack sudo[98193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-7bc043ab-6d97-4c8b-a805-5c038c5b721c tempest-VolumesGetTest-991115499 None] Acquiring lock "cinder-d18e1991-7eaa-447c-b277-a1c82cc3af2a-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-7bc043ab-6d97-4c8b-a805-5c038c5b721c tempest-VolumesGetTest-991115499 None] Lock "cinder-d18e1991-7eaa-447c-b277-a1c82cc3af2a-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-7bc043ab-6d97-4c8b-a805-5c038c5b721c tempest-VolumesGetTest-991115499 None] Acquiring lock "cinder-quobyte-d18e1991-7eaa-447c-b277-a1c82cc3af2a" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-7bc043ab-6d97-4c8b-a805-5c038c5b721c tempest-VolumesGetTest-991115499 None] Lock "cinder-quobyte-d18e1991-7eaa-447c-b277-a1c82cc3af2a" acquired by "delete_volume" :: waited 0.041s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:32 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11549ae-3c5b-4621-bd1a-e6c388605986]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7bc043ab-6d97-4c8b-a805-5c038c5b721c tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d18e1991-7eaa-447c-b277-a1c82cc3af2a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:32 devstack sudo[98193]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b6972187-e300-4f4e-9fb8-38a66abdbae0 tempest-TestMinimumBasicScenario-1504157030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.615s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:32 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-b6972187-e300-4f4e-9fb8-38a66abdbae0 tempest-TestMinimumBasicScenario-1504157030 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:32 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:32 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-b6972187-e300-4f4e-9fb8-38a66abdbae0 tempest-TestMinimumBasicScenario-1504157030 None] Deleted volume successfully. Sep 28 17:19:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306" returned: 0 in 1.020s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306 {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:19:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Creating direct copy from snapshot {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:19:32 devstack cinder-volume[86917]: DEBUG cinder.utils [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Path /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9 not found in is_blk_device check {{(pid=86917) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:19:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:33 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9 Sep 28 17:19:33 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:33 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b6972187-e300-4f4e-9fb8-38a66abdbae0 tempest-TestMinimumBasicScenario-1504157030 None] Lock "cinder-5998d670-b6bd-4c9f-a606-a8fa0391abea-delete_volume" released by "delete_volume" :: held 2.643s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:33 devstack sudo[98199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d18e1991-7eaa-447c-b277-a1c82cc3af2a Sep 28 17:19:33 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:33 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7bc043ab-6d97-4c8b-a805-5c038c5b721c tempest-VolumesGetTest-991115499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d18e1991-7eaa-447c-b277-a1c82cc3af2a" returned: 0 in 1.203s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7bc043ab-6d97-4c8b-a805-5c038c5b721c tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d18e1991-7eaa-447c-b277-a1c82cc3af2a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:34 devstack sudo[98218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d18e1991-7eaa-447c-b277-a1c82cc3af2a Sep 28 17:19:34 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:34 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7bc043ab-6d97-4c8b-a805-5c038c5b721c tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d18e1991-7eaa-447c-b277-a1c82cc3af2a" returned: 0 in 0.636s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:34 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-7bc043ab-6d97-4c8b-a805-5c038c5b721c tempest-VolumesGetTest-991115499 None] Lock "cinder-quobyte-d18e1991-7eaa-447c-b277-a1c82cc3af2a" released by "delete_volume" :: held 2.056s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:34 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:UPDATE=83,cinder:SELECT=79,cinder:DELETE=7,cinder:INSERT=19 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:19:35 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-7bc043ab-6d97-4c8b-a805-5c038c5b721c tempest-VolumesGetTest-991115499 None] Created reservations ['9e1397af-5fb1-48e5-9bf3-fb52d91d2d0a', '26ce7854-72fb-49b4-a3b0-b507eb1ca883', '8ae10a0d-8c63-496b-acd3-3299d085ae5c', '26f7cb84-0fe0-4e7a-8418-1574bd2bc3b2'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7bc043ab-6d97-4c8b-a805-5c038c5b721c tempest-VolumesGetTest-991115499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7bc043ab-6d97-4c8b-a805-5c038c5b721c tempest-VolumesGetTest-991115499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:35 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-7bc043ab-6d97-4c8b-a805-5c038c5b721c tempest-VolumesGetTest-991115499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:35 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-7bc043ab-6d97-4c8b-a805-5c038c5b721c tempest-VolumesGetTest-991115499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7bc043ab-6d97-4c8b-a805-5c038c5b721c tempest-VolumesGetTest-991115499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7bc043ab-6d97-4c8b-a805-5c038c5b721c tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:35 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:19:35 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:36 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7bc043ab-6d97-4c8b-a805-5c038c5b721c tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.808s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:36 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-7bc043ab-6d97-4c8b-a805-5c038c5b721c tempest-VolumesGetTest-991115499 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:36 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-7bc043ab-6d97-4c8b-a805-5c038c5b721c tempest-VolumesGetTest-991115499 None] Deleted volume successfully. Sep 28 17:19:36 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-7bc043ab-6d97-4c8b-a805-5c038c5b721c tempest-VolumesGetTest-991115499 None] Lock "cinder-d18e1991-7eaa-447c-b277-a1c82cc3af2a-delete_volume" released by "delete_volume" :: held 3.732s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:36 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-32381cb6-494d-48b2-9a21-5f93c4b9fd18 tempest-VolumesGetTest-991115499 None] Acquiring lock "cinder-d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:36 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-32381cb6-494d-48b2-9a21-5f93c4b9fd18 tempest-VolumesGetTest-991115499 None] Lock "cinder-d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:37 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-32381cb6-494d-48b2-9a21-5f93c4b9fd18 tempest-VolumesGetTest-991115499 None] Acquiring lock "cinder-quobyte-d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:37 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-32381cb6-494d-48b2-9a21-5f93c4b9fd18 tempest-VolumesGetTest-991115499 None] Lock "cinder-quobyte-d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b" acquired by "delete_volume" :: waited 0.057s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:37 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d66b6b5-1c69-4f2e-806a-52ea8fa2751d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-32381cb6-494d-48b2-9a21-5f93c4b9fd18 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:37 devstack sudo[98254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b Sep 28 17:19:37 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:39 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-32381cb6-494d-48b2-9a21-5f93c4b9fd18 tempest-VolumesGetTest-991115499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b" returned: 0 in 1.940s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-32381cb6-494d-48b2-9a21-5f93c4b9fd18 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:39 devstack sudo[98283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b Sep 28 17:19:39 devstack sudo[98283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:40 devstack sudo[98283]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-32381cb6-494d-48b2-9a21-5f93c4b9fd18 tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b" returned: 0 in 0.961s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:40 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-32381cb6-494d-48b2-9a21-5f93c4b9fd18 tempest-VolumesGetTest-991115499 None] Lock "cinder-quobyte-d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b" released by "delete_volume" :: held 3.078s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:40 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-32381cb6-494d-48b2-9a21-5f93c4b9fd18 tempest-VolumesGetTest-991115499 None] Created reservations ['72f24931-e108-43e2-b9d2-73b109baf60f', 'bf71a709-3899-47d4-860d-834b56923b63', 'cd3ef99c-c954-44dc-bd04-0f65cb87d209', 'bc4ac922-79b7-45d0-b290-f8e822ee6b40'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-32381cb6-494d-48b2-9a21-5f93c4b9fd18 tempest-VolumesGetTest-991115499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-32381cb6-494d-48b2-9a21-5f93c4b9fd18 tempest-VolumesGetTest-991115499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:40 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-32381cb6-494d-48b2-9a21-5f93c4b9fd18 tempest-VolumesGetTest-991115499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:40 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-32381cb6-494d-48b2-9a21-5f93c4b9fd18 tempest-VolumesGetTest-991115499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-32381cb6-494d-48b2-9a21-5f93c4b9fd18 tempest-VolumesGetTest-991115499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-32381cb6-494d-48b2-9a21-5f93c4b9fd18 tempest-VolumesGetTest-991115499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:40 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:19:40 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:42 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-32381cb6-494d-48b2-9a21-5f93c4b9fd18 tempest-VolumesGetTest-991115499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 1.295s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:42 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-32381cb6-494d-48b2-9a21-5f93c4b9fd18 tempest-VolumesGetTest-991115499 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:42 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-32381cb6-494d-48b2-9a21-5f93c4b9fd18 tempest-VolumesGetTest-991115499 None] Deleted volume successfully. Sep 28 17:19:42 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-32381cb6-494d-48b2-9a21-5f93c4b9fd18 tempest-VolumesGetTest-991115499 None] Lock "cinder-d1becb20-e6ac-46e9-bad8-e0ccc57fbf0b-delete_volume" released by "delete_volume" :: held 5.357s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:46 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9" returned: 0 in 13.972s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:46 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Image conversion details: src /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306, size 1024.00 MB, duration 13.97 sec, destination /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9 {{(pid=86917) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:19:46 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Converted 1024.00 MB image at 73.28 MB/s Sep 28 17:19:46 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9 is being set with open permissions: ugo+rw Sep 28 17:19:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:46 devstack sudo[98340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9 Sep 28 17:19:46 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:47 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9" returned: 0 in 0.360s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:47 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Lock "cinder-quobyte-d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9" released by "_copy_volume_from_snapshot" :: held 16.252s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:47 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Lock "cinder-quobyte-43a61fa6-ea48-407c-81d8-811e6ebe2af0-d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9" released by "_create_volume_from_snapshot" :: held 16.402s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 16.456s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:47 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13aef37f-e013-45fe-9235-fd86ca3bae25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9', 'volume_size': 1, 'snapshot_id': '43a61fa6-ea48-407c-81d8-811e6ebe2af0'}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:47 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36fd9de-8489-44c6-947f-1303c9c78728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:47 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Volume volume-d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9 (d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9): created successfully Sep 28 17:19:47 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36fd9de-8489-44c6-947f-1303c9c78728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:47 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Flow 'volume_create_manager' (833ef001-d758-46d4-a283-c82ff60f1f0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:47 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-d68d65a5-dc4b-4334-840a-d081c37208a0 tempest-TestStampPattern-1988873608 None] Created volume successfully. Sep 28 17:19:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:19:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:49 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:19:49 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:49 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.484s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:49 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:50 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager._thread_info {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:19:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread count: 28 {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:19:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread info: [<_MainThread(MainThread, started 132915553284224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:19:52 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d921390-2f86-4b58-84b8-2e0ab2b0d26b tempest-VolumesListTestJSON-1032792281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:19:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0d921390-2f86-4b58-84b8-2e0ab2b0d26b tempest-VolumesListTestJSON-1032792281 None] Flow 'volume_create_manager' (548e70b2-a682-4523-be48-0d236483fa10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0d921390-2f86-4b58-84b8-2e0ab2b0d26b tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc99195-0537-4625-8e10-6ac23dccb65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0d921390-2f86-4b58-84b8-2e0ab2b0d26b tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc99195-0537-4625-8e10-6ac23dccb65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1391346173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaf25449-36d6-4152-9a3c-d6fcb6dd9d97,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='07ca24474d4849c7808f22adbc49a30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:53Z,use_quota=True,user_id='da29afcca5d74a43820c78e0f0efac66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0d921390-2f86-4b58-84b8-2e0ab2b0d26b tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19bb7f84-7a38-442d-9b0a-b171e51a9fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0d921390-2f86-4b58-84b8-2e0ab2b0d26b tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19bb7f84-7a38-442d-9b0a-b171e51a9fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0d921390-2f86-4b58-84b8-2e0ab2b0d26b tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d8a964-9c06-40ad-956d-d135986fbe2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0d921390-2f86-4b58-84b8-2e0ab2b0d26b tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d8a964-9c06-40ad-956d-d135986fbe2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaf25449-36d6-4152-9a3c-d6fcb6dd9d97', 'volume_name': 'volume-aaf25449-36d6-4152-9a3c-d6fcb6dd9d97', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0d921390-2f86-4b58-84b8-2e0ab2b0d26b tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b728ec-5872-432c-bfc1-3a5d345eabbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0d921390-2f86-4b58-84b8-2e0ab2b0d26b tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b728ec-5872-432c-bfc1-3a5d345eabbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0d921390-2f86-4b58-84b8-2e0ab2b0d26b tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc63d023-86cb-4b74-a772-78d470faa08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:53 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-0d921390-2f86-4b58-84b8-2e0ab2b0d26b tempest-VolumesListTestJSON-1032792281 None] Volume aaf25449-36d6-4152-9a3c-d6fcb6dd9d97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaf25449-36d6-4152-9a3c-d6fcb6dd9d97', 'volume_size': 1} Sep 28 17:19:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0d921390-2f86-4b58-84b8-2e0ab2b0d26b tempest-VolumesListTestJSON-1032792281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0d921390-2f86-4b58-84b8-2e0ab2b0d26b tempest-VolumesListTestJSON-1032792281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:53 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0d921390-2f86-4b58-84b8-2e0ab2b0d26b tempest-VolumesListTestJSON-1032792281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1391346173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaf25449-36d6-4152-9a3c-d6fcb6dd9d97,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='07ca24474d4849c7808f22adbc49a30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:53Z,use_quota=True,user_id='da29afcca5d74a43820c78e0f0efac66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:19:53 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-0d921390-2f86-4b58-84b8-2e0ab2b0d26b tempest-VolumesListTestJSON-1032792281 None] Creating volume aaf25449-36d6-4152-9a3c-d6fcb6dd9d97 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:19:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0d921390-2f86-4b58-84b8-2e0ab2b0d26b tempest-VolumesListTestJSON-1032792281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0d921390-2f86-4b58-84b8-2e0ab2b0d26b tempest-VolumesListTestJSON-1032792281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:53 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0d921390-2f86-4b58-84b8-2e0ab2b0d26b tempest-VolumesListTestJSON-1032792281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:53 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0d921390-2f86-4b58-84b8-2e0ab2b0d26b tempest-VolumesListTestJSON-1032792281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0d921390-2f86-4b58-84b8-2e0ab2b0d26b tempest-VolumesListTestJSON-1032792281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:53 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0d921390-2f86-4b58-84b8-2e0ab2b0d26b tempest-VolumesListTestJSON-1032792281 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:19:53 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-0d921390-2f86-4b58-84b8-2e0ab2b0d26b tempest-VolumesListTestJSON-1032792281 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:19:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0d921390-2f86-4b58-84b8-2e0ab2b0d26b tempest-VolumesListTestJSON-1032792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aaf25449-36d6-4152-9a3c-d6fcb6dd9d97 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:53 devstack sudo[98413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aaf25449-36d6-4152-9a3c-d6fcb6dd9d97 1073741824 Sep 28 17:19:53 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:53 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-3c9090c8-e763-4fc7-b703-de2c39c20ad3 req-a4f39328-b8b8-41f4-bf63-5c900902a284 tempest-AttachVolumeNegativeTest-158509557 None] Terminate volume connection completed successfully. Sep 28 17:19:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-3c9090c8-e763-4fc7-b703-de2c39c20ad3 req-a4f39328-b8b8-41f4-bf63-5c900902a284 tempest-AttachVolumeNegativeTest-158509557 None] Deleting attachment c01ce6c7-c5b1-4a40-ade3-f580a0122a78. {{(pid=86917) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:19:54 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0d921390-2f86-4b58-84b8-2e0ab2b0d26b tempest-VolumesListTestJSON-1032792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aaf25449-36d6-4152-9a3c-d6fcb6dd9d97 1073741824" returned: 0 in 1.258s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0d921390-2f86-4b58-84b8-2e0ab2b0d26b tempest-VolumesListTestJSON-1032792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aaf25449-36d6-4152-9a3c-d6fcb6dd9d97 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:54 devstack sudo[98421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aaf25449-36d6-4152-9a3c-d6fcb6dd9d97 Sep 28 17:19:54 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:55 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0d921390-2f86-4b58-84b8-2e0ab2b0d26b tempest-VolumesListTestJSON-1032792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aaf25449-36d6-4152-9a3c-d6fcb6dd9d97" returned: 0 in 0.807s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:55 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0d921390-2f86-4b58-84b8-2e0ab2b0d26b tempest-VolumesListTestJSON-1032792281 None] <== create_volume: return (2224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:19:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0d921390-2f86-4b58-84b8-2e0ab2b0d26b tempest-VolumesListTestJSON-1032792281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.244s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0d921390-2f86-4b58-84b8-2e0ab2b0d26b tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc63d023-86cb-4b74-a772-78d470faa08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaf25449-36d6-4152-9a3c-d6fcb6dd9d97', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0d921390-2f86-4b58-84b8-2e0ab2b0d26b tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22920663-583e-47e6-9654-f5664ebaeaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:55 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-0d921390-2f86-4b58-84b8-2e0ab2b0d26b tempest-VolumesListTestJSON-1032792281 None] Volume volume-aaf25449-36d6-4152-9a3c-d6fcb6dd9d97 (aaf25449-36d6-4152-9a3c-d6fcb6dd9d97): created successfully Sep 28 17:19:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0d921390-2f86-4b58-84b8-2e0ab2b0d26b tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22920663-583e-47e6-9654-f5664ebaeaed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0d921390-2f86-4b58-84b8-2e0ab2b0d26b tempest-VolumesListTestJSON-1032792281 None] Flow 'volume_create_manager' (548e70b2-a682-4523-be48-0d236483fa10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:55 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-0d921390-2f86-4b58-84b8-2e0ab2b0d26b tempest-VolumesListTestJSON-1032792281 None] Created volume successfully. Sep 28 17:19:57 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-a10ee7ba-fd0f-4ea0-b9d9-af508f50be56 tempest-VolumesListTestJSON-1032792281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:19:57 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a10ee7ba-fd0f-4ea0-b9d9-af508f50be56 tempest-VolumesListTestJSON-1032792281 None] Flow 'volume_create_manager' (0a2b7397-d16b-4278-9dde-a85f83b7d7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:57 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a10ee7ba-fd0f-4ea0-b9d9-af508f50be56 tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53baf26f-97bd-4f66-9816-21187a048ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:57 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a10ee7ba-fd0f-4ea0-b9d9-af508f50be56 tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53baf26f-97bd-4f66-9816-21187a048ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-696667151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d71d71-3c90-425d-a071-f55da7d1e4c5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='07ca24474d4849c7808f22adbc49a30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:57Z,use_quota=True,user_id='da29afcca5d74a43820c78e0f0efac66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:57 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a10ee7ba-fd0f-4ea0-b9d9-af508f50be56 tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2ab40c9-4cf0-45b0-85b6-f070e752cee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:57 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a10ee7ba-fd0f-4ea0-b9d9-af508f50be56 tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2ab40c9-4cf0-45b0-85b6-f070e752cee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:57 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a10ee7ba-fd0f-4ea0-b9d9-af508f50be56 tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb8e7f7-4ea5-407d-ab78-514b4f3df8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:57 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a10ee7ba-fd0f-4ea0-b9d9-af508f50be56 tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb8e7f7-4ea5-407d-ab78-514b4f3df8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44d71d71-3c90-425d-a071-f55da7d1e4c5', 'volume_name': 'volume-44d71d71-3c90-425d-a071-f55da7d1e4c5', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:57 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a10ee7ba-fd0f-4ea0-b9d9-af508f50be56 tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb5d45f-90e6-4c74-a86c-74899be2f2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:57 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a10ee7ba-fd0f-4ea0-b9d9-af508f50be56 tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb5d45f-90e6-4c74-a86c-74899be2f2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:57 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a10ee7ba-fd0f-4ea0-b9d9-af508f50be56 tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f0d739-0241-4bca-bb9a-aac3ad902758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:57 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-a10ee7ba-fd0f-4ea0-b9d9-af508f50be56 tempest-VolumesListTestJSON-1032792281 None] Volume 44d71d71-3c90-425d-a071-f55da7d1e4c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44d71d71-3c90-425d-a071-f55da7d1e4c5', 'volume_size': 1} Sep 28 17:19:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a10ee7ba-fd0f-4ea0-b9d9-af508f50be56 tempest-VolumesListTestJSON-1032792281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a10ee7ba-fd0f-4ea0-b9d9-af508f50be56 tempest-VolumesListTestJSON-1032792281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:57 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a10ee7ba-fd0f-4ea0-b9d9-af508f50be56 tempest-VolumesListTestJSON-1032792281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-696667151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d71d71-3c90-425d-a071-f55da7d1e4c5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='07ca24474d4849c7808f22adbc49a30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:57Z,use_quota=True,user_id='da29afcca5d74a43820c78e0f0efac66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:19:57 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-a10ee7ba-fd0f-4ea0-b9d9-af508f50be56 tempest-VolumesListTestJSON-1032792281 None] Creating volume 44d71d71-3c90-425d-a071-f55da7d1e4c5 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:19:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a10ee7ba-fd0f-4ea0-b9d9-af508f50be56 tempest-VolumesListTestJSON-1032792281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a10ee7ba-fd0f-4ea0-b9d9-af508f50be56 tempest-VolumesListTestJSON-1032792281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:57 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a10ee7ba-fd0f-4ea0-b9d9-af508f50be56 tempest-VolumesListTestJSON-1032792281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:57 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a10ee7ba-fd0f-4ea0-b9d9-af508f50be56 tempest-VolumesListTestJSON-1032792281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a10ee7ba-fd0f-4ea0-b9d9-af508f50be56 tempest-VolumesListTestJSON-1032792281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:57 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a10ee7ba-fd0f-4ea0-b9d9-af508f50be56 tempest-VolumesListTestJSON-1032792281 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:19:57 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-a10ee7ba-fd0f-4ea0-b9d9-af508f50be56 tempest-VolumesListTestJSON-1032792281 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:19:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a10ee7ba-fd0f-4ea0-b9d9-af508f50be56 tempest-VolumesListTestJSON-1032792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-44d71d71-3c90-425d-a071-f55da7d1e4c5 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:57 devstack sudo[98446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-44d71d71-3c90-425d-a071-f55da7d1e4c5 1073741824 Sep 28 17:19:57 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:57 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a10ee7ba-fd0f-4ea0-b9d9-af508f50be56 tempest-VolumesListTestJSON-1032792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-44d71d71-3c90-425d-a071-f55da7d1e4c5 1073741824" returned: 0 in 0.541s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a10ee7ba-fd0f-4ea0-b9d9-af508f50be56 tempest-VolumesListTestJSON-1032792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-44d71d71-3c90-425d-a071-f55da7d1e4c5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:58 devstack sudo[98453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-44d71d71-3c90-425d-a071-f55da7d1e4c5 Sep 28 17:19:58 devstack sudo[98453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:58 devstack sudo[98453]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a10ee7ba-fd0f-4ea0-b9d9-af508f50be56 tempest-VolumesListTestJSON-1032792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-44d71d71-3c90-425d-a071-f55da7d1e4c5" returned: 0 in 0.598s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:58 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a10ee7ba-fd0f-4ea0-b9d9-af508f50be56 tempest-VolumesListTestJSON-1032792281 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:19:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a10ee7ba-fd0f-4ea0-b9d9-af508f50be56 tempest-VolumesListTestJSON-1032792281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a10ee7ba-fd0f-4ea0-b9d9-af508f50be56 tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f0d739-0241-4bca-bb9a-aac3ad902758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44d71d71-3c90-425d-a071-f55da7d1e4c5', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a10ee7ba-fd0f-4ea0-b9d9-af508f50be56 tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d166ab23-f468-47df-96d3-98ad2e6c6336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:58 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-a10ee7ba-fd0f-4ea0-b9d9-af508f50be56 tempest-VolumesListTestJSON-1032792281 None] Volume volume-44d71d71-3c90-425d-a071-f55da7d1e4c5 (44d71d71-3c90-425d-a071-f55da7d1e4c5): created successfully Sep 28 17:19:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a10ee7ba-fd0f-4ea0-b9d9-af508f50be56 tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d166ab23-f468-47df-96d3-98ad2e6c6336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a10ee7ba-fd0f-4ea0-b9d9-af508f50be56 tempest-VolumesListTestJSON-1032792281 None] Flow 'volume_create_manager' (0a2b7397-d16b-4278-9dde-a85f83b7d7f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:58 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-a10ee7ba-fd0f-4ea0-b9d9-af508f50be56 tempest-VolumesListTestJSON-1032792281 None] Created volume successfully. Sep 28 17:20:01 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c6c8f79-e67e-47ef-81a3-fa24b4c25144 tempest-VolumesListTestJSON-1032792281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7c6c8f79-e67e-47ef-81a3-fa24b4c25144 tempest-VolumesListTestJSON-1032792281 None] Flow 'volume_create_manager' (1332712c-823a-4454-89a7-be0c0a7911df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7c6c8f79-e67e-47ef-81a3-fa24b4c25144 tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4685b18-715d-4a55-bbb4-6b99051ae742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7c6c8f79-e67e-47ef-81a3-fa24b4c25144 tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4685b18-715d-4a55-bbb4-6b99051ae742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-95087542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34b587b1-407b-47db-a9d0-ea8aca4cf8d4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='07ca24474d4849c7808f22adbc49a30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:01Z,use_quota=True,user_id='da29afcca5d74a43820c78e0f0efac66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7c6c8f79-e67e-47ef-81a3-fa24b4c25144 tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a25d65c1-8b1a-49f4-9252-ef8ae7d2d645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7c6c8f79-e67e-47ef-81a3-fa24b4c25144 tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a25d65c1-8b1a-49f4-9252-ef8ae7d2d645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7c6c8f79-e67e-47ef-81a3-fa24b4c25144 tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35f54c3f-6989-47a8-afee-03dbc71d8513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7c6c8f79-e67e-47ef-81a3-fa24b4c25144 tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35f54c3f-6989-47a8-afee-03dbc71d8513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34b587b1-407b-47db-a9d0-ea8aca4cf8d4', 'volume_name': 'volume-34b587b1-407b-47db-a9d0-ea8aca4cf8d4', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7c6c8f79-e67e-47ef-81a3-fa24b4c25144 tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f894dba7-2ea3-4f39-b94a-21a554f65884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7c6c8f79-e67e-47ef-81a3-fa24b4c25144 tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f894dba7-2ea3-4f39-b94a-21a554f65884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7c6c8f79-e67e-47ef-81a3-fa24b4c25144 tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42bf5052-e0bb-4e45-b502-599f4cff707d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:01 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-7c6c8f79-e67e-47ef-81a3-fa24b4c25144 tempest-VolumesListTestJSON-1032792281 None] Volume 34b587b1-407b-47db-a9d0-ea8aca4cf8d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34b587b1-407b-47db-a9d0-ea8aca4cf8d4', 'volume_size': 1} Sep 28 17:20:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7c6c8f79-e67e-47ef-81a3-fa24b4c25144 tempest-VolumesListTestJSON-1032792281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7c6c8f79-e67e-47ef-81a3-fa24b4c25144 tempest-VolumesListTestJSON-1032792281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:01 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-7c6c8f79-e67e-47ef-81a3-fa24b4c25144 tempest-VolumesListTestJSON-1032792281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-95087542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34b587b1-407b-47db-a9d0-ea8aca4cf8d4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='07ca24474d4849c7808f22adbc49a30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:01Z,use_quota=True,user_id='da29afcca5d74a43820c78e0f0efac66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:01 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-7c6c8f79-e67e-47ef-81a3-fa24b4c25144 tempest-VolumesListTestJSON-1032792281 None] Creating volume 34b587b1-407b-47db-a9d0-ea8aca4cf8d4 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7c6c8f79-e67e-47ef-81a3-fa24b4c25144 tempest-VolumesListTestJSON-1032792281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7c6c8f79-e67e-47ef-81a3-fa24b4c25144 tempest-VolumesListTestJSON-1032792281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:01 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-7c6c8f79-e67e-47ef-81a3-fa24b4c25144 tempest-VolumesListTestJSON-1032792281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:01 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-7c6c8f79-e67e-47ef-81a3-fa24b4c25144 tempest-VolumesListTestJSON-1032792281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7c6c8f79-e67e-47ef-81a3-fa24b4c25144 tempest-VolumesListTestJSON-1032792281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:01 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-7c6c8f79-e67e-47ef-81a3-fa24b4c25144 tempest-VolumesListTestJSON-1032792281 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:01 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-7c6c8f79-e67e-47ef-81a3-fa24b4c25144 tempest-VolumesListTestJSON-1032792281 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:20:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7c6c8f79-e67e-47ef-81a3-fa24b4c25144 tempest-VolumesListTestJSON-1032792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-34b587b1-407b-47db-a9d0-ea8aca4cf8d4 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:01 devstack sudo[98460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-34b587b1-407b-47db-a9d0-ea8aca4cf8d4 1073741824 Sep 28 17:20:01 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:01 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7c6c8f79-e67e-47ef-81a3-fa24b4c25144 tempest-VolumesListTestJSON-1032792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-34b587b1-407b-47db-a9d0-ea8aca4cf8d4 1073741824" returned: 0 in 0.679s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7c6c8f79-e67e-47ef-81a3-fa24b4c25144 tempest-VolumesListTestJSON-1032792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-34b587b1-407b-47db-a9d0-ea8aca4cf8d4 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:01 devstack sudo[98466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-34b587b1-407b-47db-a9d0-ea8aca4cf8d4 Sep 28 17:20:01 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:02 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7c6c8f79-e67e-47ef-81a3-fa24b4c25144 tempest-VolumesListTestJSON-1032792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-34b587b1-407b-47db-a9d0-ea8aca4cf8d4" returned: 0 in 0.382s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:02 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-7c6c8f79-e67e-47ef-81a3-fa24b4c25144 tempest-VolumesListTestJSON-1032792281 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7c6c8f79-e67e-47ef-81a3-fa24b4c25144 tempest-VolumesListTestJSON-1032792281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:02 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7c6c8f79-e67e-47ef-81a3-fa24b4c25144 tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42bf5052-e0bb-4e45-b502-599f4cff707d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34b587b1-407b-47db-a9d0-ea8aca4cf8d4', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:02 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7c6c8f79-e67e-47ef-81a3-fa24b4c25144 tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce819a7-01c4-4452-be4f-a746ed88beb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:02 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-7c6c8f79-e67e-47ef-81a3-fa24b4c25144 tempest-VolumesListTestJSON-1032792281 None] Volume volume-34b587b1-407b-47db-a9d0-ea8aca4cf8d4 (34b587b1-407b-47db-a9d0-ea8aca4cf8d4): created successfully Sep 28 17:20:02 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7c6c8f79-e67e-47ef-81a3-fa24b4c25144 tempest-VolumesListTestJSON-1032792281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce819a7-01c4-4452-be4f-a746ed88beb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:02 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7c6c8f79-e67e-47ef-81a3-fa24b4c25144 tempest-VolumesListTestJSON-1032792281 None] Flow 'volume_create_manager' (1332712c-823a-4454-89a7-be0c0a7911df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:02 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-7c6c8f79-e67e-47ef-81a3-fa24b4c25144 tempest-VolumesListTestJSON-1032792281 None] Created volume successfully. Sep 28 17:20:07 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-986636ce-719d-45d6-9af5-996ca55f7459 tempest-VolumesListTestJSON-1032792281 None] Acquiring lock "cinder-34b587b1-407b-47db-a9d0-ea8aca4cf8d4-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:07 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-986636ce-719d-45d6-9af5-996ca55f7459 tempest-VolumesListTestJSON-1032792281 None] Lock "cinder-34b587b1-407b-47db-a9d0-ea8aca4cf8d4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:07 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-986636ce-719d-45d6-9af5-996ca55f7459 tempest-VolumesListTestJSON-1032792281 None] Acquiring lock "cinder-quobyte-34b587b1-407b-47db-a9d0-ea8aca4cf8d4" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:07 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-986636ce-719d-45d6-9af5-996ca55f7459 tempest-VolumesListTestJSON-1032792281 None] Lock "cinder-quobyte-34b587b1-407b-47db-a9d0-ea8aca4cf8d4" acquired by "delete_volume" :: waited 0.018s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:07 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f07eaa5-2f45-46be-bd74-2fe1ef352b07]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-986636ce-719d-45d6-9af5-996ca55f7459 tempest-VolumesListTestJSON-1032792281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-34b587b1-407b-47db-a9d0-ea8aca4cf8d4 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:07 devstack sudo[98483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-34b587b1-407b-47db-a9d0-ea8aca4cf8d4 Sep 28 17:20:07 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:08 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-986636ce-719d-45d6-9af5-996ca55f7459 tempest-VolumesListTestJSON-1032792281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-34b587b1-407b-47db-a9d0-ea8aca4cf8d4" returned: 0 in 0.505s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-986636ce-719d-45d6-9af5-996ca55f7459 tempest-VolumesListTestJSON-1032792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-34b587b1-407b-47db-a9d0-ea8aca4cf8d4 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:08 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-34b587b1-407b-47db-a9d0-ea8aca4cf8d4 Sep 28 17:20:08 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:08 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-986636ce-719d-45d6-9af5-996ca55f7459 tempest-VolumesListTestJSON-1032792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-34b587b1-407b-47db-a9d0-ea8aca4cf8d4" returned: 0 in 0.367s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:08 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-986636ce-719d-45d6-9af5-996ca55f7459 tempest-VolumesListTestJSON-1032792281 None] Lock "cinder-quobyte-34b587b1-407b-47db-a9d0-ea8aca4cf8d4" released by "delete_volume" :: held 0.942s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:08 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-986636ce-719d-45d6-9af5-996ca55f7459 tempest-VolumesListTestJSON-1032792281 None] Created reservations ['9d4ce001-dd5f-4298-830a-c8b103998463', '0eda0839-3747-46b8-b759-0efed50f0c37', 'c365db5d-e7ec-428c-919d-375c75590ae0', '55f93338-5b94-44fb-a5a0-e95206f89a4d'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-986636ce-719d-45d6-9af5-996ca55f7459 tempest-VolumesListTestJSON-1032792281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-986636ce-719d-45d6-9af5-996ca55f7459 tempest-VolumesListTestJSON-1032792281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:08 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-986636ce-719d-45d6-9af5-996ca55f7459 tempest-VolumesListTestJSON-1032792281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:08 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-986636ce-719d-45d6-9af5-996ca55f7459 tempest-VolumesListTestJSON-1032792281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-986636ce-719d-45d6-9af5-996ca55f7459 tempest-VolumesListTestJSON-1032792281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-986636ce-719d-45d6-9af5-996ca55f7459 tempest-VolumesListTestJSON-1032792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:09 devstack sudo[98491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:20:09 devstack sudo[98491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:09 devstack sudo[98491]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-986636ce-719d-45d6-9af5-996ca55f7459 tempest-VolumesListTestJSON-1032792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.325s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:09 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-986636ce-719d-45d6-9af5-996ca55f7459 tempest-VolumesListTestJSON-1032792281 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:09 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-986636ce-719d-45d6-9af5-996ca55f7459 tempest-VolumesListTestJSON-1032792281 None] Deleted volume successfully. Sep 28 17:20:09 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-986636ce-719d-45d6-9af5-996ca55f7459 tempest-VolumesListTestJSON-1032792281 None] Lock "cinder-34b587b1-407b-47db-a9d0-ea8aca4cf8d4-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:10 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b7841c12-1e9c-4e91-8e89-28a454c7a11a tempest-VolumesListTestJSON-1032792281 None] Acquiring lock "cinder-44d71d71-3c90-425d-a071-f55da7d1e4c5-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:10 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b7841c12-1e9c-4e91-8e89-28a454c7a11a tempest-VolumesListTestJSON-1032792281 None] Lock "cinder-44d71d71-3c90-425d-a071-f55da7d1e4c5-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:10 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b7841c12-1e9c-4e91-8e89-28a454c7a11a tempest-VolumesListTestJSON-1032792281 None] Acquiring lock "cinder-quobyte-44d71d71-3c90-425d-a071-f55da7d1e4c5" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:10 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b7841c12-1e9c-4e91-8e89-28a454c7a11a tempest-VolumesListTestJSON-1032792281 None] Lock "cinder-quobyte-44d71d71-3c90-425d-a071-f55da7d1e4c5" acquired by "delete_volume" :: waited 0.031s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:10 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcd9f1c-c838-48e3-a648-b19ffd4b6e55]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b7841c12-1e9c-4e91-8e89-28a454c7a11a tempest-VolumesListTestJSON-1032792281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-44d71d71-3c90-425d-a071-f55da7d1e4c5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:10 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-44d71d71-3c90-425d-a071-f55da7d1e4c5 Sep 28 17:20:10 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:10 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2ba9d82-28ed-42ac-b9d7-5acb5742e475 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:10 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-e2ba9d82-28ed-42ac-b9d7-5acb5742e475 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Flow 'volume_create_manager' (aef7aaa1-e39f-4a72-a532-218b72c4bfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:10 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-e2ba9d82-28ed-42ac-b9d7-5acb5742e475 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f571af-4e56-49e3-affd-4fb2df63e3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:10 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-e2ba9d82-28ed-42ac-b9d7-5acb5742e475 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f571af-4e56-49e3-affd-4fb2df63e3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1918127768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32fbf648-a661-41f7-beda-a585102708ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8af2018212bd4fe8b0b01bb227f83f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:11Z,use_quota=True,user_id='52b8e3bc157f4b01b83a7d665bd007fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:10 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-e2ba9d82-28ed-42ac-b9d7-5acb5742e475 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d730bd59-1bb0-4c7b-b913-6301b1b465c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:10 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-e2ba9d82-28ed-42ac-b9d7-5acb5742e475 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d730bd59-1bb0-4c7b-b913-6301b1b465c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:10 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-e2ba9d82-28ed-42ac-b9d7-5acb5742e475 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80d053a9-99db-4cb4-a466-bddc638ef364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:10 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-e2ba9d82-28ed-42ac-b9d7-5acb5742e475 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80d053a9-99db-4cb4-a466-bddc638ef364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32fbf648-a661-41f7-beda-a585102708ad', 'volume_name': 'volume-32fbf648-a661-41f7-beda-a585102708ad', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:10 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-e2ba9d82-28ed-42ac-b9d7-5acb5742e475 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f9414a-1ae3-4f4f-8f6d-ada788a88f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:10 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-e2ba9d82-28ed-42ac-b9d7-5acb5742e475 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f9414a-1ae3-4f4f-8f6d-ada788a88f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:10 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-e2ba9d82-28ed-42ac-b9d7-5acb5742e475 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca94e14-c83b-4910-81c6-099de4bd41a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:10 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-e2ba9d82-28ed-42ac-b9d7-5acb5742e475 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Volume 32fbf648-a661-41f7-beda-a585102708ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32fbf648-a661-41f7-beda-a585102708ad', 'volume_size': 1} Sep 28 17:20:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e2ba9d82-28ed-42ac-b9d7-5acb5742e475 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e2ba9d82-28ed-42ac-b9d7-5acb5742e475 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:10 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-e2ba9d82-28ed-42ac-b9d7-5acb5742e475 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1918127768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32fbf648-a661-41f7-beda-a585102708ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8af2018212bd4fe8b0b01bb227f83f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:11Z,use_quota=True,user_id='52b8e3bc157f4b01b83a7d665bd007fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:10 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-e2ba9d82-28ed-42ac-b9d7-5acb5742e475 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Creating volume 32fbf648-a661-41f7-beda-a585102708ad {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e2ba9d82-28ed-42ac-b9d7-5acb5742e475 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e2ba9d82-28ed-42ac-b9d7-5acb5742e475 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:10 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-e2ba9d82-28ed-42ac-b9d7-5acb5742e475 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:10 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-e2ba9d82-28ed-42ac-b9d7-5acb5742e475 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e2ba9d82-28ed-42ac-b9d7-5acb5742e475 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:10 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-e2ba9d82-28ed-42ac-b9d7-5acb5742e475 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:10 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-e2ba9d82-28ed-42ac-b9d7-5acb5742e475 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:20:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e2ba9d82-28ed-42ac-b9d7-5acb5742e475 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-32fbf648-a661-41f7-beda-a585102708ad 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:10 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-32fbf648-a661-41f7-beda-a585102708ad 1073741824 Sep 28 17:20:10 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:10 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b7841c12-1e9c-4e91-8e89-28a454c7a11a tempest-VolumesListTestJSON-1032792281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-44d71d71-3c90-425d-a071-f55da7d1e4c5" returned: 0 in 0.579s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b7841c12-1e9c-4e91-8e89-28a454c7a11a tempest-VolumesListTestJSON-1032792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-44d71d71-3c90-425d-a071-f55da7d1e4c5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:10 devstack sudo[98505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-44d71d71-3c90-425d-a071-f55da7d1e4c5 Sep 28 17:20:10 devstack sudo[98505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:11 devstack sudo[98505]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b7841c12-1e9c-4e91-8e89-28a454c7a11a tempest-VolumesListTestJSON-1032792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-44d71d71-3c90-425d-a071-f55da7d1e4c5" returned: 0 in 0.387s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:11 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b7841c12-1e9c-4e91-8e89-28a454c7a11a tempest-VolumesListTestJSON-1032792281 None] Lock "cinder-quobyte-44d71d71-3c90-425d-a071-f55da7d1e4c5" released by "delete_volume" :: held 1.047s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:11 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-b7841c12-1e9c-4e91-8e89-28a454c7a11a tempest-VolumesListTestJSON-1032792281 None] Created reservations ['20155e87-1e18-490f-8c49-18c2d647c421', 'cd772008-e7e0-4fc6-8ecc-50c98c4b5a3c', '27df3396-51c2-4bd9-a310-913cc4918f8f', '9084e2a1-3d99-425d-823b-e68f72e66f0d'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:11 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e2ba9d82-28ed-42ac-b9d7-5acb5742e475 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-32fbf648-a661-41f7-beda-a585102708ad 1073741824" returned: 0 in 0.771s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e2ba9d82-28ed-42ac-b9d7-5acb5742e475 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-32fbf648-a661-41f7-beda-a585102708ad {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b7841c12-1e9c-4e91-8e89-28a454c7a11a tempest-VolumesListTestJSON-1032792281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b7841c12-1e9c-4e91-8e89-28a454c7a11a tempest-VolumesListTestJSON-1032792281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b7841c12-1e9c-4e91-8e89-28a454c7a11a tempest-VolumesListTestJSON-1032792281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b7841c12-1e9c-4e91-8e89-28a454c7a11a tempest-VolumesListTestJSON-1032792281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b7841c12-1e9c-4e91-8e89-28a454c7a11a tempest-VolumesListTestJSON-1032792281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b7841c12-1e9c-4e91-8e89-28a454c7a11a tempest-VolumesListTestJSON-1032792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:11 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-32fbf648-a661-41f7-beda-a585102708ad Sep 28 17:20:11 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:11 devstack sudo[98513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:20:11 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:11 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d1eb3608-2e3c-44b9-9dfa-55b2ccc99f9b tempest-VolumesListTestJSON-1032792281 None] Acquiring lock "cinder-aaf25449-36d6-4152-9a3c-d6fcb6dd9d97-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:12 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d1eb3608-2e3c-44b9-9dfa-55b2ccc99f9b tempest-VolumesListTestJSON-1032792281 None] Lock "cinder-aaf25449-36d6-4152-9a3c-d6fcb6dd9d97-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:12 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d1eb3608-2e3c-44b9-9dfa-55b2ccc99f9b tempest-VolumesListTestJSON-1032792281 None] Acquiring lock "cinder-quobyte-aaf25449-36d6-4152-9a3c-d6fcb6dd9d97" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:12 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d1eb3608-2e3c-44b9-9dfa-55b2ccc99f9b tempest-VolumesListTestJSON-1032792281 None] Lock "cinder-quobyte-aaf25449-36d6-4152-9a3c-d6fcb6dd9d97" acquired by "delete_volume" :: waited 0.037s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:12 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38dec12-53d2-4152-84ec-58f870330f87]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d1eb3608-2e3c-44b9-9dfa-55b2ccc99f9b tempest-VolumesListTestJSON-1032792281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aaf25449-36d6-4152-9a3c-d6fcb6dd9d97 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:12 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e2ba9d82-28ed-42ac-b9d7-5acb5742e475 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-32fbf648-a661-41f7-beda-a585102708ad" returned: 0 in 0.485s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:12 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-e2ba9d82-28ed-42ac-b9d7-5acb5742e475 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e2ba9d82-28ed-42ac-b9d7-5acb5742e475 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-e2ba9d82-28ed-42ac-b9d7-5acb5742e475 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca94e14-c83b-4910-81c6-099de4bd41a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32fbf648-a661-41f7-beda-a585102708ad', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-e2ba9d82-28ed-42ac-b9d7-5acb5742e475 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a99241db-bc56-4f60-85e8-8154b637bd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:12 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-e2ba9d82-28ed-42ac-b9d7-5acb5742e475 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Volume volume-32fbf648-a661-41f7-beda-a585102708ad (32fbf648-a661-41f7-beda-a585102708ad): created successfully Sep 28 17:20:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-e2ba9d82-28ed-42ac-b9d7-5acb5742e475 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a99241db-bc56-4f60-85e8-8154b637bd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-e2ba9d82-28ed-42ac-b9d7-5acb5742e475 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Flow 'volume_create_manager' (aef7aaa1-e39f-4a72-a532-218b72c4bfef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:12 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b7841c12-1e9c-4e91-8e89-28a454c7a11a tempest-VolumesListTestJSON-1032792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.581s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:12 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-b7841c12-1e9c-4e91-8e89-28a454c7a11a tempest-VolumesListTestJSON-1032792281 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:12 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-b7841c12-1e9c-4e91-8e89-28a454c7a11a tempest-VolumesListTestJSON-1032792281 None] Deleted volume successfully. Sep 28 17:20:12 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-e2ba9d82-28ed-42ac-b9d7-5acb5742e475 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Created volume successfully. Sep 28 17:20:12 devstack sudo[98517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aaf25449-36d6-4152-9a3c-d6fcb6dd9d97 Sep 28 17:20:12 devstack sudo[98517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:12 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b7841c12-1e9c-4e91-8e89-28a454c7a11a tempest-VolumesListTestJSON-1032792281 None] Lock "cinder-44d71d71-3c90-425d-a071-f55da7d1e4c5-delete_volume" released by "delete_volume" :: held 2.204s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:12 devstack sudo[98517]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d1eb3608-2e3c-44b9-9dfa-55b2ccc99f9b tempest-VolumesListTestJSON-1032792281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aaf25449-36d6-4152-9a3c-d6fcb6dd9d97" returned: 0 in 0.602s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d1eb3608-2e3c-44b9-9dfa-55b2ccc99f9b tempest-VolumesListTestJSON-1032792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aaf25449-36d6-4152-9a3c-d6fcb6dd9d97 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:12 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aaf25449-36d6-4152-9a3c-d6fcb6dd9d97 Sep 28 17:20:12 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:13 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d1eb3608-2e3c-44b9-9dfa-55b2ccc99f9b tempest-VolumesListTestJSON-1032792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-aaf25449-36d6-4152-9a3c-d6fcb6dd9d97" returned: 0 in 0.542s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:13 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d1eb3608-2e3c-44b9-9dfa-55b2ccc99f9b tempest-VolumesListTestJSON-1032792281 None] Lock "cinder-quobyte-aaf25449-36d6-4152-9a3c-d6fcb6dd9d97" released by "delete_volume" :: held 1.229s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:13 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-d1eb3608-2e3c-44b9-9dfa-55b2ccc99f9b tempest-VolumesListTestJSON-1032792281 None] Created reservations ['87b8ef87-9f50-49af-9fce-2ee5cf87730a', '70a97940-11a3-47f8-ade4-595476161efa', '29112176-c0f4-4034-9ab0-b81c97f01f0f', '1ce87057-2fb5-4a20-b18e-8c2426631fb0'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d1eb3608-2e3c-44b9-9dfa-55b2ccc99f9b tempest-VolumesListTestJSON-1032792281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d1eb3608-2e3c-44b9-9dfa-55b2ccc99f9b tempest-VolumesListTestJSON-1032792281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:13 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb3608-2e3c-44b9-9dfa-55b2ccc99f9b tempest-VolumesListTestJSON-1032792281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:13 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb3608-2e3c-44b9-9dfa-55b2ccc99f9b tempest-VolumesListTestJSON-1032792281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d1eb3608-2e3c-44b9-9dfa-55b2ccc99f9b tempest-VolumesListTestJSON-1032792281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d1eb3608-2e3c-44b9-9dfa-55b2ccc99f9b tempest-VolumesListTestJSON-1032792281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:13 devstack sudo[98544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:20:13 devstack sudo[98544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:13 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-a32ec293-1b91-42f2-9e6e-e4fa09abcc96 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:13 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a32ec293-1b91-42f2-9e6e-e4fa09abcc96 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Flow 'volume_create_manager' (56e14744-0621-4cdb-9e91-1bab6f6f1eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:13 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a32ec293-1b91-42f2-9e6e-e4fa09abcc96 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eef5b0f-d60b-4da2-8f5c-26498ff2a594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a32ec293-1b91-42f2-9e6e-e4fa09abcc96 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eef5b0f-d60b-4da2-8f5c-26498ff2a594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1010764005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90cbb5f0-160f-417e-89ea-09d34ffbdcea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8af2018212bd4fe8b0b01bb227f83f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:14Z,use_quota=True,user_id='52b8e3bc157f4b01b83a7d665bd007fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a32ec293-1b91-42f2-9e6e-e4fa09abcc96 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05dc9b1f-8d6b-44b1-862f-caeb787bb42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:14 devstack sudo[98544]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a32ec293-1b91-42f2-9e6e-e4fa09abcc96 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05dc9b1f-8d6b-44b1-862f-caeb787bb42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a32ec293-1b91-42f2-9e6e-e4fa09abcc96 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96ad868-e5e0-486c-9692-a0e4ed5a24d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a32ec293-1b91-42f2-9e6e-e4fa09abcc96 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96ad868-e5e0-486c-9692-a0e4ed5a24d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90cbb5f0-160f-417e-89ea-09d34ffbdcea', 'volume_name': 'volume-90cbb5f0-160f-417e-89ea-09d34ffbdcea', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a32ec293-1b91-42f2-9e6e-e4fa09abcc96 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a174ea28-3ce9-4d73-8575-c0e02a7c6d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a32ec293-1b91-42f2-9e6e-e4fa09abcc96 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a174ea28-3ce9-4d73-8575-c0e02a7c6d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a32ec293-1b91-42f2-9e6e-e4fa09abcc96 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5668a654-1fc9-4f72-bafe-4ce429d03bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:14 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-a32ec293-1b91-42f2-9e6e-e4fa09abcc96 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Volume 90cbb5f0-160f-417e-89ea-09d34ffbdcea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90cbb5f0-160f-417e-89ea-09d34ffbdcea', 'volume_size': 1} Sep 28 17:20:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a32ec293-1b91-42f2-9e6e-e4fa09abcc96 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a32ec293-1b91-42f2-9e6e-e4fa09abcc96 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:14 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a32ec293-1b91-42f2-9e6e-e4fa09abcc96 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1010764005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90cbb5f0-160f-417e-89ea-09d34ffbdcea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8af2018212bd4fe8b0b01bb227f83f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:14Z,use_quota=True,user_id='52b8e3bc157f4b01b83a7d665bd007fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:14 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-a32ec293-1b91-42f2-9e6e-e4fa09abcc96 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Creating volume 90cbb5f0-160f-417e-89ea-09d34ffbdcea {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a32ec293-1b91-42f2-9e6e-e4fa09abcc96 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a32ec293-1b91-42f2-9e6e-e4fa09abcc96 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:14 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a32ec293-1b91-42f2-9e6e-e4fa09abcc96 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:14 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a32ec293-1b91-42f2-9e6e-e4fa09abcc96 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a32ec293-1b91-42f2-9e6e-e4fa09abcc96 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:14 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a32ec293-1b91-42f2-9e6e-e4fa09abcc96 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:14 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-a32ec293-1b91-42f2-9e6e-e4fa09abcc96 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:20:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a32ec293-1b91-42f2-9e6e-e4fa09abcc96 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-90cbb5f0-160f-417e-89ea-09d34ffbdcea 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d1eb3608-2e3c-44b9-9dfa-55b2ccc99f9b tempest-VolumesListTestJSON-1032792281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.576s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:14 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-d1eb3608-2e3c-44b9-9dfa-55b2ccc99f9b tempest-VolumesListTestJSON-1032792281 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:14 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-d1eb3608-2e3c-44b9-9dfa-55b2ccc99f9b tempest-VolumesListTestJSON-1032792281 None] Deleted volume successfully. Sep 28 17:20:14 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-90cbb5f0-160f-417e-89ea-09d34ffbdcea 1073741824 Sep 28 17:20:14 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:14 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d1eb3608-2e3c-44b9-9dfa-55b2ccc99f9b tempest-VolumesListTestJSON-1032792281 None] Lock "cinder-aaf25449-36d6-4152-9a3c-d6fcb6dd9d97-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:14 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4235279-12a7-4137-8e91-a2fd78d77cea tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a4235279-12a7-4137-8e91-a2fd78d77cea tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Flow 'volume_create_manager' (4daf1d70-502e-40d7-abac-24ae0d762626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a4235279-12a7-4137-8e91-a2fd78d77cea tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (755022a4-68ac-49d6-8231-e56b622c9cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a4235279-12a7-4137-8e91-a2fd78d77cea tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (755022a4-68ac-49d6-8231-e56b622c9cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-82605721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e673188-0f66-4f77-a82b-d0af07b9f010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8af2018212bd4fe8b0b01bb227f83f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:15Z,use_quota=True,user_id='52b8e3bc157f4b01b83a7d665bd007fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a4235279-12a7-4137-8e91-a2fd78d77cea tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e204af2a-ffcc-43a6-948c-915246f77d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a4235279-12a7-4137-8e91-a2fd78d77cea tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e204af2a-ffcc-43a6-948c-915246f77d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a4235279-12a7-4137-8e91-a2fd78d77cea tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (162e8b28-3828-4a2e-8f76-d0ec2ee626c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a4235279-12a7-4137-8e91-a2fd78d77cea tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (162e8b28-3828-4a2e-8f76-d0ec2ee626c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e673188-0f66-4f77-a82b-d0af07b9f010', 'volume_name': 'volume-5e673188-0f66-4f77-a82b-d0af07b9f010', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a4235279-12a7-4137-8e91-a2fd78d77cea tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07fc64c4-6e68-4c3c-9264-9b5f5a075912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a4235279-12a7-4137-8e91-a2fd78d77cea tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07fc64c4-6e68-4c3c-9264-9b5f5a075912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a4235279-12a7-4137-8e91-a2fd78d77cea tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa09f42-dbf3-4aaf-b300-77052bba4efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:15 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-a4235279-12a7-4137-8e91-a2fd78d77cea tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Volume 5e673188-0f66-4f77-a82b-d0af07b9f010: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e673188-0f66-4f77-a82b-d0af07b9f010', 'volume_size': 1} Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a4235279-12a7-4137-8e91-a2fd78d77cea tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:15 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a32ec293-1b91-42f2-9e6e-e4fa09abcc96 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-90cbb5f0-160f-417e-89ea-09d34ffbdcea 1073741824" returned: 0 in 1.266s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a32ec293-1b91-42f2-9e6e-e4fa09abcc96 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-90cbb5f0-160f-417e-89ea-09d34ffbdcea {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:15 devstack sudo[98568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-90cbb5f0-160f-417e-89ea-09d34ffbdcea Sep 28 17:20:15 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-39af5ae9-e150-4b13-ac23-ddb4e07e1fcc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-39af5ae9-e150-4b13-ac23-ddb4e07e1fcc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Flow 'volume_create_manager' (9ce73878-ad4c-4223-9bc5-5890250cc53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-39af5ae9-e150-4b13-ac23-ddb4e07e1fcc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc8c9d32-b47d-4502-9725-bb701780b6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-39af5ae9-e150-4b13-ac23-ddb4e07e1fcc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc8c9d32-b47d-4502-9725-bb701780b6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1669097731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2e385a7-a9bb-4760-bd63-8d96dc88f049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8af2018212bd4fe8b0b01bb227f83f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:16Z,use_quota=True,user_id='52b8e3bc157f4b01b83a7d665bd007fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-39af5ae9-e150-4b13-ac23-ddb4e07e1fcc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ea0bbb-a2a4-4a02-8839-4886d22607ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-39af5ae9-e150-4b13-ac23-ddb4e07e1fcc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ea0bbb-a2a4-4a02-8839-4886d22607ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-39af5ae9-e150-4b13-ac23-ddb4e07e1fcc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1accf859-63c7-4762-91f2-7655564ce867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-39af5ae9-e150-4b13-ac23-ddb4e07e1fcc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1accf859-63c7-4762-91f2-7655564ce867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2e385a7-a9bb-4760-bd63-8d96dc88f049', 'volume_name': 'volume-b2e385a7-a9bb-4760-bd63-8d96dc88f049', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-39af5ae9-e150-4b13-ac23-ddb4e07e1fcc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaf30231-79f2-46b0-a5e6-48e526b72cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-39af5ae9-e150-4b13-ac23-ddb4e07e1fcc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaf30231-79f2-46b0-a5e6-48e526b72cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-39af5ae9-e150-4b13-ac23-ddb4e07e1fcc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4efa3d9-85a7-4856-9eff-7d4ccf5de5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:15 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-39af5ae9-e150-4b13-ac23-ddb4e07e1fcc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Volume b2e385a7-a9bb-4760-bd63-8d96dc88f049: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2e385a7-a9bb-4760-bd63-8d96dc88f049', 'volume_size': 1} Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-39af5ae9-e150-4b13-ac23-ddb4e07e1fcc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:15 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a32ec293-1b91-42f2-9e6e-e4fa09abcc96 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-90cbb5f0-160f-417e-89ea-09d34ffbdcea" returned: 0 in 0.469s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a32ec293-1b91-42f2-9e6e-e4fa09abcc96 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] <== create_volume: return (1803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a32ec293-1b91-42f2-9e6e-e4fa09abcc96 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.807s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a4235279-12a7-4137-8e91-a2fd78d77cea tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.729s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a4235279-12a7-4137-8e91-a2fd78d77cea tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-82605721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e673188-0f66-4f77-a82b-d0af07b9f010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8af2018212bd4fe8b0b01bb227f83f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:15Z,use_quota=True,user_id='52b8e3bc157f4b01b83a7d665bd007fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-a4235279-12a7-4137-8e91-a2fd78d77cea tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Creating volume 5e673188-0f66-4f77-a82b-d0af07b9f010 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a4235279-12a7-4137-8e91-a2fd78d77cea tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a4235279-12a7-4137-8e91-a2fd78d77cea tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a4235279-12a7-4137-8e91-a2fd78d77cea tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a4235279-12a7-4137-8e91-a2fd78d77cea tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a4235279-12a7-4137-8e91-a2fd78d77cea tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a4235279-12a7-4137-8e91-a2fd78d77cea tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:15 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-a4235279-12a7-4137-8e91-a2fd78d77cea tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:20:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a4235279-12a7-4137-8e91-a2fd78d77cea tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5e673188-0f66-4f77-a82b-d0af07b9f010 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:16 devstack sudo[98571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5e673188-0f66-4f77-a82b-d0af07b9f010 1073741824 Sep 28 17:20:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a32ec293-1b91-42f2-9e6e-e4fa09abcc96 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5668a654-1fc9-4f72-bafe-4ce429d03bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90cbb5f0-160f-417e-89ea-09d34ffbdcea', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:16 devstack sudo[98571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a32ec293-1b91-42f2-9e6e-e4fa09abcc96 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c68ece0e-38ca-4eba-a360-1f0f66be1fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:16 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-a32ec293-1b91-42f2-9e6e-e4fa09abcc96 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Volume volume-90cbb5f0-160f-417e-89ea-09d34ffbdcea (90cbb5f0-160f-417e-89ea-09d34ffbdcea): created successfully Sep 28 17:20:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a32ec293-1b91-42f2-9e6e-e4fa09abcc96 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c68ece0e-38ca-4eba-a360-1f0f66be1fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a32ec293-1b91-42f2-9e6e-e4fa09abcc96 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Flow 'volume_create_manager' (56e14744-0621-4cdb-9e91-1bab6f6f1eeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:16 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-a32ec293-1b91-42f2-9e6e-e4fa09abcc96 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Created volume successfully. Sep 28 17:20:16 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfc7d38c-eefa-4976-a4fe-91de2fe10c77 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cfc7d38c-eefa-4976-a4fe-91de2fe10c77 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Flow 'volume_create_manager' (193ea939-098c-4bb4-9233-92a92d53460e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cfc7d38c-eefa-4976-a4fe-91de2fe10c77 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d78462-dc9a-4156-8e31-4c8f277426e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cfc7d38c-eefa-4976-a4fe-91de2fe10c77 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d78462-dc9a-4156-8e31-4c8f277426e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1891560713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b1bb478-2040-40b7-94d8-630d51c237ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8af2018212bd4fe8b0b01bb227f83f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:17Z,use_quota=True,user_id='52b8e3bc157f4b01b83a7d665bd007fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cfc7d38c-eefa-4976-a4fe-91de2fe10c77 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e31ce998-306a-4419-9ff8-16763c4e5140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cfc7d38c-eefa-4976-a4fe-91de2fe10c77 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e31ce998-306a-4419-9ff8-16763c4e5140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cfc7d38c-eefa-4976-a4fe-91de2fe10c77 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (078637ea-c1fe-4307-838d-de8561f170b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cfc7d38c-eefa-4976-a4fe-91de2fe10c77 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (078637ea-c1fe-4307-838d-de8561f170b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b1bb478-2040-40b7-94d8-630d51c237ec', 'volume_name': 'volume-4b1bb478-2040-40b7-94d8-630d51c237ec', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cfc7d38c-eefa-4976-a4fe-91de2fe10c77 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc07296-a04b-4148-a7b4-b73227ab9fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:16 devstack sudo[98571]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cfc7d38c-eefa-4976-a4fe-91de2fe10c77 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc07296-a04b-4148-a7b4-b73227ab9fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cfc7d38c-eefa-4976-a4fe-91de2fe10c77 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03c46f6-2608-4c89-8cc0-9e69bf7078e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:16 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-cfc7d38c-eefa-4976-a4fe-91de2fe10c77 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Volume 4b1bb478-2040-40b7-94d8-630d51c237ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b1bb478-2040-40b7-94d8-630d51c237ec', 'volume_size': 1} Sep 28 17:20:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-cfc7d38c-eefa-4976-a4fe-91de2fe10c77 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a4235279-12a7-4137-8e91-a2fd78d77cea tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5e673188-0f66-4f77-a82b-d0af07b9f010 1073741824" returned: 0 in 0.972s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a4235279-12a7-4137-8e91-a2fd78d77cea tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5e673188-0f66-4f77-a82b-d0af07b9f010 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:17 devstack sudo[98577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5e673188-0f66-4f77-a82b-d0af07b9f010 Sep 28 17:20:17 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:17 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a4235279-12a7-4137-8e91-a2fd78d77cea tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5e673188-0f66-4f77-a82b-d0af07b9f010" returned: 0 in 0.547s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:17 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a4235279-12a7-4137-8e91-a2fd78d77cea tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a4235279-12a7-4137-8e91-a2fd78d77cea tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-39af5ae9-e150-4b13-ac23-ddb4e07e1fcc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.676s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:17 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-39af5ae9-e150-4b13-ac23-ddb4e07e1fcc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1669097731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2e385a7-a9bb-4760-bd63-8d96dc88f049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8af2018212bd4fe8b0b01bb227f83f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:16Z,use_quota=True,user_id='52b8e3bc157f4b01b83a7d665bd007fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:17 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-39af5ae9-e150-4b13-ac23-ddb4e07e1fcc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Creating volume b2e385a7-a9bb-4760-bd63-8d96dc88f049 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-39af5ae9-e150-4b13-ac23-ddb4e07e1fcc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-39af5ae9-e150-4b13-ac23-ddb4e07e1fcc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:17 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-39af5ae9-e150-4b13-ac23-ddb4e07e1fcc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:17 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-39af5ae9-e150-4b13-ac23-ddb4e07e1fcc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-39af5ae9-e150-4b13-ac23-ddb4e07e1fcc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:17 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-39af5ae9-e150-4b13-ac23-ddb4e07e1fcc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:17 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-39af5ae9-e150-4b13-ac23-ddb4e07e1fcc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:20:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-39af5ae9-e150-4b13-ac23-ddb4e07e1fcc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b2e385a7-a9bb-4760-bd63-8d96dc88f049 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a4235279-12a7-4137-8e91-a2fd78d77cea tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa09f42-dbf3-4aaf-b300-77052bba4efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e673188-0f66-4f77-a82b-d0af07b9f010', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:17 devstack sudo[98581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b2e385a7-a9bb-4760-bd63-8d96dc88f049 1073741824 Sep 28 17:20:17 devstack sudo[98581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a4235279-12a7-4137-8e91-a2fd78d77cea tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e4014f-c2a7-43f0-bc26-d87bdd261989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:17 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-a4235279-12a7-4137-8e91-a2fd78d77cea tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Volume volume-5e673188-0f66-4f77-a82b-d0af07b9f010 (5e673188-0f66-4f77-a82b-d0af07b9f010): created successfully Sep 28 17:20:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a4235279-12a7-4137-8e91-a2fd78d77cea tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e4014f-c2a7-43f0-bc26-d87bdd261989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a4235279-12a7-4137-8e91-a2fd78d77cea tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Flow 'volume_create_manager' (4daf1d70-502e-40d7-abac-24ae0d762626) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:17 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-03676821-2f78-4d6a-9f18-09761fdebb4a tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-03676821-2f78-4d6a-9f18-09761fdebb4a tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Flow 'volume_create_manager' (ecb4a279-8d3c-4cf6-b0fe-da10afbfbe74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-03676821-2f78-4d6a-9f18-09761fdebb4a tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3b30dd7-ed02-4308-a5d8-e4e894f28d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:17 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-a4235279-12a7-4137-8e91-a2fd78d77cea tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Created volume successfully. Sep 28 17:20:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-03676821-2f78-4d6a-9f18-09761fdebb4a tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3b30dd7-ed02-4308-a5d8-e4e894f28d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1894842381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf6f14e-1645-43d3-bf58-edb3a8c3dc27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8af2018212bd4fe8b0b01bb227f83f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:17Z,use_quota=True,user_id='52b8e3bc157f4b01b83a7d665bd007fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-03676821-2f78-4d6a-9f18-09761fdebb4a tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cddae7a1-cacd-494d-aed4-253fdd366e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-03676821-2f78-4d6a-9f18-09761fdebb4a tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cddae7a1-cacd-494d-aed4-253fdd366e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-03676821-2f78-4d6a-9f18-09761fdebb4a tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca9a0ecd-e609-4377-8893-d7e9cf8ccb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-03676821-2f78-4d6a-9f18-09761fdebb4a tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca9a0ecd-e609-4377-8893-d7e9cf8ccb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bf6f14e-1645-43d3-bf58-edb3a8c3dc27', 'volume_name': 'volume-2bf6f14e-1645-43d3-bf58-edb3a8c3dc27', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-03676821-2f78-4d6a-9f18-09761fdebb4a tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c36474-8534-4b95-a1d4-9d15d9fc504a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-03676821-2f78-4d6a-9f18-09761fdebb4a tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c36474-8534-4b95-a1d4-9d15d9fc504a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-03676821-2f78-4d6a-9f18-09761fdebb4a tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b79499-4874-467a-857f-1ddfe4c91512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:17 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-03676821-2f78-4d6a-9f18-09761fdebb4a tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Volume 2bf6f14e-1645-43d3-bf58-edb3a8c3dc27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bf6f14e-1645-43d3-bf58-edb3a8c3dc27', 'volume_size': 1} Sep 28 17:20:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-03676821-2f78-4d6a-9f18-09761fdebb4a tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:18 devstack sudo[98581]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-39af5ae9-e150-4b13-ac23-ddb4e07e1fcc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b2e385a7-a9bb-4760-bd63-8d96dc88f049 1073741824" returned: 0 in 0.873s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-39af5ae9-e150-4b13-ac23-ddb4e07e1fcc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b2e385a7-a9bb-4760-bd63-8d96dc88f049 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:18 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b2e385a7-a9bb-4760-bd63-8d96dc88f049 Sep 28 17:20:18 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:19 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-39af5ae9-e150-4b13-ac23-ddb4e07e1fcc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b2e385a7-a9bb-4760-bd63-8d96dc88f049" returned: 0 in 0.684s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-39af5ae9-e150-4b13-ac23-ddb4e07e1fcc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-39af5ae9-e150-4b13-ac23-ddb4e07e1fcc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-cfc7d38c-eefa-4976-a4fe-91de2fe10c77 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.336s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-cfc7d38c-eefa-4976-a4fe-91de2fe10c77 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1891560713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b1bb478-2040-40b7-94d8-630d51c237ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8af2018212bd4fe8b0b01bb227f83f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:17Z,use_quota=True,user_id='52b8e3bc157f4b01b83a7d665bd007fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-cfc7d38c-eefa-4976-a4fe-91de2fe10c77 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Creating volume 4b1bb478-2040-40b7-94d8-630d51c237ec {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-cfc7d38c-eefa-4976-a4fe-91de2fe10c77 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-cfc7d38c-eefa-4976-a4fe-91de2fe10c77 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-cfc7d38c-eefa-4976-a4fe-91de2fe10c77 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-cfc7d38c-eefa-4976-a4fe-91de2fe10c77 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-cfc7d38c-eefa-4976-a4fe-91de2fe10c77 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-cfc7d38c-eefa-4976-a4fe-91de2fe10c77 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:19 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-cfc7d38c-eefa-4976-a4fe-91de2fe10c77 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:20:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-cfc7d38c-eefa-4976-a4fe-91de2fe10c77 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4b1bb478-2040-40b7-94d8-630d51c237ec 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-39af5ae9-e150-4b13-ac23-ddb4e07e1fcc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4efa3d9-85a7-4856-9eff-7d4ccf5de5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2e385a7-a9bb-4760-bd63-8d96dc88f049', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:19 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4b1bb478-2040-40b7-94d8-630d51c237ec 1073741824 Sep 28 17:20:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-39af5ae9-e150-4b13-ac23-ddb4e07e1fcc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (349d4e40-3d1b-4950-9f66-81c8259e761c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:19 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:19 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-39af5ae9-e150-4b13-ac23-ddb4e07e1fcc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Volume volume-b2e385a7-a9bb-4760-bd63-8d96dc88f049 (b2e385a7-a9bb-4760-bd63-8d96dc88f049): created successfully Sep 28 17:20:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-39af5ae9-e150-4b13-ac23-ddb4e07e1fcc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (349d4e40-3d1b-4950-9f66-81c8259e761c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-39af5ae9-e150-4b13-ac23-ddb4e07e1fcc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Flow 'volume_create_manager' (9ce73878-ad4c-4223-9bc5-5890250cc53f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:19 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-39af5ae9-e150-4b13-ac23-ddb4e07e1fcc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Created volume successfully. Sep 28 17:20:20 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-cfc7d38c-eefa-4976-a4fe-91de2fe10c77 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4b1bb478-2040-40b7-94d8-630d51c237ec 1073741824" returned: 0 in 1.476s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-cfc7d38c-eefa-4976-a4fe-91de2fe10c77 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4b1bb478-2040-40b7-94d8-630d51c237ec {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:20 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4b1bb478-2040-40b7-94d8-630d51c237ec Sep 28 17:20:20 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:21 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-cfc7d38c-eefa-4976-a4fe-91de2fe10c77 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4b1bb478-2040-40b7-94d8-630d51c237ec" returned: 0 in 0.681s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:21 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-cfc7d38c-eefa-4976-a4fe-91de2fe10c77 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] <== create_volume: return (2244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-cfc7d38c-eefa-4976-a4fe-91de2fe10c77 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.252s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-03676821-2f78-4d6a-9f18-09761fdebb4a tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.722s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:21 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-03676821-2f78-4d6a-9f18-09761fdebb4a tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1894842381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf6f14e-1645-43d3-bf58-edb3a8c3dc27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8af2018212bd4fe8b0b01bb227f83f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:17Z,use_quota=True,user_id='52b8e3bc157f4b01b83a7d665bd007fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:21 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-03676821-2f78-4d6a-9f18-09761fdebb4a tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Creating volume 2bf6f14e-1645-43d3-bf58-edb3a8c3dc27 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-03676821-2f78-4d6a-9f18-09761fdebb4a tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-03676821-2f78-4d6a-9f18-09761fdebb4a tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:21 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-03676821-2f78-4d6a-9f18-09761fdebb4a tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:21 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-03676821-2f78-4d6a-9f18-09761fdebb4a tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-03676821-2f78-4d6a-9f18-09761fdebb4a tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:21 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-03676821-2f78-4d6a-9f18-09761fdebb4a tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:21 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-03676821-2f78-4d6a-9f18-09761fdebb4a tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:20:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-03676821-2f78-4d6a-9f18-09761fdebb4a tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2bf6f14e-1645-43d3-bf58-edb3a8c3dc27 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:21 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2bf6f14e-1645-43d3-bf58-edb3a8c3dc27 1073741824 Sep 28 17:20:21 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cfc7d38c-eefa-4976-a4fe-91de2fe10c77 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03c46f6-2608-4c89-8cc0-9e69bf7078e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b1bb478-2040-40b7-94d8-630d51c237ec', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cfc7d38c-eefa-4976-a4fe-91de2fe10c77 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61bc12c4-1f71-4e2d-b9e9-f4db1e6e21c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:21 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-cfc7d38c-eefa-4976-a4fe-91de2fe10c77 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Volume volume-4b1bb478-2040-40b7-94d8-630d51c237ec (4b1bb478-2040-40b7-94d8-630d51c237ec): created successfully Sep 28 17:20:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cfc7d38c-eefa-4976-a4fe-91de2fe10c77 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61bc12c4-1f71-4e2d-b9e9-f4db1e6e21c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cfc7d38c-eefa-4976-a4fe-91de2fe10c77 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Flow 'volume_create_manager' (193ea939-098c-4bb4-9233-92a92d53460e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:21 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-cfc7d38c-eefa-4976-a4fe-91de2fe10c77 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Created volume successfully. Sep 28 17:20:22 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-03676821-2f78-4d6a-9f18-09761fdebb4a tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2bf6f14e-1645-43d3-bf58-edb3a8c3dc27 1073741824" returned: 0 in 0.957s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-03676821-2f78-4d6a-9f18-09761fdebb4a tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2bf6f14e-1645-43d3-bf58-edb3a8c3dc27 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:22 devstack sudo[98728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2bf6f14e-1645-43d3-bf58-edb3a8c3dc27 Sep 28 17:20:22 devstack sudo[98728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:23 devstack sudo[98728]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-03676821-2f78-4d6a-9f18-09761fdebb4a tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2bf6f14e-1645-43d3-bf58-edb3a8c3dc27" returned: 0 in 0.615s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:23 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-03676821-2f78-4d6a-9f18-09761fdebb4a tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-03676821-2f78-4d6a-9f18-09761fdebb4a tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-03676821-2f78-4d6a-9f18-09761fdebb4a tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b79499-4874-467a-857f-1ddfe4c91512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bf6f14e-1645-43d3-bf58-edb3a8c3dc27', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-03676821-2f78-4d6a-9f18-09761fdebb4a tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8568a6a5-cf5c-46e4-8266-feebe77d6e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:23 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-03676821-2f78-4d6a-9f18-09761fdebb4a tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Volume volume-2bf6f14e-1645-43d3-bf58-edb3a8c3dc27 (2bf6f14e-1645-43d3-bf58-edb3a8c3dc27): created successfully Sep 28 17:20:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-03676821-2f78-4d6a-9f18-09761fdebb4a tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8568a6a5-cf5c-46e4-8266-feebe77d6e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-03676821-2f78-4d6a-9f18-09761fdebb4a tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Flow 'volume_create_manager' (ecb4a279-8d3c-4cf6-b0fe-da10afbfbe74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:23 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-03676821-2f78-4d6a-9f18-09761fdebb4a tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Created volume successfully. Sep 28 17:20:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-83bfd201-b28a-4367-87d2-71aabb42a2f1 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Acquiring lock "cinder-2bf6f14e-1645-43d3-bf58-edb3a8c3dc27-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-83bfd201-b28a-4367-87d2-71aabb42a2f1 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "cinder-2bf6f14e-1645-43d3-bf58-edb3a8c3dc27-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-83bfd201-b28a-4367-87d2-71aabb42a2f1 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Acquiring lock "cinder-quobyte-2bf6f14e-1645-43d3-bf58-edb3a8c3dc27" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-83bfd201-b28a-4367-87d2-71aabb42a2f1 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "cinder-quobyte-2bf6f14e-1645-43d3-bf58-edb3a8c3dc27" acquired by "delete_volume" :: waited 0.046s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:24 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec244d22-94e7-484e-aa0e-79740e1b0ae7]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-83bfd201-b28a-4367-87d2-71aabb42a2f1 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2bf6f14e-1645-43d3-bf58-edb3a8c3dc27 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:24 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2bf6f14e-1645-43d3-bf58-edb3a8c3dc27 Sep 28 17:20:24 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:25 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-83bfd201-b28a-4367-87d2-71aabb42a2f1 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2bf6f14e-1645-43d3-bf58-edb3a8c3dc27" returned: 0 in 0.961s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-83bfd201-b28a-4367-87d2-71aabb42a2f1 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2bf6f14e-1645-43d3-bf58-edb3a8c3dc27 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:25 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2bf6f14e-1645-43d3-bf58-edb3a8c3dc27 Sep 28 17:20:25 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:26 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-83bfd201-b28a-4367-87d2-71aabb42a2f1 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2bf6f14e-1645-43d3-bf58-edb3a8c3dc27" returned: 0 in 0.519s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:26 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-83bfd201-b28a-4367-87d2-71aabb42a2f1 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "cinder-quobyte-2bf6f14e-1645-43d3-bf58-edb3a8c3dc27" released by "delete_volume" :: held 1.629s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:26 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-83bfd201-b28a-4367-87d2-71aabb42a2f1 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Created reservations ['20824e08-010c-44a4-bcbe-70de5f8d8626', '67a16af4-27ea-491f-8c64-76e968590bb1', '39adbf7d-6f88-4cca-9665-9b88009c04ca', 'fa92f066-5f05-4bc4-a2c7-a2aed3c6fa18'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-3fbd668b-ea68-44ea-8a81-5d8b3169a939 req-ffc6c4a1-23c2-49a2-8050-edc9f79a1451 tempest-TestStampPattern-1988873608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-3fbd668b-ea68-44ea-8a81-5d8b3169a939 req-ffc6c4a1-23c2-49a2-8050-edc9f79a1451 tempest-TestStampPattern-1988873608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-3fbd668b-ea68-44ea-8a81-5d8b3169a939 req-ffc6c4a1-23c2-49a2-8050-edc9f79a1451 tempest-TestStampPattern-1988873608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.051s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-83bfd201-b28a-4367-87d2-71aabb42a2f1 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-83bfd201-b28a-4367-87d2-71aabb42a2f1 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:26 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-83bfd201-b28a-4367-87d2-71aabb42a2f1 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:26 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-83bfd201-b28a-4367-87d2-71aabb42a2f1 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-83bfd201-b28a-4367-87d2-71aabb42a2f1 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-83bfd201-b28a-4367-87d2-71aabb42a2f1 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:26 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-3fbd668b-ea68-44ea-8a81-5d8b3169a939 req-ffc6c4a1-23c2-49a2-8050-edc9f79a1451 tempest-TestStampPattern-1988873608 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069', 'name': 'volume-d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0cdea94f-933e-4e94-87e8-12ee6f3d53c5', 'enforce_multipath': True} {{(pid=86917) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:20:26 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:20:26 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:26 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-3fbd668b-ea68-44ea-8a81-5d8b3169a939 req-ffc6c4a1-23c2-49a2-8050-edc9f79a1451 tempest-TestStampPattern-1988873608 None] attachment_update completed successfully. Sep 28 17:20:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a31336d9-3c46-4379-ac5b-312a118c2098 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Acquiring lock "cinder-4b1bb478-2040-40b7-94d8-630d51c237ec-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a31336d9-3c46-4379-ac5b-312a118c2098 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "cinder-4b1bb478-2040-40b7-94d8-630d51c237ec-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a31336d9-3c46-4379-ac5b-312a118c2098 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Acquiring lock "cinder-quobyte-4b1bb478-2040-40b7-94d8-630d51c237ec" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a31336d9-3c46-4379-ac5b-312a118c2098 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "cinder-quobyte-4b1bb478-2040-40b7-94d8-630d51c237ec" acquired by "delete_volume" :: waited 0.029s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:27 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:27 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b701f9-c69c-466d-ba68-e4b3be279542]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a31336d9-3c46-4379-ac5b-312a118c2098 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4b1bb478-2040-40b7-94d8-630d51c237ec {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-83bfd201-b28a-4367-87d2-71aabb42a2f1 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.949s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:27 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-83bfd201-b28a-4367-87d2-71aabb42a2f1 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:27 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-83bfd201-b28a-4367-87d2-71aabb42a2f1 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Deleted volume successfully. Sep 28 17:20:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-83bfd201-b28a-4367-87d2-71aabb42a2f1 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "cinder-2bf6f14e-1645-43d3-bf58-edb3a8c3dc27-delete_volume" released by "delete_volume" :: held 3.237s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:27 devstack sudo[98834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4b1bb478-2040-40b7-94d8-630d51c237ec Sep 28 17:20:27 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:28 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a31336d9-3c46-4379-ac5b-312a118c2098 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4b1bb478-2040-40b7-94d8-630d51c237ec" returned: 0 in 0.773s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a31336d9-3c46-4379-ac5b-312a118c2098 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4b1bb478-2040-40b7-94d8-630d51c237ec {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:28 devstack sudo[99184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4b1bb478-2040-40b7-94d8-630d51c237ec Sep 28 17:20:28 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:28 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a31336d9-3c46-4379-ac5b-312a118c2098 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4b1bb478-2040-40b7-94d8-630d51c237ec" returned: 0 in 0.564s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:28 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a31336d9-3c46-4379-ac5b-312a118c2098 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "cinder-quobyte-4b1bb478-2040-40b7-94d8-630d51c237ec" released by "delete_volume" :: held 1.472s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:28 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-a31336d9-3c46-4379-ac5b-312a118c2098 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Created reservations ['42764a2b-36a6-4f07-85b3-11eeab2f9be5', '810fd14a-c1dc-4517-b36a-c33677276e2b', '7519a974-583f-4529-ae0b-f541c13c61af', 'f6592b88-ce51-4a60-b517-e1b464612097'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a31336d9-3c46-4379-ac5b-312a118c2098 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a31336d9-3c46-4379-ac5b-312a118c2098 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a31336d9-3c46-4379-ac5b-312a118c2098 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a31336d9-3c46-4379-ac5b-312a118c2098 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a31336d9-3c46-4379-ac5b-312a118c2098 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a31336d9-3c46-4379-ac5b-312a118c2098 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:29 devstack sudo[99188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:20:29 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:29 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a31336d9-3c46-4379-ac5b-312a118c2098 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.488s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:29 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-a31336d9-3c46-4379-ac5b-312a118c2098 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:29 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-a31336d9-3c46-4379-ac5b-312a118c2098 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Deleted volume successfully. Sep 28 17:20:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a31336d9-3c46-4379-ac5b-312a118c2098 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "cinder-4b1bb478-2040-40b7-94d8-630d51c237ec-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-567fbb61-7618-43ea-9544-caef2b8889ab tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Acquiring lock "cinder-b2e385a7-a9bb-4760-bd63-8d96dc88f049-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-567fbb61-7618-43ea-9544-caef2b8889ab tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "cinder-b2e385a7-a9bb-4760-bd63-8d96dc88f049-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-567fbb61-7618-43ea-9544-caef2b8889ab tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Acquiring lock "cinder-quobyte-b2e385a7-a9bb-4760-bd63-8d96dc88f049" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-567fbb61-7618-43ea-9544-caef2b8889ab tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "cinder-quobyte-b2e385a7-a9bb-4760-bd63-8d96dc88f049" acquired by "delete_volume" :: waited 0.021s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:29 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[093b5e37-662e-4a88-a28c-9f2345688db3]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-567fbb61-7618-43ea-9544-caef2b8889ab tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b2e385a7-a9bb-4760-bd63-8d96dc88f049 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:30 devstack sudo[99203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b2e385a7-a9bb-4760-bd63-8d96dc88f049 Sep 28 17:20:30 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:30 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-567fbb61-7618-43ea-9544-caef2b8889ab tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b2e385a7-a9bb-4760-bd63-8d96dc88f049" returned: 0 in 0.573s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-567fbb61-7618-43ea-9544-caef2b8889ab tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b2e385a7-a9bb-4760-bd63-8d96dc88f049 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:30 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b2e385a7-a9bb-4760-bd63-8d96dc88f049 Sep 28 17:20:30 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:30 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-567fbb61-7618-43ea-9544-caef2b8889ab tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b2e385a7-a9bb-4760-bd63-8d96dc88f049" returned: 0 in 0.407s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-567fbb61-7618-43ea-9544-caef2b8889ab tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "cinder-quobyte-b2e385a7-a9bb-4760-bd63-8d96dc88f049" released by "delete_volume" :: held 1.062s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:31 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-567fbb61-7618-43ea-9544-caef2b8889ab tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Created reservations ['a26c1250-5f50-4742-9222-927ab640c30b', 'e4a1ab1a-866c-4150-902c-bfee9d7bf34e', '348451af-f221-4add-99b6-df3a12ae3d6b', '4558222a-0752-4ebf-aea1-b59bcb044180'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-567fbb61-7618-43ea-9544-caef2b8889ab tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-567fbb61-7618-43ea-9544-caef2b8889ab tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-567fbb61-7618-43ea-9544-caef2b8889ab tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-567fbb61-7618-43ea-9544-caef2b8889ab tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-567fbb61-7618-43ea-9544-caef2b8889ab tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-567fbb61-7618-43ea-9544-caef2b8889ab tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:31 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:20:31 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:31 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-567fbb61-7618-43ea-9544-caef2b8889ab tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.439s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:31 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-567fbb61-7618-43ea-9544-caef2b8889ab tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:31 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-567fbb61-7618-43ea-9544-caef2b8889ab tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Deleted volume successfully. Sep 28 17:20:31 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-efd0211d-b580-4b27-997c-13d31928cb86 req-0c2b3be3-d23a-4aec-b389-e2d3b2c9faf3 tempest-TestStampPattern-1988873608 None] Terminate volume connection completed successfully. Sep 28 17:20:31 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-efd0211d-b580-4b27-997c-13d31928cb86 req-0c2b3be3-d23a-4aec-b389-e2d3b2c9faf3 tempest-TestStampPattern-1988873608 None] Deleting attachment 0cdea94f-933e-4e94-87e8-12ee6f3d53c5. {{(pid=86917) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:20:31 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-567fbb61-7618-43ea-9544-caef2b8889ab tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "cinder-b2e385a7-a9bb-4760-bd63-8d96dc88f049-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a1f93800-3224-4122-9cf9-43e5a67d4ebc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Acquiring lock "cinder-5e673188-0f66-4f77-a82b-d0af07b9f010-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a1f93800-3224-4122-9cf9-43e5a67d4ebc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "cinder-5e673188-0f66-4f77-a82b-d0af07b9f010-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:32 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:UPDATE=105,cinder:SELECT=58,cinder:DELETE=6,cinder:INSERT=24 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:20:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a1f93800-3224-4122-9cf9-43e5a67d4ebc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Acquiring lock "cinder-quobyte-5e673188-0f66-4f77-a82b-d0af07b9f010" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a1f93800-3224-4122-9cf9-43e5a67d4ebc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "cinder-quobyte-5e673188-0f66-4f77-a82b-d0af07b9f010" acquired by "delete_volume" :: waited 0.053s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:32 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d70e86a-e988-4b79-b9f2-96f2d99e0878]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a1f93800-3224-4122-9cf9-43e5a67d4ebc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5e673188-0f66-4f77-a82b-d0af07b9f010 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:32 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5e673188-0f66-4f77-a82b-d0af07b9f010 Sep 28 17:20:32 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:33 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a1f93800-3224-4122-9cf9-43e5a67d4ebc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5e673188-0f66-4f77-a82b-d0af07b9f010" returned: 0 in 0.671s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a1f93800-3224-4122-9cf9-43e5a67d4ebc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5e673188-0f66-4f77-a82b-d0af07b9f010 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:33 devstack sudo[99263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5e673188-0f66-4f77-a82b-d0af07b9f010 Sep 28 17:20:33 devstack sudo[99263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:33 devstack sudo[99263]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a1f93800-3224-4122-9cf9-43e5a67d4ebc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5e673188-0f66-4f77-a82b-d0af07b9f010" returned: 0 in 0.415s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:33 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a1f93800-3224-4122-9cf9-43e5a67d4ebc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "cinder-quobyte-5e673188-0f66-4f77-a82b-d0af07b9f010" released by "delete_volume" :: held 1.181s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:33 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-a1f93800-3224-4122-9cf9-43e5a67d4ebc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Created reservations ['084ad760-bf53-4520-aa1c-c9bac3af76f6', '44721584-4fdd-4799-b397-b46dd7f82a8e', '2257e950-6a61-40a1-9d79-5b2443b6cbf4', 'd48d7c66-fd77-405b-95d8-4bb6492d4831'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a1f93800-3224-4122-9cf9-43e5a67d4ebc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a1f93800-3224-4122-9cf9-43e5a67d4ebc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:34 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a1f93800-3224-4122-9cf9-43e5a67d4ebc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:34 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a1f93800-3224-4122-9cf9-43e5a67d4ebc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a1f93800-3224-4122-9cf9-43e5a67d4ebc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a1f93800-3224-4122-9cf9-43e5a67d4ebc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:34 devstack sudo[99266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:20:34 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:35 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a1f93800-3224-4122-9cf9-43e5a67d4ebc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.930s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:35 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-a1f93800-3224-4122-9cf9-43e5a67d4ebc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:35 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-a1f93800-3224-4122-9cf9-43e5a67d4ebc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Deleted volume successfully. Sep 28 17:20:35 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d9ce2e64-40a9-4366-a67e-37dfbbe9c699 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Acquiring lock "cinder-90cbb5f0-160f-417e-89ea-09d34ffbdcea-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:35 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d9ce2e64-40a9-4366-a67e-37dfbbe9c699 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "cinder-90cbb5f0-160f-417e-89ea-09d34ffbdcea-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:35 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a1f93800-3224-4122-9cf9-43e5a67d4ebc tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "cinder-5e673188-0f66-4f77-a82b-d0af07b9f010-delete_volume" released by "delete_volume" :: held 2.693s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:35 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=84,cinder:INSERT=21,cinder:UPDATE=98,cinder:DELETE=13 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:20:35 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d9ce2e64-40a9-4366-a67e-37dfbbe9c699 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Acquiring lock "cinder-quobyte-90cbb5f0-160f-417e-89ea-09d34ffbdcea" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:35 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d9ce2e64-40a9-4366-a67e-37dfbbe9c699 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "cinder-quobyte-90cbb5f0-160f-417e-89ea-09d34ffbdcea" acquired by "delete_volume" :: waited 0.096s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:35 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3a1ecb-ca0a-44d4-818e-e2c73aecb79c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d9ce2e64-40a9-4366-a67e-37dfbbe9c699 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-90cbb5f0-160f-417e-89ea-09d34ffbdcea {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:35 devstack sudo[99274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-90cbb5f0-160f-417e-89ea-09d34ffbdcea Sep 28 17:20:35 devstack sudo[99274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:36 devstack sudo[99274]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d9ce2e64-40a9-4366-a67e-37dfbbe9c699 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-90cbb5f0-160f-417e-89ea-09d34ffbdcea" returned: 0 in 0.999s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d9ce2e64-40a9-4366-a67e-37dfbbe9c699 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-90cbb5f0-160f-417e-89ea-09d34ffbdcea {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:36 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-90cbb5f0-160f-417e-89ea-09d34ffbdcea Sep 28 17:20:36 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:36 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d9ce2e64-40a9-4366-a67e-37dfbbe9c699 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-90cbb5f0-160f-417e-89ea-09d34ffbdcea" returned: 0 in 0.535s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:37 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d9ce2e64-40a9-4366-a67e-37dfbbe9c699 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "cinder-quobyte-90cbb5f0-160f-417e-89ea-09d34ffbdcea" released by "delete_volume" :: held 1.635s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:37 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-d9ce2e64-40a9-4366-a67e-37dfbbe9c699 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Created reservations ['4fc4708c-c6fd-4007-af86-6451c9edc21f', '67c851db-8905-417d-bfa3-fd721864a7c6', '58420938-6bda-41c9-8f40-f0707a17882c', '3bb1b0b1-bbfb-43d3-8d47-f88a50e7689b'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d9ce2e64-40a9-4366-a67e-37dfbbe9c699 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d9ce2e64-40a9-4366-a67e-37dfbbe9c699 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:37 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d9ce2e64-40a9-4366-a67e-37dfbbe9c699 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:37 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d9ce2e64-40a9-4366-a67e-37dfbbe9c699 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d9ce2e64-40a9-4366-a67e-37dfbbe9c699 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d9ce2e64-40a9-4366-a67e-37dfbbe9c699 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:37 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:20:37 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:37 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d9ce2e64-40a9-4366-a67e-37dfbbe9c699 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.322s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:37 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-d9ce2e64-40a9-4366-a67e-37dfbbe9c699 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:37 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-d9ce2e64-40a9-4366-a67e-37dfbbe9c699 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Deleted volume successfully. Sep 28 17:20:37 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d9ce2e64-40a9-4366-a67e-37dfbbe9c699 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "cinder-90cbb5f0-160f-417e-89ea-09d34ffbdcea-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:37 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c7f1dec1-5765-43f6-9c49-00b59b14b857 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Acquiring lock "cinder-32fbf648-a661-41f7-beda-a585102708ad-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:37 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c7f1dec1-5765-43f6-9c49-00b59b14b857 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "cinder-32fbf648-a661-41f7-beda-a585102708ad-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:37 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c7f1dec1-5765-43f6-9c49-00b59b14b857 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Acquiring lock "cinder-quobyte-32fbf648-a661-41f7-beda-a585102708ad" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:37 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c7f1dec1-5765-43f6-9c49-00b59b14b857 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "cinder-quobyte-32fbf648-a661-41f7-beda-a585102708ad" acquired by "delete_volume" :: waited 0.032s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:37 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee0f3c0-313a-4481-a236-ebfc45d46449]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7f1dec1-5765-43f6-9c49-00b59b14b857 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-32fbf648-a661-41f7-beda-a585102708ad {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:38 devstack sudo[99333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-32fbf648-a661-41f7-beda-a585102708ad Sep 28 17:20:38 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:38 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7f1dec1-5765-43f6-9c49-00b59b14b857 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-32fbf648-a661-41f7-beda-a585102708ad" returned: 0 in 0.762s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7f1dec1-5765-43f6-9c49-00b59b14b857 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-32fbf648-a661-41f7-beda-a585102708ad {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:38 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-32fbf648-a661-41f7-beda-a585102708ad Sep 28 17:20:38 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:39 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7f1dec1-5765-43f6-9c49-00b59b14b857 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-32fbf648-a661-41f7-beda-a585102708ad" returned: 0 in 0.366s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:39 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c7f1dec1-5765-43f6-9c49-00b59b14b857 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "cinder-quobyte-32fbf648-a661-41f7-beda-a585102708ad" released by "delete_volume" :: held 1.213s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:39 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-c7f1dec1-5765-43f6-9c49-00b59b14b857 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Created reservations ['c4611cd4-22bd-4ce4-b438-34960d215e7a', 'b65c1037-b442-4079-9ffe-eef019e04d31', 'c5d22b4d-d26d-4106-b3a2-aa4d72535fc4', '7b1e8241-3bc9-42c7-8d3d-a5f02e022131'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c7f1dec1-5765-43f6-9c49-00b59b14b857 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c7f1dec1-5765-43f6-9c49-00b59b14b857 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:39 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c7f1dec1-5765-43f6-9c49-00b59b14b857 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:39 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c7f1dec1-5765-43f6-9c49-00b59b14b857 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c7f1dec1-5765-43f6-9c49-00b59b14b857 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7f1dec1-5765-43f6-9c49-00b59b14b857 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:39 devstack sudo[99343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:20:39 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:39 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7f1dec1-5765-43f6-9c49-00b59b14b857 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.353s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:39 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-c7f1dec1-5765-43f6-9c49-00b59b14b857 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:39 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-c7f1dec1-5765-43f6-9c49-00b59b14b857 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Deleted volume successfully. Sep 28 17:20:39 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c7f1dec1-5765-43f6-9c49-00b59b14b857 tempest-CreateVolumesFromSourceVolumeTest-1281967067 None] Lock "cinder-32fbf648-a661-41f7-beda-a585102708ad-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:41 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-25cd7884-e725-4936-b9e4-d628753bfbda tempest-TestStampPattern-1988873608 None] Acquiring lock "cinder-d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:41 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-25cd7884-e725-4936-b9e4-d628753bfbda tempest-TestStampPattern-1988873608 None] Lock "cinder-d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:41 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-25cd7884-e725-4936-b9e4-d628753bfbda tempest-TestStampPattern-1988873608 None] Acquiring lock "cinder-quobyte-d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:41 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-25cd7884-e725-4936-b9e4-d628753bfbda tempest-TestStampPattern-1988873608 None] Lock "cinder-quobyte-d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9" acquired by "delete_volume" :: waited 0.019s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:41 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f914e2f9-b00f-4af7-91dd-127b2d1eccb2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-25cd7884-e725-4936-b9e4-d628753bfbda tempest-TestStampPattern-1988873608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:42 devstack sudo[99349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9 Sep 28 17:20:42 devstack sudo[99349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:42 devstack sudo[99349]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-25cd7884-e725-4936-b9e4-d628753bfbda tempest-TestStampPattern-1988873608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9" returned: 0 in 0.562s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-25cd7884-e725-4936-b9e4-d628753bfbda tempest-TestStampPattern-1988873608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:42 devstack sudo[99354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9 Sep 28 17:20:42 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:42 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a0022d9-5955-4ad8-a14b-3616c9929006 tempest-VolumesSnapshotTestJSON-803354126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:42 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3a0022d9-5955-4ad8-a14b-3616c9929006 tempest-VolumesSnapshotTestJSON-803354126 None] Flow 'volume_create_manager' (3e48998a-4e0c-412e-b7ee-95ec5a1514fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3a0022d9-5955-4ad8-a14b-3616c9929006 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f73f250-0762-4657-af7b-0cea38cc4d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-25cd7884-e725-4936-b9e4-d628753bfbda tempest-TestStampPattern-1988873608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9" returned: 0 in 0.368s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3a0022d9-5955-4ad8-a14b-3616c9929006 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f73f250-0762-4657-af7b-0cea38cc4d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1505194279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc34ab6f-ffce-46b3-ac22-5a65393ac200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daababf0069a4500946ef3bd106e2e19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:43Z,use_quota=True,user_id='3b4641fc2a6e4cf592a96014ad60aeb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3a0022d9-5955-4ad8-a14b-3616c9929006 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d77b2cc-c8bc-4f56-8b2c-90a980acb950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3a0022d9-5955-4ad8-a14b-3616c9929006 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d77b2cc-c8bc-4f56-8b2c-90a980acb950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3a0022d9-5955-4ad8-a14b-3616c9929006 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bd6b96f-1c73-4d84-8499-fbed35ace8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3a0022d9-5955-4ad8-a14b-3616c9929006 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bd6b96f-1c73-4d84-8499-fbed35ace8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc34ab6f-ffce-46b3-ac22-5a65393ac200', 'volume_name': 'volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3a0022d9-5955-4ad8-a14b-3616c9929006 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e83f49-f080-4018-8858-a9565379a165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3a0022d9-5955-4ad8-a14b-3616c9929006 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e83f49-f080-4018-8858-a9565379a165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3a0022d9-5955-4ad8-a14b-3616c9929006 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b16a57ee-43b3-4b75-856a-0a683dc99bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:42 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-3a0022d9-5955-4ad8-a14b-3616c9929006 tempest-VolumesSnapshotTestJSON-803354126 None] Volume dc34ab6f-ffce-46b3-ac22-5a65393ac200: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200', 'volume_size': 1} Sep 28 17:20:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3a0022d9-5955-4ad8-a14b-3616c9929006 tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3a0022d9-5955-4ad8-a14b-3616c9929006 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:42 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-3a0022d9-5955-4ad8-a14b-3616c9929006 tempest-VolumesSnapshotTestJSON-803354126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1505194279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc34ab6f-ffce-46b3-ac22-5a65393ac200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daababf0069a4500946ef3bd106e2e19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:43Z,use_quota=True,user_id='3b4641fc2a6e4cf592a96014ad60aeb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:42 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-3a0022d9-5955-4ad8-a14b-3616c9929006 tempest-VolumesSnapshotTestJSON-803354126 None] Creating volume dc34ab6f-ffce-46b3-ac22-5a65393ac200 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3a0022d9-5955-4ad8-a14b-3616c9929006 tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3a0022d9-5955-4ad8-a14b-3616c9929006 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:42 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-3a0022d9-5955-4ad8-a14b-3616c9929006 tempest-VolumesSnapshotTestJSON-803354126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:42 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-3a0022d9-5955-4ad8-a14b-3616c9929006 tempest-VolumesSnapshotTestJSON-803354126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3a0022d9-5955-4ad8-a14b-3616c9929006 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:42 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-3a0022d9-5955-4ad8-a14b-3616c9929006 tempest-VolumesSnapshotTestJSON-803354126 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:42 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-3a0022d9-5955-4ad8-a14b-3616c9929006 tempest-VolumesSnapshotTestJSON-803354126 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:20:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3a0022d9-5955-4ad8-a14b-3616c9929006 tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:42 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-25cd7884-e725-4936-b9e4-d628753bfbda tempest-TestStampPattern-1988873608 None] Lock "cinder-quobyte-d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9" released by "delete_volume" :: held 1.083s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:43 devstack sudo[99357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200 1073741824 Sep 28 17:20:43 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:43 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-25cd7884-e725-4936-b9e4-d628753bfbda tempest-TestStampPattern-1988873608 None] Created reservations ['58bd180f-44e0-48ff-9371-d18ff319d38d', '3a711414-e5e4-499a-b5ca-fbe9ac0a79f4', '684ac80a-e7a9-49ba-a729-a345e2dd3e13', '3e672301-93fe-4e75-9b39-251c15309104'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-25cd7884-e725-4936-b9e4-d628753bfbda tempest-TestStampPattern-1988873608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-25cd7884-e725-4936-b9e4-d628753bfbda tempest-TestStampPattern-1988873608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:43 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-25cd7884-e725-4936-b9e4-d628753bfbda tempest-TestStampPattern-1988873608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:43 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-25cd7884-e725-4936-b9e4-d628753bfbda tempest-TestStampPattern-1988873608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-25cd7884-e725-4936-b9e4-d628753bfbda tempest-TestStampPattern-1988873608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-25cd7884-e725-4936-b9e4-d628753bfbda tempest-TestStampPattern-1988873608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:43 devstack sudo[99359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:20:43 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:43 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-25cd7884-e725-4936-b9e4-d628753bfbda tempest-TestStampPattern-1988873608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.374s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:43 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-25cd7884-e725-4936-b9e4-d628753bfbda tempest-TestStampPattern-1988873608 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:43 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-25cd7884-e725-4936-b9e4-d628753bfbda tempest-TestStampPattern-1988873608 None] Deleted volume successfully. Sep 28 17:20:43 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:43 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-25cd7884-e725-4936-b9e4-d628753bfbda tempest-TestStampPattern-1988873608 None] Lock "cinder-d18c9aec-8b40-4fbd-b7f1-7df205a6c9c9-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3a0022d9-5955-4ad8-a14b-3616c9929006 tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200 1073741824" returned: 0 in 0.649s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3a0022d9-5955-4ad8-a14b-3616c9929006 tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:43 devstack sudo[99367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200 Sep 28 17:20:43 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:44 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3a0022d9-5955-4ad8-a14b-3616c9929006 tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200" returned: 0 in 0.337s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:44 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-3a0022d9-5955-4ad8-a14b-3616c9929006 tempest-VolumesSnapshotTestJSON-803354126 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3a0022d9-5955-4ad8-a14b-3616c9929006 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3a0022d9-5955-4ad8-a14b-3616c9929006 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b16a57ee-43b3-4b75-856a-0a683dc99bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3a0022d9-5955-4ad8-a14b-3616c9929006 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec10d9f8-91d1-4370-93ec-7cf925e3b9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:44 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-3a0022d9-5955-4ad8-a14b-3616c9929006 tempest-VolumesSnapshotTestJSON-803354126 None] Volume volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200 (dc34ab6f-ffce-46b3-ac22-5a65393ac200): created successfully Sep 28 17:20:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3a0022d9-5955-4ad8-a14b-3616c9929006 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec10d9f8-91d1-4370-93ec-7cf925e3b9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3a0022d9-5955-4ad8-a14b-3616c9929006 tempest-VolumesSnapshotTestJSON-803354126 None] Flow 'volume_create_manager' (3e48998a-4e0c-412e-b7ee-95ec5a1514fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:44 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-3a0022d9-5955-4ad8-a14b-3616c9929006 tempest-VolumesSnapshotTestJSON-803354126 None] Created volume successfully. Sep 28 17:20:44 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-80a196bc-9951-49e5-8dd3-6ec21fce668f tempest-TestStampPattern-1988873608 None] Acquiring lock "cinder-43a61fa6-ea48-407c-81d8-811e6ebe2af0-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:44 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-80a196bc-9951-49e5-8dd3-6ec21fce668f tempest-TestStampPattern-1988873608 None] Lock "cinder-43a61fa6-ea48-407c-81d8-811e6ebe2af0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:44 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-80a196bc-9951-49e5-8dd3-6ec21fce668f tempest-TestStampPattern-1988873608 None] Acquiring lock "cinder-quobyte-3035682a-178b-4675-8d92-5ba3a79dc306" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:44 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-80a196bc-9951-49e5-8dd3-6ec21fce668f tempest-TestStampPattern-1988873608 None] Lock "cinder-quobyte-3035682a-178b-4675-8d92-5ba3a79dc306" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:44 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-80a196bc-9951-49e5-8dd3-6ec21fce668f tempest-TestStampPattern-1988873608 None] Acquiring lock "cinder-quobyte-43a61fa6-ea48-407c-81d8-811e6ebe2af0" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:44 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-80a196bc-9951-49e5-8dd3-6ec21fce668f tempest-TestStampPattern-1988873608 None] Lock "cinder-quobyte-43a61fa6-ea48-407c-81d8-811e6ebe2af0" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:44 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-80a196bc-9951-49e5-8dd3-6ec21fce668f tempest-TestStampPattern-1988873608 None] Deleting offline snapshot 43a61fa6-ea48-407c-81d8-811e6ebe2af0 of volume 3035682a-178b-4675-8d92-5ba3a79dc306 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:20:44 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-80a196bc-9951-49e5-8dd3-6ec21fce668f tempest-TestStampPattern-1988873608 None] snapshot_file for this snap is: volume-3035682a-178b-4675-8d92-5ba3a79dc306.43a61fa6-ea48-407c-81d8-811e6ebe2af0 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:20:44 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[17392371-bb15-404e-bf3b-4533a6f06e79]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-80a196bc-9951-49e5-8dd3-6ec21fce668f tempest-TestStampPattern-1988873608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306.43a61fa6-ea48-407c-81d8-811e6ebe2af0 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:44 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306.43a61fa6-ea48-407c-81d8-811e6ebe2af0 Sep 28 17:20:44 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:45 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2eba46c-77fc-485b-a2c4-a518b7c62536 tempest-VolumeDependencyTests-1461480466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:45 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f2eba46c-77fc-485b-a2c4-a518b7c62536 tempest-VolumeDependencyTests-1461480466 None] Flow 'volume_create_manager' (b981d286-46af-48db-bfae-1d2c228ebc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f2eba46c-77fc-485b-a2c4-a518b7c62536 tempest-VolumeDependencyTests-1461480466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75300fdb-7257-4117-81ea-37b934525f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-80a196bc-9951-49e5-8dd3-6ec21fce668f tempest-TestStampPattern-1988873608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306.43a61fa6-ea48-407c-81d8-811e6ebe2af0" returned: 0 in 0.584s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-80a196bc-9951-49e5-8dd3-6ec21fce668f tempest-TestStampPattern-1988873608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3035682a-178b-4675-8d92-5ba3a79dc306(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:20:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f2eba46c-77fc-485b-a2c4-a518b7c62536 tempest-VolumeDependencyTests-1461480466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75300fdb-7257-4117-81ea-37b934525f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1277839880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d98902c7-c8aa-4353-85e4-0fd813892962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cb5c09764884f37bb410d66fc1a3eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:45Z,use_quota=True,user_id='2d4d082496e4458eaeba2ed011952b28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f2eba46c-77fc-485b-a2c4-a518b7c62536 tempest-VolumeDependencyTests-1461480466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (367067e3-caf1-4b37-9ab5-6fc38cfd5559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f2eba46c-77fc-485b-a2c4-a518b7c62536 tempest-VolumeDependencyTests-1461480466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (367067e3-caf1-4b37-9ab5-6fc38cfd5559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f2eba46c-77fc-485b-a2c4-a518b7c62536 tempest-VolumeDependencyTests-1461480466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc589268-9bde-4471-b038-a61421713752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f2eba46c-77fc-485b-a2c4-a518b7c62536 tempest-VolumeDependencyTests-1461480466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc589268-9bde-4471-b038-a61421713752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd98902c7-c8aa-4353-85e4-0fd813892962', 'volume_name': 'volume-d98902c7-c8aa-4353-85e4-0fd813892962', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f2eba46c-77fc-485b-a2c4-a518b7c62536 tempest-VolumeDependencyTests-1461480466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42dfd8a2-52f5-4088-8d6e-6bc3cdd2170b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f2eba46c-77fc-485b-a2c4-a518b7c62536 tempest-VolumeDependencyTests-1461480466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42dfd8a2-52f5-4088-8d6e-6bc3cdd2170b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f2eba46c-77fc-485b-a2c4-a518b7c62536 tempest-VolumeDependencyTests-1461480466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88406e36-0535-4b0b-8330-188dfeac007c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:45 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-f2eba46c-77fc-485b-a2c4-a518b7c62536 tempest-VolumeDependencyTests-1461480466 None] Volume d98902c7-c8aa-4353-85e4-0fd813892962: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d98902c7-c8aa-4353-85e4-0fd813892962', 'volume_size': 1} Sep 28 17:20:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f2eba46c-77fc-485b-a2c4-a518b7c62536 tempest-VolumeDependencyTests-1461480466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f2eba46c-77fc-485b-a2c4-a518b7c62536 tempest-VolumeDependencyTests-1461480466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f2eba46c-77fc-485b-a2c4-a518b7c62536 tempest-VolumeDependencyTests-1461480466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1277839880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d98902c7-c8aa-4353-85e4-0fd813892962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cb5c09764884f37bb410d66fc1a3eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:45Z,use_quota=True,user_id='2d4d082496e4458eaeba2ed011952b28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-f2eba46c-77fc-485b-a2c4-a518b7c62536 tempest-VolumeDependencyTests-1461480466 None] Creating volume d98902c7-c8aa-4353-85e4-0fd813892962 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f2eba46c-77fc-485b-a2c4-a518b7c62536 tempest-VolumeDependencyTests-1461480466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f2eba46c-77fc-485b-a2c4-a518b7c62536 tempest-VolumeDependencyTests-1461480466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f2eba46c-77fc-485b-a2c4-a518b7c62536 tempest-VolumeDependencyTests-1461480466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f2eba46c-77fc-485b-a2c4-a518b7c62536 tempest-VolumeDependencyTests-1461480466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f2eba46c-77fc-485b-a2c4-a518b7c62536 tempest-VolumeDependencyTests-1461480466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f2eba46c-77fc-485b-a2c4-a518b7c62536 tempest-VolumeDependencyTests-1461480466 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:45 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-f2eba46c-77fc-485b-a2c4-a518b7c62536 tempest-VolumeDependencyTests-1461480466 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:20:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f2eba46c-77fc-485b-a2c4-a518b7c62536 tempest-VolumeDependencyTests-1461480466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:45 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eaf09a8-2821-4629-a7ed-7d0d0a57f249]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-80a196bc-9951-49e5-8dd3-6ec21fce668f tempest-TestStampPattern-1988873608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:45 devstack sudo[99377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962 1073741824 Sep 28 17:20:45 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:45 devstack sudo[99378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306 Sep 28 17:20:45 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c053995e-99a7-43d3-b518-58bca00bec4b tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:46 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f2eba46c-77fc-485b-a2c4-a518b7c62536 tempest-VolumeDependencyTests-1461480466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962 1073741824" returned: 0 in 0.789s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:46 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-80a196bc-9951-49e5-8dd3-6ec21fce668f tempest-TestStampPattern-1988873608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306" returned: 0 in 0.812s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-80a196bc-9951-49e5-8dd3-6ec21fce668f tempest-TestStampPattern-1988873608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306.43a61fa6-ea48-407c-81d8-811e6ebe2af0 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:46 devstack sudo[99388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306.43a61fa6-ea48-407c-81d8-811e6ebe2af0 Sep 28 17:20:46 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f2eba46c-77fc-485b-a2c4-a518b7c62536 tempest-VolumeDependencyTests-1461480466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:46 devstack sudo[99390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962 Sep 28 17:20:46 devstack sudo[99390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:46 devstack sudo[99390]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f2eba46c-77fc-485b-a2c4-a518b7c62536 tempest-VolumeDependencyTests-1461480466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962" returned: 0 in 0.315s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:46 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f2eba46c-77fc-485b-a2c4-a518b7c62536 tempest-VolumeDependencyTests-1461480466 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f2eba46c-77fc-485b-a2c4-a518b7c62536 tempest-VolumeDependencyTests-1461480466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c053995e-99a7-43d3-b518-58bca00bec4b tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.945s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:46 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f2eba46c-77fc-485b-a2c4-a518b7c62536 tempest-VolumeDependencyTests-1461480466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88406e36-0535-4b0b-8330-188dfeac007c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d98902c7-c8aa-4353-85e4-0fd813892962', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f2eba46c-77fc-485b-a2c4-a518b7c62536 tempest-VolumeDependencyTests-1461480466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb6f222-fe88-40ff-bb22-c1277b0c4671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-80a196bc-9951-49e5-8dd3-6ec21fce668f tempest-TestStampPattern-1988873608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306.43a61fa6-ea48-407c-81d8-811e6ebe2af0" returned: 0 in 0.429s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-80a196bc-9951-49e5-8dd3-6ec21fce668f tempest-TestStampPattern-1988873608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306.43a61fa6-ea48-407c-81d8-811e6ebe2af0 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:46 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-c053995e-99a7-43d3-b518-58bca00bec4b tempest-VolumesSnapshotTestJSON-803354126 None] Creating offline snapshot 376a5534-f511-4a31-82ce-a889283526f3 of volume dc34ab6f-ffce-46b3-ac22-5a65393ac200 {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:20:46 devstack sudo[99396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306.43a61fa6-ea48-407c-81d8-811e6ebe2af0 Sep 28 17:20:46 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-f2eba46c-77fc-485b-a2c4-a518b7c62536 tempest-VolumeDependencyTests-1461480466 None] Volume volume-d98902c7-c8aa-4353-85e4-0fd813892962 (d98902c7-c8aa-4353-85e4-0fd813892962): created successfully Sep 28 17:20:46 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f2eba46c-77fc-485b-a2c4-a518b7c62536 tempest-VolumeDependencyTests-1461480466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb6f222-fe88-40ff-bb22-c1277b0c4671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f2eba46c-77fc-485b-a2c4-a518b7c62536 tempest-VolumeDependencyTests-1461480466 None] Flow 'volume_create_manager' (b981d286-46af-48db-bfae-1d2c228ebc99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:46 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0065acdd-3885-4b14-a384-05af3cdb30d6]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c053995e-99a7-43d3-b518-58bca00bec4b tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:46 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-f2eba46c-77fc-485b-a2c4-a518b7c62536 tempest-VolumeDependencyTests-1461480466 None] Created volume successfully. Sep 28 17:20:46 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200 Sep 28 17:20:46 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:47 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-80a196bc-9951-49e5-8dd3-6ec21fce668f tempest-TestStampPattern-1988873608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306.43a61fa6-ea48-407c-81d8-811e6ebe2af0" returned: 0 in 0.336s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:47 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-80a196bc-9951-49e5-8dd3-6ec21fce668f tempest-TestStampPattern-1988873608 None] Lock "cinder-quobyte-43a61fa6-ea48-407c-81d8-811e6ebe2af0" released by "_delete_snapshot" :: held 2.444s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:47 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-80a196bc-9951-49e5-8dd3-6ec21fce668f tempest-TestStampPattern-1988873608 None] Lock "cinder-quobyte-3035682a-178b-4675-8d92-5ba3a79dc306" released by "delete_snapshot" :: held 2.481s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:47 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-80a196bc-9951-49e5-8dd3-6ec21fce668f tempest-TestStampPattern-1988873608 None] Created reservations ['bf1c67ad-2a54-4f29-afd1-8f497677d2f9', 'd3e5196d-acc3-4ab9-98e9-3c78f1a0746e', 'ede7bc12-3e60-437c-8b16-227f5064e150', 'ab9a5538-f422-47b4-93b3-42188c4168f4'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:47 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c053995e-99a7-43d3-b518-58bca00bec4b tempest-VolumesSnapshotTestJSON-803354126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200" returned: 0 in 0.504s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c053995e-99a7-43d3-b518-58bca00bec4b tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200.376a5534-f511-4a31-82ce-a889283526f3 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:47 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-80a196bc-9951-49e5-8dd3-6ec21fce668f tempest-TestStampPattern-1988873608 None] Delete snapshot completed successfully. Sep 28 17:20:47 devstack sudo[99404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200.376a5534-f511-4a31-82ce-a889283526f3 1G Sep 28 17:20:47 devstack sudo[99404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:47 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-80a196bc-9951-49e5-8dd3-6ec21fce668f tempest-TestStampPattern-1988873608 None] Lock "cinder-43a61fa6-ea48-407c-81d8-811e6ebe2af0-delete_snapshot" released by "delete_snapshot" :: held 2.733s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-944b59af-eb2a-49ab-8938-662701c03163 tempest-VolumeDependencyTests-1461480466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:47 devstack sudo[99404]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c053995e-99a7-43d3-b518-58bca00bec4b tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200.376a5534-f511-4a31-82ce-a889283526f3 1G" returned: 0 in 0.703s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c053995e-99a7-43d3-b518-58bca00bec4b tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200.376a5534-f511-4a31-82ce-a889283526f3 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:48 devstack sudo[99410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200.376a5534-f511-4a31-82ce-a889283526f3 Sep 28 17:20:48 devstack sudo[99410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:48 devstack sudo[99410]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c053995e-99a7-43d3-b518-58bca00bec4b tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200.376a5534-f511-4a31-82ce-a889283526f3" returned: 0 in 0.354s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:48 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-c053995e-99a7-43d3-b518-58bca00bec4b tempest-VolumesSnapshotTestJSON-803354126 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200.376a5534-f511-4a31-82ce-a889283526f3 is being set with open permissions: ugo+rw Sep 28 17:20:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c053995e-99a7-43d3-b518-58bca00bec4b tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200.376a5534-f511-4a31-82ce-a889283526f3 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:48 devstack sudo[99415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200.376a5534-f511-4a31-82ce-a889283526f3 Sep 28 17:20:48 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:48 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c053995e-99a7-43d3-b518-58bca00bec4b tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200.376a5534-f511-4a31-82ce-a889283526f3" returned: 0 in 0.391s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c053995e-99a7-43d3-b518-58bca00bec4b tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:48 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200.info Sep 28 17:20:48 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:49 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c053995e-99a7-43d3-b518-58bca00bec4b tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200.info" returned: 0 in 0.354s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:49 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-c053995e-99a7-43d3-b518-58bca00bec4b tempest-VolumesSnapshotTestJSON-803354126 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200.info is being set with open permissions: ugo+rw Sep 28 17:20:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c053995e-99a7-43d3-b518-58bca00bec4b tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:49 devstack sudo[99423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200.info Sep 28 17:20:49 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:20:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:49 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c053995e-99a7-43d3-b518-58bca00bec4b tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200.info" returned: 0 in 0.375s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:49 devstack sudo[99431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:20:49 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c053995e-99a7-43d3-b518-58bca00bec4b tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.917s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-944b59af-eb2a-49ab-8938-662701c03163 tempest-VolumeDependencyTests-1461480466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.880s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-944b59af-eb2a-49ab-8938-662701c03163 tempest-VolumeDependencyTests-1461480466 None] Creating offline snapshot d8570692-4f90-4195-b142-c50f9a49bd0a of volume d98902c7-c8aa-4353-85e4-0fd813892962 {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:20:49 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7640063f-9fee-4545-b56b-5c492c892aa3]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-944b59af-eb2a-49ab-8938-662701c03163 tempest-VolumeDependencyTests-1461480466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:49 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-c053995e-99a7-43d3-b518-58bca00bec4b tempest-VolumesSnapshotTestJSON-803354126 None] Create snapshot completed successfully Sep 28 17:20:49 devstack sudo[99433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962 Sep 28 17:20:49 devstack sudo[99433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:50 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.608s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:50 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:50 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager._thread_info {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:20:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread count: 28 {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:20:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread info: [<_MainThread(MainThread, started 132915553284224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:20:50 devstack sudo[99433]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-944b59af-eb2a-49ab-8938-662701c03163 tempest-VolumeDependencyTests-1461480466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962" returned: 0 in 0.692s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-944b59af-eb2a-49ab-8938-662701c03163 tempest-VolumeDependencyTests-1461480466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962.d8570692-4f90-4195-b142-c50f9a49bd0a 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:50 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fbf6ab39-1add-4dd5-9ab8-e32244a39db0 tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "cinder-376a5534-f511-4a31-82ce-a889283526f3-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:50 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962.d8570692-4f90-4195-b142-c50f9a49bd0a 1G Sep 28 17:20:50 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:50 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fbf6ab39-1add-4dd5-9ab8-e32244a39db0 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-376a5534-f511-4a31-82ce-a889283526f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:50 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fbf6ab39-1add-4dd5-9ab8-e32244a39db0 tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "cinder-quobyte-dc34ab6f-ffce-46b3-ac22-5a65393ac200" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:50 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fbf6ab39-1add-4dd5-9ab8-e32244a39db0 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-quobyte-dc34ab6f-ffce-46b3-ac22-5a65393ac200" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:50 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fbf6ab39-1add-4dd5-9ab8-e32244a39db0 tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "cinder-quobyte-376a5534-f511-4a31-82ce-a889283526f3" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:50 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fbf6ab39-1add-4dd5-9ab8-e32244a39db0 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-quobyte-376a5534-f511-4a31-82ce-a889283526f3" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:50 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-fbf6ab39-1add-4dd5-9ab8-e32244a39db0 tempest-VolumesSnapshotTestJSON-803354126 None] Deleting offline snapshot 376a5534-f511-4a31-82ce-a889283526f3 of volume dc34ab6f-ffce-46b3-ac22-5a65393ac200 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:20:50 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-fbf6ab39-1add-4dd5-9ab8-e32244a39db0 tempest-VolumesSnapshotTestJSON-803354126 None] snapshot_file for this snap is: volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200.376a5534-f511-4a31-82ce-a889283526f3 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:20:50 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9888bab6-9ade-49b2-829d-0df62bcf17e1]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fbf6ab39-1add-4dd5-9ab8-e32244a39db0 tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200.376a5534-f511-4a31-82ce-a889283526f3 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:50 devstack sudo[99463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200.376a5534-f511-4a31-82ce-a889283526f3 Sep 28 17:20:50 devstack sudo[99463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:51 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-944b59af-eb2a-49ab-8938-662701c03163 tempest-VolumeDependencyTests-1461480466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962.d8570692-4f90-4195-b142-c50f9a49bd0a 1G" returned: 0 in 0.927s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-944b59af-eb2a-49ab-8938-662701c03163 tempest-VolumeDependencyTests-1461480466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d98902c7-c8aa-4353-85e4-0fd813892962 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962.d8570692-4f90-4195-b142-c50f9a49bd0a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:51 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d98902c7-c8aa-4353-85e4-0fd813892962 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962.d8570692-4f90-4195-b142-c50f9a49bd0a Sep 28 17:20:51 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:51 devstack sudo[99463]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fbf6ab39-1add-4dd5-9ab8-e32244a39db0 tempest-VolumesSnapshotTestJSON-803354126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200.376a5534-f511-4a31-82ce-a889283526f3" returned: 0 in 0.788s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:51 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-fbf6ab39-1add-4dd5-9ab8-e32244a39db0 tempest-VolumesSnapshotTestJSON-803354126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:20:51 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffd48df-9e1a-4892-9a88-d65c644cfd6f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fbf6ab39-1add-4dd5-9ab8-e32244a39db0 tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:51 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-31f60e8e-c020-4a92-ab40-aef43297cf95 tempest-AttachVolumeNegativeTest-158509557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-31f60e8e-c020-4a92-ab40-aef43297cf95 tempest-AttachVolumeNegativeTest-158509557 None] Flow 'volume_create_manager' (683faa64-5cc5-46ee-b778-540e15361ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-31f60e8e-c020-4a92-ab40-aef43297cf95 tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d950cf-851f-46a9-93fd-ed502b01aa27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-31f60e8e-c020-4a92-ab40-aef43297cf95 tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d950cf-851f-46a9-93fd-ed502b01aa27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-550211360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b31a6b5f-e9f6-4952-81df-f5ce9837504e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e41dab614240d2b055b96b240d7125',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:51Z,use_quota=True,user_id='f95bafa9537c4a559275623e6bb50109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-31f60e8e-c020-4a92-ab40-aef43297cf95 tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3feb5c7-5a89-4e63-b39e-7061b944dcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-31f60e8e-c020-4a92-ab40-aef43297cf95 tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3feb5c7-5a89-4e63-b39e-7061b944dcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-31f60e8e-c020-4a92-ab40-aef43297cf95 tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a67f6c3-c55e-4341-9e58-4057e7924401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-31f60e8e-c020-4a92-ab40-aef43297cf95 tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a67f6c3-c55e-4341-9e58-4057e7924401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b31a6b5f-e9f6-4952-81df-f5ce9837504e', 'volume_name': 'volume-b31a6b5f-e9f6-4952-81df-f5ce9837504e', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-31f60e8e-c020-4a92-ab40-aef43297cf95 tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70666758-5e84-41e7-99c2-17c90988f78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-31f60e8e-c020-4a92-ab40-aef43297cf95 tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70666758-5e84-41e7-99c2-17c90988f78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-31f60e8e-c020-4a92-ab40-aef43297cf95 tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e8419a-78da-4464-a89a-2f24e82d0e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:51 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-31f60e8e-c020-4a92-ab40-aef43297cf95 tempest-AttachVolumeNegativeTest-158509557 None] Volume b31a6b5f-e9f6-4952-81df-f5ce9837504e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b31a6b5f-e9f6-4952-81df-f5ce9837504e', 'volume_size': 1} Sep 28 17:20:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-31f60e8e-c020-4a92-ab40-aef43297cf95 tempest-AttachVolumeNegativeTest-158509557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:51 devstack sudo[99474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200 Sep 28 17:20:51 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:51 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-944b59af-eb2a-49ab-8938-662701c03163 tempest-VolumeDependencyTests-1461480466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d98902c7-c8aa-4353-85e4-0fd813892962 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962.d8570692-4f90-4195-b142-c50f9a49bd0a" returned: 0 in 0.455s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:51 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-944b59af-eb2a-49ab-8938-662701c03163 tempest-VolumeDependencyTests-1461480466 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962.d8570692-4f90-4195-b142-c50f9a49bd0a is being set with open permissions: ugo+rw Sep 28 17:20:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-944b59af-eb2a-49ab-8938-662701c03163 tempest-VolumeDependencyTests-1461480466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962.d8570692-4f90-4195-b142-c50f9a49bd0a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:51 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962.d8570692-4f90-4195-b142-c50f9a49bd0a Sep 28 17:20:51 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:52 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fbf6ab39-1add-4dd5-9ab8-e32244a39db0 tempest-VolumesSnapshotTestJSON-803354126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200" returned: 0 in 0.601s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fbf6ab39-1add-4dd5-9ab8-e32244a39db0 tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200.376a5534-f511-4a31-82ce-a889283526f3 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:52 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-944b59af-eb2a-49ab-8938-662701c03163 tempest-VolumeDependencyTests-1461480466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962.d8570692-4f90-4195-b142-c50f9a49bd0a" returned: 0 in 0.339s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:52 devstack sudo[99489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200.376a5534-f511-4a31-82ce-a889283526f3 Sep 28 17:20:52 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-944b59af-eb2a-49ab-8938-662701c03163 tempest-VolumeDependencyTests-1461480466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:52 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962.info Sep 28 17:20:52 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:52 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-944b59af-eb2a-49ab-8938-662701c03163 tempest-VolumeDependencyTests-1461480466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962.info" returned: 0 in 0.433s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:52 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-944b59af-eb2a-49ab-8938-662701c03163 tempest-VolumeDependencyTests-1461480466 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962.info is being set with open permissions: ugo+rw Sep 28 17:20:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-944b59af-eb2a-49ab-8938-662701c03163 tempest-VolumeDependencyTests-1461480466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:52 devstack sudo[99498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962.info Sep 28 17:20:52 devstack sudo[99498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:52 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fbf6ab39-1add-4dd5-9ab8-e32244a39db0 tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200.376a5534-f511-4a31-82ce-a889283526f3" returned: 0 in 0.576s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fbf6ab39-1add-4dd5-9ab8-e32244a39db0 tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200.376a5534-f511-4a31-82ce-a889283526f3 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:52 devstack sudo[99500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200.376a5534-f511-4a31-82ce-a889283526f3 Sep 28 17:20:52 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:52 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fbf6ab39-1add-4dd5-9ab8-e32244a39db0 tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200.376a5534-f511-4a31-82ce-a889283526f3" returned: 0 in 0.260s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:52 devstack sudo[99498]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-944b59af-eb2a-49ab-8938-662701c03163 tempest-VolumeDependencyTests-1461480466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962.info" returned: 0 in 0.378s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-944b59af-eb2a-49ab-8938-662701c03163 tempest-VolumeDependencyTests-1461480466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.371s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:52 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fbf6ab39-1add-4dd5-9ab8-e32244a39db0 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-quobyte-376a5534-f511-4a31-82ce-a889283526f3" released by "_delete_snapshot" :: held 2.421s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-31f60e8e-c020-4a92-ab40-aef43297cf95 tempest-AttachVolumeNegativeTest-158509557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.338s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-31f60e8e-c020-4a92-ab40-aef43297cf95 tempest-AttachVolumeNegativeTest-158509557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-550211360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b31a6b5f-e9f6-4952-81df-f5ce9837504e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e41dab614240d2b055b96b240d7125',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:51Z,use_quota=True,user_id='f95bafa9537c4a559275623e6bb50109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-31f60e8e-c020-4a92-ab40-aef43297cf95 tempest-AttachVolumeNegativeTest-158509557 None] Creating volume b31a6b5f-e9f6-4952-81df-f5ce9837504e {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-31f60e8e-c020-4a92-ab40-aef43297cf95 tempest-AttachVolumeNegativeTest-158509557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-31f60e8e-c020-4a92-ab40-aef43297cf95 tempest-AttachVolumeNegativeTest-158509557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-31f60e8e-c020-4a92-ab40-aef43297cf95 tempest-AttachVolumeNegativeTest-158509557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-31f60e8e-c020-4a92-ab40-aef43297cf95 tempest-AttachVolumeNegativeTest-158509557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-31f60e8e-c020-4a92-ab40-aef43297cf95 tempest-AttachVolumeNegativeTest-158509557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-31f60e8e-c020-4a92-ab40-aef43297cf95 tempest-AttachVolumeNegativeTest-158509557 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:52 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-31f60e8e-c020-4a92-ab40-aef43297cf95 tempest-AttachVolumeNegativeTest-158509557 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:20:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-31f60e8e-c020-4a92-ab40-aef43297cf95 tempest-AttachVolumeNegativeTest-158509557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b31a6b5f-e9f6-4952-81df-f5ce9837504e 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:52 devstack sudo[99504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b31a6b5f-e9f6-4952-81df-f5ce9837504e 1073741824 Sep 28 17:20:52 devstack sudo[99504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:52 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fbf6ab39-1add-4dd5-9ab8-e32244a39db0 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-quobyte-dc34ab6f-ffce-46b3-ac22-5a65393ac200" released by "delete_snapshot" :: held 2.497s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:53 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-944b59af-eb2a-49ab-8938-662701c03163 tempest-VolumeDependencyTests-1461480466 None] Create snapshot completed successfully Sep 28 17:20:53 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-fbf6ab39-1add-4dd5-9ab8-e32244a39db0 tempest-VolumesSnapshotTestJSON-803354126 None] Created reservations ['1cca6673-9b29-472b-a3b7-ed4ee8873e03', '67a64582-a1c1-428b-9fbe-b580fd21be2a', '0758376a-68b7-4558-b047-cbe2c77014cb', 'c945de6d-53a2-4129-bc96-20ac8c0feec0'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:53 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-fbf6ab39-1add-4dd5-9ab8-e32244a39db0 tempest-VolumesSnapshotTestJSON-803354126 None] Delete snapshot completed successfully. Sep 28 17:20:53 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fbf6ab39-1add-4dd5-9ab8-e32244a39db0 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-376a5534-f511-4a31-82ce-a889283526f3-delete_snapshot" released by "delete_snapshot" :: held 2.784s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:53 devstack sudo[99504]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:53 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b2696e0e-6b58-4b06-b512-f0e2f7265a72 tempest-TestStampPattern-1988873608 None] Acquiring lock "cinder-3035682a-178b-4675-8d92-5ba3a79dc306-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-31f60e8e-c020-4a92-ab40-aef43297cf95 tempest-AttachVolumeNegativeTest-158509557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b31a6b5f-e9f6-4952-81df-f5ce9837504e 1073741824" returned: 0 in 0.558s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:53 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b2696e0e-6b58-4b06-b512-f0e2f7265a72 tempest-TestStampPattern-1988873608 None] Lock "cinder-3035682a-178b-4675-8d92-5ba3a79dc306-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-31f60e8e-c020-4a92-ab40-aef43297cf95 tempest-AttachVolumeNegativeTest-158509557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b31a6b5f-e9f6-4952-81df-f5ce9837504e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:53 devstack sudo[99510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b31a6b5f-e9f6-4952-81df-f5ce9837504e Sep 28 17:20:53 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:53 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b2696e0e-6b58-4b06-b512-f0e2f7265a72 tempest-TestStampPattern-1988873608 None] Acquiring lock "cinder-quobyte-3035682a-178b-4675-8d92-5ba3a79dc306" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:53 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b2696e0e-6b58-4b06-b512-f0e2f7265a72 tempest-TestStampPattern-1988873608 None] Lock "cinder-quobyte-3035682a-178b-4675-8d92-5ba3a79dc306" acquired by "delete_volume" :: waited 0.026s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:53 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7260289a-3a1c-4a95-8009-30a0205d36ff]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b2696e0e-6b58-4b06-b512-f0e2f7265a72 tempest-TestStampPattern-1988873608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:53 devstack sudo[99512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306 Sep 28 17:20:53 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:53 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-31f60e8e-c020-4a92-ab40-aef43297cf95 tempest-AttachVolumeNegativeTest-158509557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b31a6b5f-e9f6-4952-81df-f5ce9837504e" returned: 0 in 0.304s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:53 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-31f60e8e-c020-4a92-ab40-aef43297cf95 tempest-AttachVolumeNegativeTest-158509557 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-31f60e8e-c020-4a92-ab40-aef43297cf95 tempest-AttachVolumeNegativeTest-158509557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-31f60e8e-c020-4a92-ab40-aef43297cf95 tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e8419a-78da-4464-a89a-2f24e82d0e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b31a6b5f-e9f6-4952-81df-f5ce9837504e', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-31f60e8e-c020-4a92-ab40-aef43297cf95 tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac8d3d35-435b-4156-ae6a-131a7429e0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:53 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-31f60e8e-c020-4a92-ab40-aef43297cf95 tempest-AttachVolumeNegativeTest-158509557 None] Volume volume-b31a6b5f-e9f6-4952-81df-f5ce9837504e (b31a6b5f-e9f6-4952-81df-f5ce9837504e): created successfully Sep 28 17:20:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-31f60e8e-c020-4a92-ab40-aef43297cf95 tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac8d3d35-435b-4156-ae6a-131a7429e0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-31f60e8e-c020-4a92-ab40-aef43297cf95 tempest-AttachVolumeNegativeTest-158509557 None] Flow 'volume_create_manager' (683faa64-5cc5-46ee-b778-540e15361ad6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:53 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-31f60e8e-c020-4a92-ab40-aef43297cf95 tempest-AttachVolumeNegativeTest-158509557 None] Created volume successfully. Sep 28 17:20:54 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b2696e0e-6b58-4b06-b512-f0e2f7265a72 tempest-TestStampPattern-1988873608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306" returned: 0 in 0.499s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b2696e0e-6b58-4b06-b512-f0e2f7265a72 tempest-TestStampPattern-1988873608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:54 devstack sudo[99518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306 Sep 28 17:20:54 devstack sudo[99518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:54 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-cefde3a0-8445-486c-b4d8-130a1c311b8a tempest-VolumesSnapshotTestJSON-803354126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:54 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cefde3a0-8445-486c-b4d8-130a1c311b8a tempest-VolumesSnapshotTestJSON-803354126 None] Flow 'volume_create_manager' (c0065db5-23ad-4627-8509-0259531af085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:54 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cefde3a0-8445-486c-b4d8-130a1c311b8a tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30bf25a5-dbe3-46b5-88ab-213f36c20c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:54 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cefde3a0-8445-486c-b4d8-130a1c311b8a tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30bf25a5-dbe3-46b5-88ab-213f36c20c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-180373300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb79ba0c-05f0-4e73-ae80-bced458d4385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daababf0069a4500946ef3bd106e2e19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:54Z,use_quota=True,user_id='3b4641fc2a6e4cf592a96014ad60aeb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:54 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cefde3a0-8445-486c-b4d8-130a1c311b8a tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e0fe51f-b528-4d24-a087-d4058f4fb211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:54 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cefde3a0-8445-486c-b4d8-130a1c311b8a tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e0fe51f-b528-4d24-a087-d4058f4fb211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:54 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cefde3a0-8445-486c-b4d8-130a1c311b8a tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c77916-578d-4418-b603-54b091cc1f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:54 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cefde3a0-8445-486c-b4d8-130a1c311b8a tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c77916-578d-4418-b603-54b091cc1f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb79ba0c-05f0-4e73-ae80-bced458d4385', 'volume_name': 'volume-fb79ba0c-05f0-4e73-ae80-bced458d4385', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:54 devstack sudo[99518]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:54 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cefde3a0-8445-486c-b4d8-130a1c311b8a tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (183babbf-41f9-4872-907c-7ab7f0666e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:54 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cefde3a0-8445-486c-b4d8-130a1c311b8a tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (183babbf-41f9-4872-907c-7ab7f0666e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:54 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cefde3a0-8445-486c-b4d8-130a1c311b8a tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d33eef-22ed-4d9e-a6cb-c9f5eea4ae98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:54 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-cefde3a0-8445-486c-b4d8-130a1c311b8a tempest-VolumesSnapshotTestJSON-803354126 None] Volume fb79ba0c-05f0-4e73-ae80-bced458d4385: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb79ba0c-05f0-4e73-ae80-bced458d4385', 'volume_size': 1} Sep 28 17:20:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-cefde3a0-8445-486c-b4d8-130a1c311b8a tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-cefde3a0-8445-486c-b4d8-130a1c311b8a tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:54 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-cefde3a0-8445-486c-b4d8-130a1c311b8a tempest-VolumesSnapshotTestJSON-803354126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-180373300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb79ba0c-05f0-4e73-ae80-bced458d4385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daababf0069a4500946ef3bd106e2e19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:54Z,use_quota=True,user_id='3b4641fc2a6e4cf592a96014ad60aeb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:54 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-cefde3a0-8445-486c-b4d8-130a1c311b8a tempest-VolumesSnapshotTestJSON-803354126 None] Creating volume fb79ba0c-05f0-4e73-ae80-bced458d4385 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-cefde3a0-8445-486c-b4d8-130a1c311b8a tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-cefde3a0-8445-486c-b4d8-130a1c311b8a tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:54 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-cefde3a0-8445-486c-b4d8-130a1c311b8a tempest-VolumesSnapshotTestJSON-803354126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:54 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-cefde3a0-8445-486c-b4d8-130a1c311b8a tempest-VolumesSnapshotTestJSON-803354126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-cefde3a0-8445-486c-b4d8-130a1c311b8a tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:54 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-cefde3a0-8445-486c-b4d8-130a1c311b8a tempest-VolumesSnapshotTestJSON-803354126 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:54 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-cefde3a0-8445-486c-b4d8-130a1c311b8a tempest-VolumesSnapshotTestJSON-803354126 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:20:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-cefde3a0-8445-486c-b4d8-130a1c311b8a tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b2696e0e-6b58-4b06-b512-f0e2f7265a72 tempest-TestStampPattern-1988873608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3035682a-178b-4675-8d92-5ba3a79dc306" returned: 0 in 0.520s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:54 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385 1073741824 Sep 28 17:20:54 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:54 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b2696e0e-6b58-4b06-b512-f0e2f7265a72 tempest-TestStampPattern-1988873608 None] Lock "cinder-quobyte-3035682a-178b-4675-8d92-5ba3a79dc306" released by "delete_volume" :: held 1.135s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:54 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-b2696e0e-6b58-4b06-b512-f0e2f7265a72 tempest-TestStampPattern-1988873608 None] Created reservations ['49cc064c-8140-41d0-8989-df75b2c577c7', '0ca76a8d-4115-4b72-bb4c-a1b04a3a7e73', '965544b1-2a76-430a-80cd-ab7d65ae619f', '7bd6fc4e-742c-42b6-b7a6-e9495e2fa60c'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b2696e0e-6b58-4b06-b512-f0e2f7265a72 tempest-TestStampPattern-1988873608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b2696e0e-6b58-4b06-b512-f0e2f7265a72 tempest-TestStampPattern-1988873608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:55 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b2696e0e-6b58-4b06-b512-f0e2f7265a72 tempest-TestStampPattern-1988873608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:55 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b2696e0e-6b58-4b06-b512-f0e2f7265a72 tempest-TestStampPattern-1988873608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b2696e0e-6b58-4b06-b512-f0e2f7265a72 tempest-TestStampPattern-1988873608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b2696e0e-6b58-4b06-b512-f0e2f7265a72 tempest-TestStampPattern-1988873608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:55 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:55 devstack sudo[99526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:20:55 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Flow 'volume_create_manager' (14b5b65a-d759-4aaa-bcb8-88b1a568ad2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f753a02-5210-45f7-bb06-6c9ac6b61f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f753a02-5210-45f7-bb06-6c9ac6b61f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-519922371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d11f84a9-ca95-48f2-a667-a30031e52361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cb5c09764884f37bb410d66fc1a3eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d8570692-4f90-4195-b142-c50f9a49bd0a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:55Z,use_quota=True,user_id='2d4d082496e4458eaeba2ed011952b28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8adfe27-4196-4555-b82a-6fc00b07f603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8adfe27-4196-4555-b82a-6fc00b07f603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (864b151f-1bf9-4f32-a848-bb2c737e9412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (864b151f-1bf9-4f32-a848-bb2c737e9412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd11f84a9-ca95-48f2-a667-a30031e52361', 'volume_name': 'volume-d11f84a9-ca95-48f2-a667-a30031e52361', 'volume_size': 1, 'snapshot_id': 'd8570692-4f90-4195-b142-c50f9a49bd0a'}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2808ef1-327a-4077-bdc2-62e3efb5be34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2808ef1-327a-4077-bdc2-62e3efb5be34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62344b01-fb18-41df-b147-c78c8c004e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:55 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Volume d11f84a9-ca95-48f2-a667-a30031e52361: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d11f84a9-ca95-48f2-a667-a30031e52361', 'volume_size': 1, 'snapshot_id': 'd8570692-4f90-4195-b142-c50f9a49bd0a'} Sep 28 17:20:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:55 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b2696e0e-6b58-4b06-b512-f0e2f7265a72 tempest-TestStampPattern-1988873608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.483s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:55 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-b2696e0e-6b58-4b06-b512-f0e2f7265a72 tempest-TestStampPattern-1988873608 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:55 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-b2696e0e-6b58-4b06-b512-f0e2f7265a72 tempest-TestStampPattern-1988873608 None] Deleted volume successfully. Sep 28 17:20:55 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-cefde3a0-8445-486c-b4d8-130a1c311b8a tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385 1073741824" returned: 0 in 0.814s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:55 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b2696e0e-6b58-4b06-b512-f0e2f7265a72 tempest-TestStampPattern-1988873608 None] Lock "cinder-3035682a-178b-4675-8d92-5ba3a79dc306-delete_volume" released by "delete_volume" :: held 2.010s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-cefde3a0-8445-486c-b4d8-130a1c311b8a tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:55 devstack sudo[99534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385 Sep 28 17:20:55 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-f381db96-5387-4d9b-b6eb-37b7d8f44e66 req-5c7821bf-4690-49e7-95c4-d352a274e5c1 tempest-AttachVolumeNegativeTest-158509557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:55 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-cefde3a0-8445-486c-b4d8-130a1c311b8a tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385" returned: 0 in 0.332s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:55 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-cefde3a0-8445-486c-b4d8-130a1c311b8a tempest-VolumesSnapshotTestJSON-803354126 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-cefde3a0-8445-486c-b4d8-130a1c311b8a tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.660s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:55 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Acquiring lock "cinder-quobyte-d8570692-4f90-4195-b142-c50f9a49bd0a-d11f84a9-ca95-48f2-a667-a30031e52361" by "_create_volume_from_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cefde3a0-8445-486c-b4d8-130a1c311b8a tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d33eef-22ed-4d9e-a6cb-c9f5eea4ae98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb79ba0c-05f0-4e73-ae80-bced458d4385', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cefde3a0-8445-486c-b4d8-130a1c311b8a tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ee0185-088a-4d29-a9bd-3f8fcabcffe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:55 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Lock "cinder-quobyte-d8570692-4f90-4195-b142-c50f9a49bd0a-d11f84a9-ca95-48f2-a667-a30031e52361" acquired by "_create_volume_from_snapshot" :: waited 0.054s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:55 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Creating volume d11f84a9-ca95-48f2-a667-a30031e52361 from snapshot d8570692-4f90-4195-b142-c50f9a49bd0a {{(pid=86917) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:20:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:56 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:56 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:56 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:56 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Acquiring lock "cinder-quobyte-d11f84a9-ca95-48f2-a667-a30031e52361" by "_copy_volume_from_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:56 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-cefde3a0-8445-486c-b4d8-130a1c311b8a tempest-VolumesSnapshotTestJSON-803354126 None] Volume volume-fb79ba0c-05f0-4e73-ae80-bced458d4385 (fb79ba0c-05f0-4e73-ae80-bced458d4385): created successfully Sep 28 17:20:56 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cefde3a0-8445-486c-b4d8-130a1c311b8a tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ee0185-088a-4d29-a9bd-3f8fcabcffe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:56 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cefde3a0-8445-486c-b4d8-130a1c311b8a tempest-VolumesSnapshotTestJSON-803354126 None] Flow 'volume_create_manager' (c0065db5-23ad-4627-8509-0259531af085) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:56 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Lock "cinder-quobyte-d11f84a9-ca95-48f2-a667-a30031e52361" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:56 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] snapshot: d8570692-4f90-4195-b142-c50f9a49bd0a, volume: d11f84a9-ca95-48f2-a667-a30031e52361, {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:20:56 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-cefde3a0-8445-486c-b4d8-130a1c311b8a tempest-VolumesSnapshotTestJSON-803354126 None] Created volume successfully. Sep 28 17:20:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:56 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:56 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:56 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9f27c1-0085-43ca-b837-3db4c3b22036]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962.d8570692-4f90-4195-b142-c50f9a49bd0a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:56 devstack sudo[99545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962.d8570692-4f90-4195-b142-c50f9a49bd0a Sep 28 17:20:56 devstack sudo[99545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:56 devstack sudo[99545]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962.d8570692-4f90-4195-b142-c50f9a49bd0a" returned: 0 in 0.469s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:56 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d98902c7-c8aa-4353-85e4-0fd813892962(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:20:56 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b2c009-83f7-4079-aed4-a6d20d9a7cb0]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:56 devstack sudo[99550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962 Sep 28 17:20:56 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-acbe6dea-7470-40b4-b319-fdfa0803a995 tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:57 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962" returned: 0 in 0.474s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:57 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962 {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:20:57 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Creating direct copy from snapshot {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:20:57 devstack cinder-volume[86917]: DEBUG cinder.utils [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Path /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d11f84a9-ca95-48f2-a667-a30031e52361 not found in is_blk_device check {{(pid=86917) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:20:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d11f84a9-ca95-48f2-a667-a30031e52361 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:57 devstack sudo[99555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d11f84a9-ca95-48f2-a667-a30031e52361 Sep 28 17:20:57 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:05 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d11f84a9-ca95-48f2-a667-a30031e52361" returned: 0 in 8.202s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:05 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Image conversion details: src /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962, size 1024.00 MB, duration 8.20 sec, destination /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d11f84a9-ca95-48f2-a667-a30031e52361 {{(pid=86917) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:21:05 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Converted 1024.00 MB image at 124.81 MB/s Sep 28 17:21:05 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d11f84a9-ca95-48f2-a667-a30031e52361 is being set with open permissions: ugo+rw Sep 28 17:21:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d11f84a9-ca95-48f2-a667-a30031e52361 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:05 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d11f84a9-ca95-48f2-a667-a30031e52361 Sep 28 17:21:05 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:05 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d11f84a9-ca95-48f2-a667-a30031e52361" returned: 0 in 0.287s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:05 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Lock "cinder-quobyte-d11f84a9-ca95-48f2-a667-a30031e52361" released by "_copy_volume_from_snapshot" :: held 9.578s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:05 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Lock "cinder-quobyte-d8570692-4f90-4195-b142-c50f9a49bd0a-d11f84a9-ca95-48f2-a667-a30031e52361" released by "_create_volume_from_snapshot" :: held 9.708s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.764s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-f381db96-5387-4d9b-b6eb-37b7d8f44e66 req-5c7821bf-4690-49e7-95c4-d352a274e5c1 tempest-AttachVolumeNegativeTest-158509557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.819s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-f381db96-5387-4d9b-b6eb-37b7d8f44e66 req-5c7821bf-4690-49e7-95c4-d352a274e5c1 tempest-AttachVolumeNegativeTest-158509557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-acbe6dea-7470-40b4-b319-fdfa0803a995 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.836s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62344b01-fb18-41df-b147-c78c8c004e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d11f84a9-ca95-48f2-a667-a30031e52361', 'volume_size': 1, 'snapshot_id': 'd8570692-4f90-4195-b142-c50f9a49bd0a'}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c983b8fa-54bc-4d7c-b331-be3c1fb8bd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:05 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Volume volume-d11f84a9-ca95-48f2-a667-a30031e52361 (d11f84a9-ca95-48f2-a667-a30031e52361): created successfully Sep 28 17:21:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c983b8fa-54bc-4d7c-b331-be3c1fb8bd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Flow 'volume_create_manager' (14b5b65a-d759-4aaa-bcb8-88b1a568ad2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-acbe6dea-7470-40b4-b319-fdfa0803a995 tempest-VolumesSnapshotTestJSON-803354126 None] Creating offline snapshot 9da91a05-1426-43b9-b8e4-899dc08991c3 of volume fb79ba0c-05f0-4e73-ae80-bced458d4385 {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:21:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-f381db96-5387-4d9b-b6eb-37b7d8f44e66 req-5c7821bf-4690-49e7-95c4-d352a274e5c1 tempest-AttachVolumeNegativeTest-158509557 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069', 'name': 'volume-b31a6b5f-e9f6-4952-81df-f5ce9837504e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8edd942f-2af1-4049-b796-9d5e9c4e51f9', 'enforce_multipath': True} {{(pid=86917) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:21:05 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-13461272-2495-46aa-acc7-5d2ef0dea3ae tempest-VolumeDependencyTests-1461480466 None] Created volume successfully. Sep 28 17:21:05 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb728417-3481-42e9-9265-de3cec951676]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-acbe6dea-7470-40b4-b319-fdfa0803a995 tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:05 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-f381db96-5387-4d9b-b6eb-37b7d8f44e66 req-5c7821bf-4690-49e7-95c4-d352a274e5c1 tempest-AttachVolumeNegativeTest-158509557 None] attachment_update completed successfully. Sep 28 17:21:06 devstack sudo[99573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385 Sep 28 17:21:06 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:06 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d6ff1a36-b586-48a0-833c-70efbeb8be39 tempest-VolumeDependencyTests-1461480466 None] Acquiring lock "cinder-d8570692-4f90-4195-b142-c50f9a49bd0a-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:06 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d6ff1a36-b586-48a0-833c-70efbeb8be39 tempest-VolumeDependencyTests-1461480466 None] Lock "cinder-d8570692-4f90-4195-b142-c50f9a49bd0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:06 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d6ff1a36-b586-48a0-833c-70efbeb8be39 tempest-VolumeDependencyTests-1461480466 None] Acquiring lock "cinder-quobyte-d98902c7-c8aa-4353-85e4-0fd813892962" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:06 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d6ff1a36-b586-48a0-833c-70efbeb8be39 tempest-VolumeDependencyTests-1461480466 None] Lock "cinder-quobyte-d98902c7-c8aa-4353-85e4-0fd813892962" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:06 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d6ff1a36-b586-48a0-833c-70efbeb8be39 tempest-VolumeDependencyTests-1461480466 None] Acquiring lock "cinder-quobyte-d8570692-4f90-4195-b142-c50f9a49bd0a" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:06 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d6ff1a36-b586-48a0-833c-70efbeb8be39 tempest-VolumeDependencyTests-1461480466 None] Lock "cinder-quobyte-d8570692-4f90-4195-b142-c50f9a49bd0a" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:06 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-d6ff1a36-b586-48a0-833c-70efbeb8be39 tempest-VolumeDependencyTests-1461480466 None] Deleting offline snapshot d8570692-4f90-4195-b142-c50f9a49bd0a of volume d98902c7-c8aa-4353-85e4-0fd813892962 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:21:06 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-d6ff1a36-b586-48a0-833c-70efbeb8be39 tempest-VolumeDependencyTests-1461480466 None] snapshot_file for this snap is: volume-d98902c7-c8aa-4353-85e4-0fd813892962.d8570692-4f90-4195-b142-c50f9a49bd0a {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:21:06 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[812062f8-07c0-438b-87c5-b632f2393f99]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d6ff1a36-b586-48a0-833c-70efbeb8be39 tempest-VolumeDependencyTests-1461480466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962.d8570692-4f90-4195-b142-c50f9a49bd0a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:06 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-acbe6dea-7470-40b4-b319-fdfa0803a995 tempest-VolumesSnapshotTestJSON-803354126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385" returned: 0 in 0.552s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-acbe6dea-7470-40b4-b319-fdfa0803a995 tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385.9da91a05-1426-43b9-b8e4-899dc08991c3 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:06 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962.d8570692-4f90-4195-b142-c50f9a49bd0a Sep 28 17:21:06 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:06 devstack sudo[99993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385.9da91a05-1426-43b9-b8e4-899dc08991c3 1G Sep 28 17:21:06 devstack sudo[99993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:06 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d6ff1a36-b586-48a0-833c-70efbeb8be39 tempest-VolumeDependencyTests-1461480466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962.d8570692-4f90-4195-b142-c50f9a49bd0a" returned: 0 in 0.612s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:06 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-d6ff1a36-b586-48a0-833c-70efbeb8be39 tempest-VolumeDependencyTests-1461480466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d98902c7-c8aa-4353-85e4-0fd813892962(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:21:06 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dfc3b3-e9af-4cba-9e44-9be71bde2375]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d6ff1a36-b586-48a0-833c-70efbeb8be39 tempest-VolumeDependencyTests-1461480466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:07 devstack sudo[99993]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-acbe6dea-7470-40b4-b319-fdfa0803a995 tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385.9da91a05-1426-43b9-b8e4-899dc08991c3 1G" returned: 0 in 0.754s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-acbe6dea-7470-40b4-b319-fdfa0803a995 tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb79ba0c-05f0-4e73-ae80-bced458d4385 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385.9da91a05-1426-43b9-b8e4-899dc08991c3 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:07 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962 Sep 28 17:21:07 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:07 devstack sudo[100010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb79ba0c-05f0-4e73-ae80-bced458d4385 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385.9da91a05-1426-43b9-b8e4-899dc08991c3 Sep 28 17:21:07 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:07 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-acbe6dea-7470-40b4-b319-fdfa0803a995 tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb79ba0c-05f0-4e73-ae80-bced458d4385 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385.9da91a05-1426-43b9-b8e4-899dc08991c3" returned: 0 in 0.431s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:07 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-acbe6dea-7470-40b4-b319-fdfa0803a995 tempest-VolumesSnapshotTestJSON-803354126 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385.9da91a05-1426-43b9-b8e4-899dc08991c3 is being set with open permissions: ugo+rw Sep 28 17:21:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-acbe6dea-7470-40b4-b319-fdfa0803a995 tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385.9da91a05-1426-43b9-b8e4-899dc08991c3 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:07 devstack sudo[100018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385.9da91a05-1426-43b9-b8e4-899dc08991c3 Sep 28 17:21:07 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:07 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d6ff1a36-b586-48a0-833c-70efbeb8be39 tempest-VolumeDependencyTests-1461480466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962" returned: 0 in 0.804s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d6ff1a36-b586-48a0-833c-70efbeb8be39 tempest-VolumeDependencyTests-1461480466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962.d8570692-4f90-4195-b142-c50f9a49bd0a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:07 devstack sudo[100021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962.d8570692-4f90-4195-b142-c50f9a49bd0a Sep 28 17:21:07 devstack sudo[100021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:08 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-acbe6dea-7470-40b4-b319-fdfa0803a995 tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385.9da91a05-1426-43b9-b8e4-899dc08991c3" returned: 0 in 0.374s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-acbe6dea-7470-40b4-b319-fdfa0803a995 tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:08 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385.info Sep 28 17:21:08 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:08 devstack sudo[100021]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d6ff1a36-b586-48a0-833c-70efbeb8be39 tempest-VolumeDependencyTests-1461480466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962.d8570692-4f90-4195-b142-c50f9a49bd0a" returned: 0 in 0.475s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d6ff1a36-b586-48a0-833c-70efbeb8be39 tempest-VolumeDependencyTests-1461480466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962.d8570692-4f90-4195-b142-c50f9a49bd0a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:08 devstack sudo[100029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962.d8570692-4f90-4195-b142-c50f9a49bd0a Sep 28 17:21:08 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:08 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-acbe6dea-7470-40b4-b319-fdfa0803a995 tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385.info" returned: 0 in 0.445s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:08 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-acbe6dea-7470-40b4-b319-fdfa0803a995 tempest-VolumesSnapshotTestJSON-803354126 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385.info is being set with open permissions: ugo+rw Sep 28 17:21:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-acbe6dea-7470-40b4-b319-fdfa0803a995 tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:08 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385.info Sep 28 17:21:08 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:08 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d6ff1a36-b586-48a0-833c-70efbeb8be39 tempest-VolumeDependencyTests-1461480466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962.d8570692-4f90-4195-b142-c50f9a49bd0a" returned: 0 in 0.410s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:08 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d6ff1a36-b586-48a0-833c-70efbeb8be39 tempest-VolumeDependencyTests-1461480466 None] Lock "cinder-quobyte-d8570692-4f90-4195-b142-c50f9a49bd0a" released by "_delete_snapshot" :: held 2.508s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:08 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d6ff1a36-b586-48a0-833c-70efbeb8be39 tempest-VolumeDependencyTests-1461480466 None] Lock "cinder-quobyte-d98902c7-c8aa-4353-85e4-0fd813892962" released by "delete_snapshot" :: held 2.556s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:08 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-d6ff1a36-b586-48a0-833c-70efbeb8be39 tempest-VolumeDependencyTests-1461480466 None] Created reservations ['ff615be6-2d55-46d3-87e3-8e2a249bdae2', 'f7a53e35-4cde-4080-87de-ec12e38900eb', 'f052f4c3-6a04-44d3-ba8e-0537e412e014', '66fe898d-f4e0-4390-82cc-3d9140dda915'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:08 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-d6ff1a36-b586-48a0-833c-70efbeb8be39 tempest-VolumeDependencyTests-1461480466 None] Delete snapshot completed successfully. Sep 28 17:21:08 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d6ff1a36-b586-48a0-833c-70efbeb8be39 tempest-VolumeDependencyTests-1461480466 None] Lock "cinder-d8570692-4f90-4195-b142-c50f9a49bd0a-delete_snapshot" released by "delete_snapshot" :: held 2.792s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:08 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-acbe6dea-7470-40b4-b319-fdfa0803a995 tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385.info" returned: 0 in 0.460s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-acbe6dea-7470-40b4-b319-fdfa0803a995 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.266s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:09 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-acbe6dea-7470-40b4-b319-fdfa0803a995 tempest-VolumesSnapshotTestJSON-803354126 None] Create snapshot completed successfully Sep 28 17:21:09 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-7ceab185-5461-4d0f-9ab2-8b8eff865a27 req-a8952822-cd52-4be0-a5c3-bf121328f981 tempest-AttachVolumeNegativeTest-158509557 None] Terminate volume connection completed successfully. Sep 28 17:21:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-7ceab185-5461-4d0f-9ab2-8b8eff865a27 req-a8952822-cd52-4be0-a5c3-bf121328f981 tempest-AttachVolumeNegativeTest-158509557 None] Deleting attachment 8edd942f-2af1-4049-b796-9d5e9c4e51f9. {{(pid=86917) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:21:09 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-01679cf1-393b-4b42-8e69-52743a456e7c tempest-VolumeDependencyTests-1461480466 None] Acquiring lock "cinder-d98902c7-c8aa-4353-85e4-0fd813892962-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:09 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-01679cf1-393b-4b42-8e69-52743a456e7c tempest-VolumeDependencyTests-1461480466 None] Lock "cinder-d98902c7-c8aa-4353-85e4-0fd813892962-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:09 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-01679cf1-393b-4b42-8e69-52743a456e7c tempest-VolumeDependencyTests-1461480466 None] Acquiring lock "cinder-quobyte-d98902c7-c8aa-4353-85e4-0fd813892962" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:09 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-01679cf1-393b-4b42-8e69-52743a456e7c tempest-VolumeDependencyTests-1461480466 None] Lock "cinder-quobyte-d98902c7-c8aa-4353-85e4-0fd813892962" acquired by "delete_volume" :: waited 0.029s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:09 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[045b5401-e96c-4d4d-942c-8c43b89479a9]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-01679cf1-393b-4b42-8e69-52743a456e7c tempest-VolumeDependencyTests-1461480466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:09 devstack sudo[100066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962 Sep 28 17:21:09 devstack sudo[100066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:10 devstack sudo[100066]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-01679cf1-393b-4b42-8e69-52743a456e7c tempest-VolumeDependencyTests-1461480466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962" returned: 0 in 0.592s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-01679cf1-393b-4b42-8e69-52743a456e7c tempest-VolumeDependencyTests-1461480466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:10 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962 Sep 28 17:21:10 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:10 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-01679cf1-393b-4b42-8e69-52743a456e7c tempest-VolumeDependencyTests-1461480466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d98902c7-c8aa-4353-85e4-0fd813892962" returned: 0 in 0.648s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:10 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-01679cf1-393b-4b42-8e69-52743a456e7c tempest-VolumeDependencyTests-1461480466 None] Lock "cinder-quobyte-d98902c7-c8aa-4353-85e4-0fd813892962" released by "delete_volume" :: held 1.352s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-01679cf1-393b-4b42-8e69-52743a456e7c tempest-VolumeDependencyTests-1461480466 None] Created reservations ['84bcc408-6cde-430c-9941-ebb1cdb8ff67', 'd552ea2d-bcf5-4c79-84e1-3f6c044bf063', '98e26297-61d5-4380-8a6d-6bab3d857322', 'c81b8188-be73-4724-b153-21fda9af71ae'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Flow 'volume_create_manager' (c5431289-9437-4e04-8453-0822050f4c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15449d39-f63b-410a-b699-f23740489011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15449d39-f63b-410a-b699-f23740489011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1246364806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5844daaa-7a62-4624-8526-1ae669aead63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daababf0069a4500946ef3bd106e2e19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=9da91a05-1426-43b9-b8e4-899dc08991c3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:11Z,use_quota=True,user_id='3b4641fc2a6e4cf592a96014ad60aeb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (989309b2-1d1b-4c9a-ab0a-3056c9d8bc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (989309b2-1d1b-4c9a-ab0a-3056c9d8bc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5893d76c-b3bb-4f1d-8514-6ae6a120e1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5893d76c-b3bb-4f1d-8514-6ae6a120e1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5844daaa-7a62-4624-8526-1ae669aead63', 'volume_name': 'volume-5844daaa-7a62-4624-8526-1ae669aead63', 'volume_size': 2, 'snapshot_id': '9da91a05-1426-43b9-b8e4-899dc08991c3'}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c34cfd-1e9f-4b0c-a0d6-2e7d4fbce161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c34cfd-1e9f-4b0c-a0d6-2e7d4fbce161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa0345e8-8730-4e9c-ad8e-cb81db6f69b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:11 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Volume 5844daaa-7a62-4624-8526-1ae669aead63: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5844daaa-7a62-4624-8526-1ae669aead63', 'volume_size': 2, 'snapshot_id': '9da91a05-1426-43b9-b8e4-899dc08991c3'} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "cinder-quobyte-9da91a05-1426-43b9-b8e4-899dc08991c3-5844daaa-7a62-4624-8526-1ae669aead63" by "_create_volume_from_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-01679cf1-393b-4b42-8e69-52743a456e7c tempest-VolumeDependencyTests-1461480466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-01679cf1-393b-4b42-8e69-52743a456e7c tempest-VolumeDependencyTests-1461480466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-01679cf1-393b-4b42-8e69-52743a456e7c tempest-VolumeDependencyTests-1461480466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-01679cf1-393b-4b42-8e69-52743a456e7c tempest-VolumeDependencyTests-1461480466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-01679cf1-393b-4b42-8e69-52743a456e7c tempest-VolumeDependencyTests-1461480466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-01679cf1-393b-4b42-8e69-52743a456e7c tempest-VolumeDependencyTests-1461480466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-quobyte-9da91a05-1426-43b9-b8e4-899dc08991c3-5844daaa-7a62-4624-8526-1ae669aead63" acquired by "_create_volume_from_snapshot" :: waited 0.067s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Creating volume 5844daaa-7a62-4624-8526-1ae669aead63 from snapshot 9da91a05-1426-43b9-b8e4-899dc08991c3 {{(pid=86917) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "cinder-quobyte-5844daaa-7a62-4624-8526-1ae669aead63" by "_copy_volume_from_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:11 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:21:11 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-quobyte-5844daaa-7a62-4624-8526-1ae669aead63" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] snapshot: 9da91a05-1426-43b9-b8e4-899dc08991c3, volume: 5844daaa-7a62-4624-8526-1ae669aead63, {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e26599-85ee-4a4c-bb15-5f8714ccb29a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385.9da91a05-1426-43b9-b8e4-899dc08991c3 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:11 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b9a2d9ec-c9d0-46b5-b954-ca543d7395ab tempest-VolumeDependencyTests-1461480466 None] Acquiring lock "cinder-d11f84a9-ca95-48f2-a667-a30031e52361-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:12 devstack sudo[100100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385.9da91a05-1426-43b9-b8e4-899dc08991c3 Sep 28 17:21:12 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:12 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-01679cf1-393b-4b42-8e69-52743a456e7c tempest-VolumeDependencyTests-1461480466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.508s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:12 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-01679cf1-393b-4b42-8e69-52743a456e7c tempest-VolumeDependencyTests-1461480466 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:12 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b9a2d9ec-c9d0-46b5-b954-ca543d7395ab tempest-VolumeDependencyTests-1461480466 None] Lock "cinder-d11f84a9-ca95-48f2-a667-a30031e52361-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:12 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-01679cf1-393b-4b42-8e69-52743a456e7c tempest-VolumeDependencyTests-1461480466 None] Deleted volume successfully. Sep 28 17:21:12 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-01679cf1-393b-4b42-8e69-52743a456e7c tempest-VolumeDependencyTests-1461480466 None] Lock "cinder-d98902c7-c8aa-4353-85e4-0fd813892962-delete_volume" released by "delete_volume" :: held 2.624s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:12 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b9a2d9ec-c9d0-46b5-b954-ca543d7395ab tempest-VolumeDependencyTests-1461480466 None] Acquiring lock "cinder-quobyte-d11f84a9-ca95-48f2-a667-a30031e52361" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:12 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b9a2d9ec-c9d0-46b5-b954-ca543d7395ab tempest-VolumeDependencyTests-1461480466 None] Lock "cinder-quobyte-d11f84a9-ca95-48f2-a667-a30031e52361" acquired by "delete_volume" :: waited 0.053s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:12 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66af9f3-7a91-45a9-8675-b9c8f6b0e931]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b9a2d9ec-c9d0-46b5-b954-ca543d7395ab tempest-VolumeDependencyTests-1461480466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d11f84a9-ca95-48f2-a667-a30031e52361 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:12 devstack sudo[100105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d11f84a9-ca95-48f2-a667-a30031e52361 Sep 28 17:21:12 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:12 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385.9da91a05-1426-43b9-b8e4-899dc08991c3" returned: 0 in 0.840s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:12 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb79ba0c-05f0-4e73-ae80-bced458d4385(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:21:12 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[003740a1-891b-4344-b740-c0f9f316e80a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:12 devstack sudo[100110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385 Sep 28 17:21:12 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:12 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b9a2d9ec-c9d0-46b5-b954-ca543d7395ab tempest-VolumeDependencyTests-1461480466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d11f84a9-ca95-48f2-a667-a30031e52361" returned: 0 in 0.640s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b9a2d9ec-c9d0-46b5-b954-ca543d7395ab tempest-VolumeDependencyTests-1461480466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d11f84a9-ca95-48f2-a667-a30031e52361 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:12 devstack sudo[100116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d11f84a9-ca95-48f2-a667-a30031e52361 Sep 28 17:21:12 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:13 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385" returned: 0 in 0.973s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:13 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385 {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:21:13 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Creating direct copy from snapshot {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:21:13 devstack cinder-volume[86917]: DEBUG cinder.utils [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Path /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5844daaa-7a62-4624-8526-1ae669aead63 not found in is_blk_device check {{(pid=86917) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:21:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5844daaa-7a62-4624-8526-1ae669aead63 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:13 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b9a2d9ec-c9d0-46b5-b954-ca543d7395ab tempest-VolumeDependencyTests-1461480466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d11f84a9-ca95-48f2-a667-a30031e52361" returned: 0 in 0.652s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:13 devstack sudo[100124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5844daaa-7a62-4624-8526-1ae669aead63 Sep 28 17:21:13 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:13 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b9a2d9ec-c9d0-46b5-b954-ca543d7395ab tempest-VolumeDependencyTests-1461480466 None] Lock "cinder-quobyte-d11f84a9-ca95-48f2-a667-a30031e52361" released by "delete_volume" :: held 1.384s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:13 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-b9a2d9ec-c9d0-46b5-b954-ca543d7395ab tempest-VolumeDependencyTests-1461480466 None] Created reservations ['140a4445-dc32-434b-a239-e49a33061528', '7dbac7ee-298f-4c1a-be7e-e52f00387890', '8429d0c3-c659-463e-9cd5-2f1d172aaa38', '0f81aa34-a83c-4d33-881f-612cb04f581c'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b9a2d9ec-c9d0-46b5-b954-ca543d7395ab tempest-VolumeDependencyTests-1461480466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b9a2d9ec-c9d0-46b5-b954-ca543d7395ab tempest-VolumeDependencyTests-1461480466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:13 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b9a2d9ec-c9d0-46b5-b954-ca543d7395ab tempest-VolumeDependencyTests-1461480466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:13 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b9a2d9ec-c9d0-46b5-b954-ca543d7395ab tempest-VolumeDependencyTests-1461480466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b9a2d9ec-c9d0-46b5-b954-ca543d7395ab tempest-VolumeDependencyTests-1461480466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b9a2d9ec-c9d0-46b5-b954-ca543d7395ab tempest-VolumeDependencyTests-1461480466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:13 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:21:13 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b9a2d9ec-c9d0-46b5-b954-ca543d7395ab tempest-VolumeDependencyTests-1461480466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.653s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:14 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:14 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-b9a2d9ec-c9d0-46b5-b954-ca543d7395ab tempest-VolumeDependencyTests-1461480466 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:14 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-b9a2d9ec-c9d0-46b5-b954-ca543d7395ab tempest-VolumeDependencyTests-1461480466 None] Deleted volume successfully. Sep 28 17:21:14 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b9a2d9ec-c9d0-46b5-b954-ca543d7395ab tempest-VolumeDependencyTests-1461480466 None] Lock "cinder-d11f84a9-ca95-48f2-a667-a30031e52361-delete_volume" released by "delete_volume" :: held 2.678s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:21 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d4b64a6-c805-4409-b3da-87541700d5f1 tempest-CreateVolumesFromImageTest-12436347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:21:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-8d4b64a6-c805-4409-b3da-87541700d5f1 tempest-CreateVolumesFromImageTest-12436347 None] Flow 'volume_create_manager' (295ba846-9b07-48b6-a117-8a41a8e280c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-8d4b64a6-c805-4409-b3da-87541700d5f1 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a05eb8a4-c0fd-4679-b2fd-6ec0da885ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-8d4b64a6-c805-4409-b3da-87541700d5f1 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a05eb8a4-c0fd-4679-b2fd-6ec0da885ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1257761151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cab41406-0e36-45b1-972c-8df53c2c3f9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b5bbfdb13640c3b5156a106c653c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:22Z,use_quota=True,user_id='82b8ad4d5df44a938cc64dd44af8091f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-8d4b64a6-c805-4409-b3da-87541700d5f1 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e572334-1394-4d00-8f58-917356ce5227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-8d4b64a6-c805-4409-b3da-87541700d5f1 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e572334-1394-4d00-8f58-917356ce5227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-8d4b64a6-c805-4409-b3da-87541700d5f1 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31848dc2-54cf-4202-9840-da25328fba58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-8d4b64a6-c805-4409-b3da-87541700d5f1 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31848dc2-54cf-4202-9840-da25328fba58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cab41406-0e36-45b1-972c-8df53c2c3f9f', 'volume_name': 'volume-cab41406-0e36-45b1-972c-8df53c2c3f9f', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-8d4b64a6-c805-4409-b3da-87541700d5f1 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdf68186-fe2a-48e5-97e6-6a486684509b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-8d4b64a6-c805-4409-b3da-87541700d5f1 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdf68186-fe2a-48e5-97e6-6a486684509b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-8d4b64a6-c805-4409-b3da-87541700d5f1 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5234e45-f00a-460f-85c5-958a6528b20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:21 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-8d4b64a6-c805-4409-b3da-87541700d5f1 tempest-CreateVolumesFromImageTest-12436347 None] Volume cab41406-0e36-45b1-972c-8df53c2c3f9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cab41406-0e36-45b1-972c-8df53c2c3f9f', 'volume_size': 1} Sep 28 17:21:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8d4b64a6-c805-4409-b3da-87541700d5f1 tempest-CreateVolumesFromImageTest-12436347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:22 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-216ce2af-ade2-47a1-a5cd-00344365aa02 tempest-CreateVolumesFromImageTest-12436347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:21:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-216ce2af-ade2-47a1-a5cd-00344365aa02 tempest-CreateVolumesFromImageTest-12436347 None] Flow 'volume_create_manager' (a452cbd1-481d-45ac-954d-d1177344bc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-216ce2af-ade2-47a1-a5cd-00344365aa02 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81bf04cf-43ff-4231-b9b1-a03d7835bedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-216ce2af-ade2-47a1-a5cd-00344365aa02 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81bf04cf-43ff-4231-b9b1-a03d7835bedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-779442155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2113e623-9fd7-4bbe-8ee6-85627752c4e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b5bbfdb13640c3b5156a106c653c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:23Z,use_quota=True,user_id='82b8ad4d5df44a938cc64dd44af8091f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-216ce2af-ade2-47a1-a5cd-00344365aa02 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36781e24-cc0f-44e9-8a58-893955438c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-216ce2af-ade2-47a1-a5cd-00344365aa02 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36781e24-cc0f-44e9-8a58-893955438c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-216ce2af-ade2-47a1-a5cd-00344365aa02 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4806b68f-7dbf-4882-bac4-02bb6cc4aed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-216ce2af-ade2-47a1-a5cd-00344365aa02 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4806b68f-7dbf-4882-bac4-02bb6cc4aed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2113e623-9fd7-4bbe-8ee6-85627752c4e2', 'volume_name': 'volume-2113e623-9fd7-4bbe-8ee6-85627752c4e2', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-216ce2af-ade2-47a1-a5cd-00344365aa02 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ba68bba-6f75-4e34-af7a-853d2ce1468a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-216ce2af-ade2-47a1-a5cd-00344365aa02 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ba68bba-6f75-4e34-af7a-853d2ce1468a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-216ce2af-ade2-47a1-a5cd-00344365aa02 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58cee9fb-c845-431d-9b01-52d313714a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:23 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-216ce2af-ade2-47a1-a5cd-00344365aa02 tempest-CreateVolumesFromImageTest-12436347 None] Volume 2113e623-9fd7-4bbe-8ee6-85627752c4e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2113e623-9fd7-4bbe-8ee6-85627752c4e2', 'volume_size': 1} Sep 28 17:21:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-216ce2af-ade2-47a1-a5cd-00344365aa02 tempest-CreateVolumesFromImageTest-12436347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:23 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9cf1aae-be1d-4e83-bdc1-6c687c845d05 tempest-CreateVolumesFromImageTest-12436347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:21:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d9cf1aae-be1d-4e83-bdc1-6c687c845d05 tempest-CreateVolumesFromImageTest-12436347 None] Flow 'volume_create_manager' (edc0d8f9-4171-49a1-b1fb-3a583e806526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d9cf1aae-be1d-4e83-bdc1-6c687c845d05 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91b4271-75d1-47f3-a17f-f321de0c9a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d9cf1aae-be1d-4e83-bdc1-6c687c845d05 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91b4271-75d1-47f3-a17f-f321de0c9a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-502515487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff83d2a-d8f2-43b1-8bec-93d56b52980e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b5bbfdb13640c3b5156a106c653c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:24Z,use_quota=True,user_id='82b8ad4d5df44a938cc64dd44af8091f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d9cf1aae-be1d-4e83-bdc1-6c687c845d05 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d19c474-9210-4397-bbf0-488018be1827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d9cf1aae-be1d-4e83-bdc1-6c687c845d05 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d19c474-9210-4397-bbf0-488018be1827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d9cf1aae-be1d-4e83-bdc1-6c687c845d05 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8706bb48-d62d-4b17-a995-4b5e09d66c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d9cf1aae-be1d-4e83-bdc1-6c687c845d05 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8706bb48-d62d-4b17-a995-4b5e09d66c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dff83d2a-d8f2-43b1-8bec-93d56b52980e', 'volume_name': 'volume-dff83d2a-d8f2-43b1-8bec-93d56b52980e', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d9cf1aae-be1d-4e83-bdc1-6c687c845d05 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4332287-ad89-41fb-b9ba-2cee49d7f0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d9cf1aae-be1d-4e83-bdc1-6c687c845d05 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4332287-ad89-41fb-b9ba-2cee49d7f0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d9cf1aae-be1d-4e83-bdc1-6c687c845d05 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eee08a3-7e09-41b8-b38c-883225b6e33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:24 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-d9cf1aae-be1d-4e83-bdc1-6c687c845d05 tempest-CreateVolumesFromImageTest-12436347 None] Volume dff83d2a-d8f2-43b1-8bec-93d56b52980e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dff83d2a-d8f2-43b1-8bec-93d56b52980e', 'volume_size': 1} Sep 28 17:21:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d9cf1aae-be1d-4e83-bdc1-6c687c845d05 tempest-CreateVolumesFromImageTest-12436347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:24 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5844daaa-7a62-4624-8526-1ae669aead63" returned: 0 in 11.134s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:24 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Image conversion details: src /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385, size 1024.00 MB, duration 11.14 sec, destination /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5844daaa-7a62-4624-8526-1ae669aead63 {{(pid=86917) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:21:24 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Converted 1024.00 MB image at 91.95 MB/s Sep 28 17:21:24 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5844daaa-7a62-4624-8526-1ae669aead63 is being set with open permissions: ugo+rw Sep 28 17:21:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5844daaa-7a62-4624-8526-1ae669aead63 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:24 devstack sudo[100184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5844daaa-7a62-4624-8526-1ae669aead63 Sep 28 17:21:24 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:24 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-6424ce3b-b4f2-4458-9d66-9b3e8bc367cc tempest-CreateVolumesFromImageTest-12436347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:21:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6424ce3b-b4f2-4458-9d66-9b3e8bc367cc tempest-CreateVolumesFromImageTest-12436347 None] Flow 'volume_create_manager' (3662706e-aed5-4b7b-8adf-6016ee13ba97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6424ce3b-b4f2-4458-9d66-9b3e8bc367cc tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b33f850c-88f4-4086-89df-bba717412281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6424ce3b-b4f2-4458-9d66-9b3e8bc367cc tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b33f850c-88f4-4086-89df-bba717412281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1104825313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d0410e7-257b-4c0a-a1a0-6f35cad15b60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b5bbfdb13640c3b5156a106c653c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:25Z,use_quota=True,user_id='82b8ad4d5df44a938cc64dd44af8091f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6424ce3b-b4f2-4458-9d66-9b3e8bc367cc tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77158e32-4e26-4f45-b5d5-4289e8a8913d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6424ce3b-b4f2-4458-9d66-9b3e8bc367cc tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77158e32-4e26-4f45-b5d5-4289e8a8913d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6424ce3b-b4f2-4458-9d66-9b3e8bc367cc tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b87cfa-4a24-47a3-874a-a9409be659de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6424ce3b-b4f2-4458-9d66-9b3e8bc367cc tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b87cfa-4a24-47a3-874a-a9409be659de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d0410e7-257b-4c0a-a1a0-6f35cad15b60', 'volume_name': 'volume-8d0410e7-257b-4c0a-a1a0-6f35cad15b60', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6424ce3b-b4f2-4458-9d66-9b3e8bc367cc tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7adb071-0568-463a-9ac5-4762d9b32ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6424ce3b-b4f2-4458-9d66-9b3e8bc367cc tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7adb071-0568-463a-9ac5-4762d9b32ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6424ce3b-b4f2-4458-9d66-9b3e8bc367cc tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b57148d5-77b9-4029-bbf8-9eebbf8202d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:24 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-6424ce3b-b4f2-4458-9d66-9b3e8bc367cc tempest-CreateVolumesFromImageTest-12436347 None] Volume 8d0410e7-257b-4c0a-a1a0-6f35cad15b60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d0410e7-257b-4c0a-a1a0-6f35cad15b60', 'volume_size': 1} Sep 28 17:21:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6424ce3b-b4f2-4458-9d66-9b3e8bc367cc tempest-CreateVolumesFromImageTest-12436347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:25 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5844daaa-7a62-4624-8526-1ae669aead63" returned: 0 in 0.438s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:25 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-quobyte-5844daaa-7a62-4624-8526-1ae669aead63" released by "_copy_volume_from_snapshot" :: held 13.574s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:25 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-quobyte-9da91a05-1426-43b9-b8e4-899dc08991c3-5844daaa-7a62-4624-8526-1ae669aead63" released by "_create_volume_from_snapshot" :: held 13.724s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.802s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8d4b64a6-c805-4409-b3da-87541700d5f1 tempest-CreateVolumesFromImageTest-12436347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.361s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:25 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-8d4b64a6-c805-4409-b3da-87541700d5f1 tempest-CreateVolumesFromImageTest-12436347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1257761151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cab41406-0e36-45b1-972c-8df53c2c3f9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b5bbfdb13640c3b5156a106c653c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:22Z,use_quota=True,user_id='82b8ad4d5df44a938cc64dd44af8091f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:21:25 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-8d4b64a6-c805-4409-b3da-87541700d5f1 tempest-CreateVolumesFromImageTest-12436347 None] Creating volume cab41406-0e36-45b1-972c-8df53c2c3f9f {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:21:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8d4b64a6-c805-4409-b3da-87541700d5f1 tempest-CreateVolumesFromImageTest-12436347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8d4b64a6-c805-4409-b3da-87541700d5f1 tempest-CreateVolumesFromImageTest-12436347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:25 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-8d4b64a6-c805-4409-b3da-87541700d5f1 tempest-CreateVolumesFromImageTest-12436347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:25 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-8d4b64a6-c805-4409-b3da-87541700d5f1 tempest-CreateVolumesFromImageTest-12436347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8d4b64a6-c805-4409-b3da-87541700d5f1 tempest-CreateVolumesFromImageTest-12436347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:25 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-8d4b64a6-c805-4409-b3da-87541700d5f1 tempest-CreateVolumesFromImageTest-12436347 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:21:25 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-8d4b64a6-c805-4409-b3da-87541700d5f1 tempest-CreateVolumesFromImageTest-12436347 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:21:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8d4b64a6-c805-4409-b3da-87541700d5f1 tempest-CreateVolumesFromImageTest-12436347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cab41406-0e36-45b1-972c-8df53c2c3f9f 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:25 devstack sudo[100187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cab41406-0e36-45b1-972c-8df53c2c3f9f 1073741824 Sep 28 17:21:25 devstack sudo[100187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa0345e8-8730-4e9c-ad8e-cb81db6f69b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5844daaa-7a62-4624-8526-1ae669aead63', 'volume_size': 2, 'snapshot_id': '9da91a05-1426-43b9-b8e4-899dc08991c3'}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f41c3f-8181-4602-8f9f-da93dd2490eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:25 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Volume volume-5844daaa-7a62-4624-8526-1ae669aead63 (5844daaa-7a62-4624-8526-1ae669aead63): created successfully Sep 28 17:21:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f41c3f-8181-4602-8f9f-da93dd2490eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Flow 'volume_create_manager' (c5431289-9437-4e04-8453-0822050f4c11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:25 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-a7f11824-2145-4cdb-839d-37ff65cc4112 tempest-VolumesSnapshotTestJSON-803354126 None] Created volume successfully. Sep 28 17:21:25 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-71dfa402-6736-485e-bdbc-ca407a6bb9f1 tempest-CreateVolumesFromImageTest-12436347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:21:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-71dfa402-6736-485e-bdbc-ca407a6bb9f1 tempest-CreateVolumesFromImageTest-12436347 None] Flow 'volume_create_manager' (9642c824-b018-4aea-aef5-91e1a8000a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-71dfa402-6736-485e-bdbc-ca407a6bb9f1 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319232f1-951a-4d4c-a765-f240a40907d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-71dfa402-6736-485e-bdbc-ca407a6bb9f1 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319232f1-951a-4d4c-a765-f240a40907d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1217454110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=360794c0-f3ca-4fa6-80b4-70f9c574ebaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b5bbfdb13640c3b5156a106c653c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:25Z,use_quota=True,user_id='82b8ad4d5df44a938cc64dd44af8091f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-71dfa402-6736-485e-bdbc-ca407a6bb9f1 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad0d3751-2b45-46d9-91ad-9ce3c7d3980d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-71dfa402-6736-485e-bdbc-ca407a6bb9f1 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad0d3751-2b45-46d9-91ad-9ce3c7d3980d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-71dfa402-6736-485e-bdbc-ca407a6bb9f1 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bad1ee1-e376-432d-9676-1dd02fa51155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-71dfa402-6736-485e-bdbc-ca407a6bb9f1 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bad1ee1-e376-432d-9676-1dd02fa51155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '360794c0-f3ca-4fa6-80b4-70f9c574ebaa', 'volume_name': 'volume-360794c0-f3ca-4fa6-80b4-70f9c574ebaa', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-71dfa402-6736-485e-bdbc-ca407a6bb9f1 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b025b84e-0336-4dbb-90f5-8f71480f5fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-71dfa402-6736-485e-bdbc-ca407a6bb9f1 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b025b84e-0336-4dbb-90f5-8f71480f5fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-71dfa402-6736-485e-bdbc-ca407a6bb9f1 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f51294c6-f708-4411-b27c-3d96a2ee1e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:25 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-71dfa402-6736-485e-bdbc-ca407a6bb9f1 tempest-CreateVolumesFromImageTest-12436347 None] Volume 360794c0-f3ca-4fa6-80b4-70f9c574ebaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-360794c0-f3ca-4fa6-80b4-70f9c574ebaa', 'volume_size': 1} Sep 28 17:21:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-71dfa402-6736-485e-bdbc-ca407a6bb9f1 tempest-CreateVolumesFromImageTest-12436347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:25 devstack sudo[100187]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8d4b64a6-c805-4409-b3da-87541700d5f1 tempest-CreateVolumesFromImageTest-12436347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cab41406-0e36-45b1-972c-8df53c2c3f9f 1073741824" returned: 0 in 0.662s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8d4b64a6-c805-4409-b3da-87541700d5f1 tempest-CreateVolumesFromImageTest-12436347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cab41406-0e36-45b1-972c-8df53c2c3f9f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:26 devstack sudo[100193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cab41406-0e36-45b1-972c-8df53c2c3f9f Sep 28 17:21:26 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:26 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8d4b64a6-c805-4409-b3da-87541700d5f1 tempest-CreateVolumesFromImageTest-12436347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cab41406-0e36-45b1-972c-8df53c2c3f9f" returned: 0 in 0.337s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:26 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-8d4b64a6-c805-4409-b3da-87541700d5f1 tempest-CreateVolumesFromImageTest-12436347 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:21:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8d4b64a6-c805-4409-b3da-87541700d5f1 tempest-CreateVolumesFromImageTest-12436347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-216ce2af-ade2-47a1-a5cd-00344365aa02 tempest-CreateVolumesFromImageTest-12436347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.238s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:26 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-216ce2af-ade2-47a1-a5cd-00344365aa02 tempest-CreateVolumesFromImageTest-12436347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-779442155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2113e623-9fd7-4bbe-8ee6-85627752c4e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b5bbfdb13640c3b5156a106c653c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:23Z,use_quota=True,user_id='82b8ad4d5df44a938cc64dd44af8091f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:21:26 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-216ce2af-ade2-47a1-a5cd-00344365aa02 tempest-CreateVolumesFromImageTest-12436347 None] Creating volume 2113e623-9fd7-4bbe-8ee6-85627752c4e2 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:21:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-216ce2af-ade2-47a1-a5cd-00344365aa02 tempest-CreateVolumesFromImageTest-12436347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-216ce2af-ade2-47a1-a5cd-00344365aa02 tempest-CreateVolumesFromImageTest-12436347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:26 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-216ce2af-ade2-47a1-a5cd-00344365aa02 tempest-CreateVolumesFromImageTest-12436347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:26 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-216ce2af-ade2-47a1-a5cd-00344365aa02 tempest-CreateVolumesFromImageTest-12436347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-216ce2af-ade2-47a1-a5cd-00344365aa02 tempest-CreateVolumesFromImageTest-12436347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:26 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-216ce2af-ade2-47a1-a5cd-00344365aa02 tempest-CreateVolumesFromImageTest-12436347 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:21:26 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-216ce2af-ade2-47a1-a5cd-00344365aa02 tempest-CreateVolumesFromImageTest-12436347 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:21:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-216ce2af-ade2-47a1-a5cd-00344365aa02 tempest-CreateVolumesFromImageTest-12436347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2113e623-9fd7-4bbe-8ee6-85627752c4e2 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:26 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-8d4b64a6-c805-4409-b3da-87541700d5f1 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5234e45-f00a-460f-85c5-958a6528b20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cab41406-0e36-45b1-972c-8df53c2c3f9f', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:26 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-8d4b64a6-c805-4409-b3da-87541700d5f1 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99523b11-6659-48ff-a4fd-23e6b140b68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:26 devstack sudo[100196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2113e623-9fd7-4bbe-8ee6-85627752c4e2 1073741824 Sep 28 17:21:26 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:26 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b573c8da-f8a0-47d9-b664-cfdc9cc5390e tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "cinder-5844daaa-7a62-4624-8526-1ae669aead63-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:26 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-8d4b64a6-c805-4409-b3da-87541700d5f1 tempest-CreateVolumesFromImageTest-12436347 None] Volume volume-cab41406-0e36-45b1-972c-8df53c2c3f9f (cab41406-0e36-45b1-972c-8df53c2c3f9f): created successfully Sep 28 17:21:26 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-8d4b64a6-c805-4409-b3da-87541700d5f1 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99523b11-6659-48ff-a4fd-23e6b140b68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:26 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-8d4b64a6-c805-4409-b3da-87541700d5f1 tempest-CreateVolumesFromImageTest-12436347 None] Flow 'volume_create_manager' (295ba846-9b07-48b6-a117-8a41a8e280c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:26 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b573c8da-f8a0-47d9-b664-cfdc9cc5390e tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-5844daaa-7a62-4624-8526-1ae669aead63-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:26 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-8d4b64a6-c805-4409-b3da-87541700d5f1 tempest-CreateVolumesFromImageTest-12436347 None] Created volume successfully. Sep 28 17:21:26 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b573c8da-f8a0-47d9-b664-cfdc9cc5390e tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "cinder-quobyte-5844daaa-7a62-4624-8526-1ae669aead63" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:26 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b573c8da-f8a0-47d9-b664-cfdc9cc5390e tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-quobyte-5844daaa-7a62-4624-8526-1ae669aead63" acquired by "delete_volume" :: waited 0.024s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:26 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[253807da-5d01-44aa-b898-767d7d0f83dd]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b573c8da-f8a0-47d9-b664-cfdc9cc5390e tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5844daaa-7a62-4624-8526-1ae669aead63 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:26 devstack sudo[100198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5844daaa-7a62-4624-8526-1ae669aead63 Sep 28 17:21:26 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:27 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-216ce2af-ade2-47a1-a5cd-00344365aa02 tempest-CreateVolumesFromImageTest-12436347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2113e623-9fd7-4bbe-8ee6-85627752c4e2 1073741824" returned: 0 in 0.719s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-216ce2af-ade2-47a1-a5cd-00344365aa02 tempest-CreateVolumesFromImageTest-12436347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2113e623-9fd7-4bbe-8ee6-85627752c4e2 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:27 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b573c8da-f8a0-47d9-b664-cfdc9cc5390e tempest-VolumesSnapshotTestJSON-803354126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5844daaa-7a62-4624-8526-1ae669aead63" returned: 0 in 0.508s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b573c8da-f8a0-47d9-b664-cfdc9cc5390e tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5844daaa-7a62-4624-8526-1ae669aead63 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:27 devstack sudo[100207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2113e623-9fd7-4bbe-8ee6-85627752c4e2 Sep 28 17:21:27 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:27 devstack sudo[100208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5844daaa-7a62-4624-8526-1ae669aead63 Sep 28 17:21:27 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:27 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-216ce2af-ade2-47a1-a5cd-00344365aa02 tempest-CreateVolumesFromImageTest-12436347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2113e623-9fd7-4bbe-8ee6-85627752c4e2" returned: 0 in 0.345s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:27 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-216ce2af-ade2-47a1-a5cd-00344365aa02 tempest-CreateVolumesFromImageTest-12436347 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:21:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-216ce2af-ade2-47a1-a5cd-00344365aa02 tempest-CreateVolumesFromImageTest-12436347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d9cf1aae-be1d-4e83-bdc1-6c687c845d05 tempest-CreateVolumesFromImageTest-12436347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.364s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:27 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d9cf1aae-be1d-4e83-bdc1-6c687c845d05 tempest-CreateVolumesFromImageTest-12436347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-502515487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff83d2a-d8f2-43b1-8bec-93d56b52980e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b5bbfdb13640c3b5156a106c653c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:24Z,use_quota=True,user_id='82b8ad4d5df44a938cc64dd44af8091f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:21:27 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-d9cf1aae-be1d-4e83-bdc1-6c687c845d05 tempest-CreateVolumesFromImageTest-12436347 None] Creating volume dff83d2a-d8f2-43b1-8bec-93d56b52980e {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:21:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d9cf1aae-be1d-4e83-bdc1-6c687c845d05 tempest-CreateVolumesFromImageTest-12436347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d9cf1aae-be1d-4e83-bdc1-6c687c845d05 tempest-CreateVolumesFromImageTest-12436347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:27 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d9cf1aae-be1d-4e83-bdc1-6c687c845d05 tempest-CreateVolumesFromImageTest-12436347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:27 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d9cf1aae-be1d-4e83-bdc1-6c687c845d05 tempest-CreateVolumesFromImageTest-12436347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d9cf1aae-be1d-4e83-bdc1-6c687c845d05 tempest-CreateVolumesFromImageTest-12436347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:27 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d9cf1aae-be1d-4e83-bdc1-6c687c845d05 tempest-CreateVolumesFromImageTest-12436347 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:21:27 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-d9cf1aae-be1d-4e83-bdc1-6c687c845d05 tempest-CreateVolumesFromImageTest-12436347 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:21:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d9cf1aae-be1d-4e83-bdc1-6c687c845d05 tempest-CreateVolumesFromImageTest-12436347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dff83d2a-d8f2-43b1-8bec-93d56b52980e 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:27 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b573c8da-f8a0-47d9-b664-cfdc9cc5390e tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5844daaa-7a62-4624-8526-1ae669aead63" returned: 0 in 0.408s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:27 devstack sudo[100214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dff83d2a-d8f2-43b1-8bec-93d56b52980e 1073741824 Sep 28 17:21:27 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:27 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-216ce2af-ade2-47a1-a5cd-00344365aa02 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58cee9fb-c845-431d-9b01-52d313714a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2113e623-9fd7-4bbe-8ee6-85627752c4e2', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:27 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-216ce2af-ade2-47a1-a5cd-00344365aa02 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (712456e1-0d8c-4613-b323-1ffcaa71ac85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b573c8da-f8a0-47d9-b664-cfdc9cc5390e tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-quobyte-5844daaa-7a62-4624-8526-1ae669aead63" released by "delete_volume" :: held 1.048s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:27 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-216ce2af-ade2-47a1-a5cd-00344365aa02 tempest-CreateVolumesFromImageTest-12436347 None] Volume volume-2113e623-9fd7-4bbe-8ee6-85627752c4e2 (2113e623-9fd7-4bbe-8ee6-85627752c4e2): created successfully Sep 28 17:21:27 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-216ce2af-ade2-47a1-a5cd-00344365aa02 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (712456e1-0d8c-4613-b323-1ffcaa71ac85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:27 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-216ce2af-ade2-47a1-a5cd-00344365aa02 tempest-CreateVolumesFromImageTest-12436347 None] Flow 'volume_create_manager' (a452cbd1-481d-45ac-954d-d1177344bc3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:27 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-216ce2af-ade2-47a1-a5cd-00344365aa02 tempest-CreateVolumesFromImageTest-12436347 None] Created volume successfully. Sep 28 17:21:27 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-b573c8da-f8a0-47d9-b664-cfdc9cc5390e tempest-VolumesSnapshotTestJSON-803354126 None] Created reservations ['9e55fb09-3afa-4aea-a73a-fa8b57e60cb6', 'b4851539-6574-43b9-9969-666cba47577d', '4596b72a-2617-4ff9-bb9b-fbea164db44e', 'a290e4c3-4494-4997-a080-a62f60740312'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b573c8da-f8a0-47d9-b664-cfdc9cc5390e tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b573c8da-f8a0-47d9-b664-cfdc9cc5390e tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:27 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b573c8da-f8a0-47d9-b664-cfdc9cc5390e tempest-VolumesSnapshotTestJSON-803354126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:27 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b573c8da-f8a0-47d9-b664-cfdc9cc5390e tempest-VolumesSnapshotTestJSON-803354126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b573c8da-f8a0-47d9-b664-cfdc9cc5390e tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b573c8da-f8a0-47d9-b664-cfdc9cc5390e tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:27 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:21:27 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:28 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b573c8da-f8a0-47d9-b664-cfdc9cc5390e tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.394s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:28 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-b573c8da-f8a0-47d9-b664-cfdc9cc5390e tempest-VolumesSnapshotTestJSON-803354126 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:28 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-b573c8da-f8a0-47d9-b664-cfdc9cc5390e tempest-VolumesSnapshotTestJSON-803354126 None] Deleted volume successfully. Sep 28 17:21:28 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d9cf1aae-be1d-4e83-bdc1-6c687c845d05 tempest-CreateVolumesFromImageTest-12436347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dff83d2a-d8f2-43b1-8bec-93d56b52980e 1073741824" returned: 0 in 0.794s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:28 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b573c8da-f8a0-47d9-b664-cfdc9cc5390e tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-5844daaa-7a62-4624-8526-1ae669aead63-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d9cf1aae-be1d-4e83-bdc1-6c687c845d05 tempest-CreateVolumesFromImageTest-12436347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dff83d2a-d8f2-43b1-8bec-93d56b52980e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:28 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dff83d2a-d8f2-43b1-8bec-93d56b52980e Sep 28 17:21:28 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:28 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d9cf1aae-be1d-4e83-bdc1-6c687c845d05 tempest-CreateVolumesFromImageTest-12436347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dff83d2a-d8f2-43b1-8bec-93d56b52980e" returned: 0 in 0.398s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:28 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d9cf1aae-be1d-4e83-bdc1-6c687c845d05 tempest-CreateVolumesFromImageTest-12436347 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:21:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d9cf1aae-be1d-4e83-bdc1-6c687c845d05 tempest-CreateVolumesFromImageTest-12436347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6424ce3b-b4f2-4458-9d66-9b3e8bc367cc tempest-CreateVolumesFromImageTest-12436347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.849s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:28 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6424ce3b-b4f2-4458-9d66-9b3e8bc367cc tempest-CreateVolumesFromImageTest-12436347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1104825313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d0410e7-257b-4c0a-a1a0-6f35cad15b60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b5bbfdb13640c3b5156a106c653c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:25Z,use_quota=True,user_id='82b8ad4d5df44a938cc64dd44af8091f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:21:28 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-6424ce3b-b4f2-4458-9d66-9b3e8bc367cc tempest-CreateVolumesFromImageTest-12436347 None] Creating volume 8d0410e7-257b-4c0a-a1a0-6f35cad15b60 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:21:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6424ce3b-b4f2-4458-9d66-9b3e8bc367cc tempest-CreateVolumesFromImageTest-12436347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6424ce3b-b4f2-4458-9d66-9b3e8bc367cc tempest-CreateVolumesFromImageTest-12436347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:28 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6424ce3b-b4f2-4458-9d66-9b3e8bc367cc tempest-CreateVolumesFromImageTest-12436347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:28 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6424ce3b-b4f2-4458-9d66-9b3e8bc367cc tempest-CreateVolumesFromImageTest-12436347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6424ce3b-b4f2-4458-9d66-9b3e8bc367cc tempest-CreateVolumesFromImageTest-12436347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:28 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6424ce3b-b4f2-4458-9d66-9b3e8bc367cc tempest-CreateVolumesFromImageTest-12436347 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:21:28 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-6424ce3b-b4f2-4458-9d66-9b3e8bc367cc tempest-CreateVolumesFromImageTest-12436347 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:21:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6424ce3b-b4f2-4458-9d66-9b3e8bc367cc tempest-CreateVolumesFromImageTest-12436347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8d0410e7-257b-4c0a-a1a0-6f35cad15b60 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:28 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d9cf1aae-be1d-4e83-bdc1-6c687c845d05 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eee08a3-7e09-41b8-b38c-883225b6e33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dff83d2a-d8f2-43b1-8bec-93d56b52980e', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:28 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8d0410e7-257b-4c0a-a1a0-6f35cad15b60 1073741824 Sep 28 17:21:28 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:28 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d9cf1aae-be1d-4e83-bdc1-6c687c845d05 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (866cd791-c4bc-4d20-ae05-ab470a198fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:28 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-d9cf1aae-be1d-4e83-bdc1-6c687c845d05 tempest-CreateVolumesFromImageTest-12436347 None] Volume volume-dff83d2a-d8f2-43b1-8bec-93d56b52980e (dff83d2a-d8f2-43b1-8bec-93d56b52980e): created successfully Sep 28 17:21:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d9cf1aae-be1d-4e83-bdc1-6c687c845d05 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (866cd791-c4bc-4d20-ae05-ab470a198fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d9cf1aae-be1d-4e83-bdc1-6c687c845d05 tempest-CreateVolumesFromImageTest-12436347 None] Flow 'volume_create_manager' (edc0d8f9-4171-49a1-b1fb-3a583e806526) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:29 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-d9cf1aae-be1d-4e83-bdc1-6c687c845d05 tempest-CreateVolumesFromImageTest-12436347 None] Created volume successfully. Sep 28 17:21:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-29abf377-06b1-40a5-a00b-93e661932ddf tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "cinder-9da91a05-1426-43b9-b8e4-899dc08991c3-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-29abf377-06b1-40a5-a00b-93e661932ddf tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-9da91a05-1426-43b9-b8e4-899dc08991c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-29abf377-06b1-40a5-a00b-93e661932ddf tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "cinder-quobyte-fb79ba0c-05f0-4e73-ae80-bced458d4385" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-29abf377-06b1-40a5-a00b-93e661932ddf tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-quobyte-fb79ba0c-05f0-4e73-ae80-bced458d4385" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-29abf377-06b1-40a5-a00b-93e661932ddf tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "cinder-quobyte-9da91a05-1426-43b9-b8e4-899dc08991c3" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-29abf377-06b1-40a5-a00b-93e661932ddf tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-quobyte-9da91a05-1426-43b9-b8e4-899dc08991c3" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-29abf377-06b1-40a5-a00b-93e661932ddf tempest-VolumesSnapshotTestJSON-803354126 None] Deleting offline snapshot 9da91a05-1426-43b9-b8e4-899dc08991c3 of volume fb79ba0c-05f0-4e73-ae80-bced458d4385 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:21:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-29abf377-06b1-40a5-a00b-93e661932ddf tempest-VolumesSnapshotTestJSON-803354126 None] snapshot_file for this snap is: volume-fb79ba0c-05f0-4e73-ae80-bced458d4385.9da91a05-1426-43b9-b8e4-899dc08991c3 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:21:29 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e654319-8722-4836-acfa-b78bebeb77b9]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-29abf377-06b1-40a5-a00b-93e661932ddf tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385.9da91a05-1426-43b9-b8e4-899dc08991c3 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:29 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:21:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Flow 'volume_create_manager' (705e9f4c-afd0-4310-b9da-6b32a3011ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d2aeb1-c5da-4357-afa8-bd625673308d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d2aeb1-c5da-4357-afa8-bd625673308d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3336558-ea2c-487e-9fa1-d5bf7b9422df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='956e50999ae8428d9eedb94d1c5eec08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:29Z,use_quota=True,user_id='1970ced9fa624f7ead084e7de7a6931b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5b7f4da-5b1d-4515-8ae8-23d3553a3c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5b7f4da-5b1d-4515-8ae8-23d3553a3c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:29 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385.9da91a05-1426-43b9-b8e4-899dc08991c3 Sep 28 17:21:29 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0fe9923-fa15-4a0a-8b81-52fa59c114cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:29 devstack cinder-volume[86917]: DEBUG cinder.image.glance [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Creating Keystone auth plugin from conf {{(pid=86917) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:21:29 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:29 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6424ce3b-b4f2-4458-9d66-9b3e8bc367cc tempest-CreateVolumesFromImageTest-12436347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8d0410e7-257b-4c0a-a1a0-6f35cad15b60 1073741824" returned: 0 in 0.991s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-29abf377-06b1-40a5-a00b-93e661932ddf tempest-VolumesSnapshotTestJSON-803354126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385.9da91a05-1426-43b9-b8e4-899dc08991c3" returned: 0 in 0.636s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-29abf377-06b1-40a5-a00b-93e661932ddf tempest-VolumesSnapshotTestJSON-803354126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb79ba0c-05f0-4e73-ae80-bced458d4385(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:21:29 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5599f6-35d0-48c6-ad0a-dc83f26192d9]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-29abf377-06b1-40a5-a00b-93e661932ddf tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6424ce3b-b4f2-4458-9d66-9b3e8bc367cc tempest-CreateVolumesFromImageTest-12436347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8d0410e7-257b-4c0a-a1a0-6f35cad15b60 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0fe9923-fa15-4a0a-8b81-52fa59c114cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f3336558-ea2c-487e-9fa1-d5bf7b9422df', 'volume_name': 'volume-f3336558-ea2c-487e-9fa1-d5bf7b9422df', 'volume_size': 1, 'image_id': 'c6745967-1710-44a8-b5c7-d13153aa134c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c6745967-1710-44a8-b5c7-d13153aa134c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8a98bdac125c6a3e0625679b2b42f6fc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '956e50999ae8428d9eedb94d1c5eec08', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a6c18abfd79fe0b2c192583a92afaef237f920faa445549892c7136a44276859462574c1677b16e6d565a1a7d2206858374b3dada02af86cef8ff3fb56360934', 'id': 'c6745967-1710-44a8-b5c7-d13153aa134c', 'created_at': datetime.datetime(2026, 9, 28, 15, 21, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 21, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c6745967-1710-44a8-b5c7-d13153aa134c/file', 'properties': {}}, 'image_service': }' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d321ab4-f002-4425-8400-74310a1b1942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d321ab4-f002-4425-8400-74310a1b1942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:30 devstack sudo[100241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8d0410e7-257b-4c0a-a1a0-6f35cad15b60 Sep 28 17:21:30 devstack sudo[100241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05549eab-4217-4a36-86c3-799dfaea19a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:30 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Volume f3336558-ea2c-487e-9fa1-d5bf7b9422df: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f3336558-ea2c-487e-9fa1-d5bf7b9422df', 'volume_size': 1, 'image_id': 'c6745967-1710-44a8-b5c7-d13153aa134c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c6745967-1710-44a8-b5c7-d13153aa134c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8a98bdac125c6a3e0625679b2b42f6fc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '956e50999ae8428d9eedb94d1c5eec08', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a6c18abfd79fe0b2c192583a92afaef237f920faa445549892c7136a44276859462574c1677b16e6d565a1a7d2206858374b3dada02af86cef8ff3fb56360934', 'id': 'c6745967-1710-44a8-b5c7-d13153aa134c', 'created_at': datetime.datetime(2026, 9, 28, 15, 21, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 21, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c6745967-1710-44a8-b5c7-d13153aa134c/file', 'properties': {}}, 'image_service': } Sep 28 17:21:30 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Trying to clone f3336558-ea2c-487e-9fa1-d5bf7b9422df from image c6745967-1710-44a8-b5c7-d13153aa134c at location (None, [{'url': 'file:///opt/stack/data/glance/images/c6745967-1710-44a8-b5c7-d13153aa134c', 'metadata': {}}]). {{(pid=86917) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:21:30 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385 Sep 28 17:21:30 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:30 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c6745967-1710-44a8-b5c7-d13153aa134c_25txw6rfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86917) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:21:30 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Image download 0.00 MB at 0.00 MB/s Sep 28 17:21:30 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d18eaf-6fb8-44b4-b045-53bda8c6f2bd]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c6745967-1710-44a8-b5c7-d13153aa134c_25txw6rfdevstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:30 devstack sudo[100241]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6424ce3b-b4f2-4458-9d66-9b3e8bc367cc tempest-CreateVolumesFromImageTest-12436347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8d0410e7-257b-4c0a-a1a0-6f35cad15b60" returned: 0 in 0.467s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:30 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6424ce3b-b4f2-4458-9d66-9b3e8bc367cc tempest-CreateVolumesFromImageTest-12436347 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:21:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6424ce3b-b4f2-4458-9d66-9b3e8bc367cc tempest-CreateVolumesFromImageTest-12436347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.676s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-71dfa402-6736-485e-bdbc-ca407a6bb9f1 tempest-CreateVolumesFromImageTest-12436347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.843s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:30 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-71dfa402-6736-485e-bdbc-ca407a6bb9f1 tempest-CreateVolumesFromImageTest-12436347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1217454110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=360794c0-f3ca-4fa6-80b4-70f9c574ebaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b5bbfdb13640c3b5156a106c653c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:25Z,use_quota=True,user_id='82b8ad4d5df44a938cc64dd44af8091f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:21:30 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-71dfa402-6736-485e-bdbc-ca407a6bb9f1 tempest-CreateVolumesFromImageTest-12436347 None] Creating volume 360794c0-f3ca-4fa6-80b4-70f9c574ebaa {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:21:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-71dfa402-6736-485e-bdbc-ca407a6bb9f1 tempest-CreateVolumesFromImageTest-12436347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-71dfa402-6736-485e-bdbc-ca407a6bb9f1 tempest-CreateVolumesFromImageTest-12436347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:30 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-71dfa402-6736-485e-bdbc-ca407a6bb9f1 tempest-CreateVolumesFromImageTest-12436347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:30 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-71dfa402-6736-485e-bdbc-ca407a6bb9f1 tempest-CreateVolumesFromImageTest-12436347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-71dfa402-6736-485e-bdbc-ca407a6bb9f1 tempest-CreateVolumesFromImageTest-12436347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:30 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-71dfa402-6736-485e-bdbc-ca407a6bb9f1 tempest-CreateVolumesFromImageTest-12436347 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:21:30 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-71dfa402-6736-485e-bdbc-ca407a6bb9f1 tempest-CreateVolumesFromImageTest-12436347 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:21:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-71dfa402-6736-485e-bdbc-ca407a6bb9f1 tempest-CreateVolumesFromImageTest-12436347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-360794c0-f3ca-4fa6-80b4-70f9c574ebaa 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6424ce3b-b4f2-4458-9d66-9b3e8bc367cc tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b57148d5-77b9-4029-bbf8-9eebbf8202d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d0410e7-257b-4c0a-a1a0-6f35cad15b60', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:30 devstack sudo[100256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-360794c0-f3ca-4fa6-80b4-70f9c574ebaa 1073741824 Sep 28 17:21:30 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6424ce3b-b4f2-4458-9d66-9b3e8bc367cc tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3885756-c4c8-41ea-a012-eca36565b207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:30 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c6745967-1710-44a8-b5c7-d13153aa134c_25txw6rfdevstack@QuobyteHD Sep 28 17:21:30 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:30 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-6424ce3b-b4f2-4458-9d66-9b3e8bc367cc tempest-CreateVolumesFromImageTest-12436347 None] Volume volume-8d0410e7-257b-4c0a-a1a0-6f35cad15b60 (8d0410e7-257b-4c0a-a1a0-6f35cad15b60): created successfully Sep 28 17:21:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6424ce3b-b4f2-4458-9d66-9b3e8bc367cc tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3885756-c4c8-41ea-a012-eca36565b207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6424ce3b-b4f2-4458-9d66-9b3e8bc367cc tempest-CreateVolumesFromImageTest-12436347 None] Flow 'volume_create_manager' (3662706e-aed5-4b7b-8adf-6016ee13ba97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:30 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-6424ce3b-b4f2-4458-9d66-9b3e8bc367cc tempest-CreateVolumesFromImageTest-12436347 None] Created volume successfully. Sep 28 17:21:30 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c6745967-1710-44a8-b5c7-d13153aa134c_25txw6rfdevstack@QuobyteHD" returned: 0 in 0.484s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c6745967-1710-44a8-b5c7-d13153aa134c_25txw6rfdevstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:31 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-29abf377-06b1-40a5-a00b-93e661932ddf tempest-VolumesSnapshotTestJSON-803354126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385" returned: 0 in 1.081s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-29abf377-06b1-40a5-a00b-93e661932ddf tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385.9da91a05-1426-43b9-b8e4-899dc08991c3 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:31 devstack sudo[100276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385.9da91a05-1426-43b9-b8e4-899dc08991c3 Sep 28 17:21:31 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:31 devstack sudo[100275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c6745967-1710-44a8-b5c7-d13153aa134c_25txw6rfdevstack@QuobyteHD Sep 28 17:21:31 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:31 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-71dfa402-6736-485e-bdbc-ca407a6bb9f1 tempest-CreateVolumesFromImageTest-12436347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-360794c0-f3ca-4fa6-80b4-70f9c574ebaa 1073741824" returned: 0 in 0.913s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-71dfa402-6736-485e-bdbc-ca407a6bb9f1 tempest-CreateVolumesFromImageTest-12436347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-360794c0-f3ca-4fa6-80b4-70f9c574ebaa {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:31 devstack sudo[100282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-360794c0-f3ca-4fa6-80b4-70f9c574ebaa Sep 28 17:21:31 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:31 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c6745967-1710-44a8-b5c7-d13153aa134c_25txw6rfdevstack@QuobyteHD" returned: 1 in 0.674s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c6745967-1710-44a8-b5c7-d13153aa134c_25txw6rfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:21:31 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Temporary image c6745967-1710-44a8-b5c7-d13153aa134c is fetched for user 1970ced9fa624f7ead084e7de7a6931b. {{(pid=86917) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:21:31 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-29abf377-06b1-40a5-a00b-93e661932ddf tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385.9da91a05-1426-43b9-b8e4-899dc08991c3" returned: 0 in 0.638s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-29abf377-06b1-40a5-a00b-93e661932ddf tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385.9da91a05-1426-43b9-b8e4-899dc08991c3 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:31 devstack sudo[100287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385.9da91a05-1426-43b9-b8e4-899dc08991c3 Sep 28 17:21:31 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:31 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a6c3b8-7dd0-4962-9d33-f0bc7eeeb090]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c6745967-1710-44a8-b5c7-d13153aa134c_25txw6rfdevstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:31 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-71dfa402-6736-485e-bdbc-ca407a6bb9f1 tempest-CreateVolumesFromImageTest-12436347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-360794c0-f3ca-4fa6-80b4-70f9c574ebaa" returned: 0 in 0.351s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-71dfa402-6736-485e-bdbc-ca407a6bb9f1 tempest-CreateVolumesFromImageTest-12436347 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:21:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-71dfa402-6736-485e-bdbc-ca407a6bb9f1 tempest-CreateVolumesFromImageTest-12436347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.369s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:31 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-71dfa402-6736-485e-bdbc-ca407a6bb9f1 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f51294c6-f708-4411-b27c-3d96a2ee1e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-360794c0-f3ca-4fa6-80b4-70f9c574ebaa', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:31 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-71dfa402-6736-485e-bdbc-ca407a6bb9f1 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd20f686-9513-4b68-b598-ea679ca3b1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:31 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-71dfa402-6736-485e-bdbc-ca407a6bb9f1 tempest-CreateVolumesFromImageTest-12436347 None] Volume volume-360794c0-f3ca-4fa6-80b4-70f9c574ebaa (360794c0-f3ca-4fa6-80b4-70f9c574ebaa): created successfully Sep 28 17:21:31 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-71dfa402-6736-485e-bdbc-ca407a6bb9f1 tempest-CreateVolumesFromImageTest-12436347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd20f686-9513-4b68-b598-ea679ca3b1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:31 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c6745967-1710-44a8-b5c7-d13153aa134c_25txw6rfdevstack@QuobyteHD Sep 28 17:21:31 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:31 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-71dfa402-6736-485e-bdbc-ca407a6bb9f1 tempest-CreateVolumesFromImageTest-12436347 None] Flow 'volume_create_manager' (9642c824-b018-4aea-aef5-91e1a8000a15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:31 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-71dfa402-6736-485e-bdbc-ca407a6bb9f1 tempest-CreateVolumesFromImageTest-12436347 None] Created volume successfully. Sep 28 17:21:32 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-29abf377-06b1-40a5-a00b-93e661932ddf tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385.9da91a05-1426-43b9-b8e4-899dc08991c3" returned: 0 in 0.327s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-29abf377-06b1-40a5-a00b-93e661932ddf tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-quobyte-9da91a05-1426-43b9-b8e4-899dc08991c3" released by "_delete_snapshot" :: held 2.873s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-29abf377-06b1-40a5-a00b-93e661932ddf tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-quobyte-fb79ba0c-05f0-4e73-ae80-bced458d4385" released by "delete_snapshot" :: held 2.911s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:32 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-29abf377-06b1-40a5-a00b-93e661932ddf tempest-VolumesSnapshotTestJSON-803354126 None] Created reservations ['72470430-ce1c-43ec-982b-669b3e15af7d', '03fca462-8e6c-4854-b26f-89bad9892dec', '0036fa42-d834-4747-8e1e-f7be11bec661', 'fc7d70f2-d382-4d4a-a26d-e9ba612d2d81'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:32 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-29abf377-06b1-40a5-a00b-93e661932ddf tempest-VolumesSnapshotTestJSON-803354126 None] Delete snapshot completed successfully. Sep 28 17:21:32 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c6745967-1710-44a8-b5c7-d13153aa134c_25txw6rfdevstack@QuobyteHD" returned: 0 in 0.436s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c6745967-1710-44a8-b5c7-d13153aa134c_25txw6rfdevstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-29abf377-06b1-40a5-a00b-93e661932ddf tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-9da91a05-1426-43b9-b8e4-899dc08991c3-delete_snapshot" released by "delete_snapshot" :: held 3.129s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c5383e9a-e960-49e7-a7e7-cd3384dc15f4 tempest-CreateVolumesFromImageTest-12436347 None] Acquiring lock "cinder-360794c0-f3ca-4fa6-80b4-70f9c574ebaa-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c5383e9a-e960-49e7-a7e7-cd3384dc15f4 tempest-CreateVolumesFromImageTest-12436347 None] Lock "cinder-360794c0-f3ca-4fa6-80b4-70f9c574ebaa-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c5383e9a-e960-49e7-a7e7-cd3384dc15f4 tempest-CreateVolumesFromImageTest-12436347 None] Acquiring lock "cinder-quobyte-360794c0-f3ca-4fa6-80b4-70f9c574ebaa" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:32 devstack sudo[100295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c6745967-1710-44a8-b5c7-d13153aa134c_25txw6rfdevstack@QuobyteHD Sep 28 17:21:32 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c5383e9a-e960-49e7-a7e7-cd3384dc15f4 tempest-CreateVolumesFromImageTest-12436347 None] Lock "cinder-quobyte-360794c0-f3ca-4fa6-80b4-70f9c574ebaa" acquired by "delete_volume" :: waited 0.033s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:32 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4933f586-2bb3-446e-b020-6bace6b3cc6d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c5383e9a-e960-49e7-a7e7-cd3384dc15f4 tempest-CreateVolumesFromImageTest-12436347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-360794c0-f3ca-4fa6-80b4-70f9c574ebaa {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a41bcd92-50f6-4c01-9ff6-b88ecf778e70 tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "cinder-fb79ba0c-05f0-4e73-ae80-bced458d4385-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a41bcd92-50f6-4c01-9ff6-b88ecf778e70 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-fb79ba0c-05f0-4e73-ae80-bced458d4385-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:32 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=116,cinder:INSERT=26,cinder:UPDATE=127,cinder:DELETE=10 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:21:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a41bcd92-50f6-4c01-9ff6-b88ecf778e70 tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "cinder-quobyte-fb79ba0c-05f0-4e73-ae80-bced458d4385" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a41bcd92-50f6-4c01-9ff6-b88ecf778e70 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-quobyte-fb79ba0c-05f0-4e73-ae80-bced458d4385" acquired by "delete_volume" :: waited 0.021s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:32 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c6745967-1710-44a8-b5c7-d13153aa134c_25txw6rfdevstack@QuobyteHD" returned: 1 in 0.524s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c6745967-1710-44a8-b5c7-d13153aa134c_25txw6rfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:21:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:32 devstack sudo[100297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-360794c0-f3ca-4fa6-80b4-70f9c574ebaa Sep 28 17:21:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3336558-ea2c-487e-9fa1-d5bf7b9422df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='956e50999ae8428d9eedb94d1c5eec08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:29Z,use_quota=True,user_id='1970ced9fa624f7ead084e7de7a6931b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:21:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Creating volume f3336558-ea2c-487e-9fa1-d5bf7b9422df {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:21:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:32 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:21:32 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:21:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f3336558-ea2c-487e-9fa1-d5bf7b9422df 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:32 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f389c599-55f5-4635-9b3b-2922020982af]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a41bcd92-50f6-4c01-9ff6-b88ecf778e70 tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:32 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f3336558-ea2c-487e-9fa1-d5bf7b9422df 1073741824 Sep 28 17:21:32 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:32 devstack sudo[100303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385 Sep 28 17:21:32 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:33 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c5383e9a-e960-49e7-a7e7-cd3384dc15f4 tempest-CreateVolumesFromImageTest-12436347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-360794c0-f3ca-4fa6-80b4-70f9c574ebaa" returned: 0 in 0.640s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c5383e9a-e960-49e7-a7e7-cd3384dc15f4 tempest-CreateVolumesFromImageTest-12436347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-360794c0-f3ca-4fa6-80b4-70f9c574ebaa {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:33 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-360794c0-f3ca-4fa6-80b4-70f9c574ebaa Sep 28 17:21:33 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:33 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a41bcd92-50f6-4c01-9ff6-b88ecf778e70 tempest-VolumesSnapshotTestJSON-803354126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385" returned: 0 in 0.571s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a41bcd92-50f6-4c01-9ff6-b88ecf778e70 tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:33 devstack sudo[100320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385 Sep 28 17:21:33 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:33 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f3336558-ea2c-487e-9fa1-d5bf7b9422df 1073741824" returned: 0 in 0.642s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f3336558-ea2c-487e-9fa1-d5bf7b9422df {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:33 devstack sudo[100322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f3336558-ea2c-487e-9fa1-d5bf7b9422df Sep 28 17:21:33 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:33 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c5383e9a-e960-49e7-a7e7-cd3384dc15f4 tempest-CreateVolumesFromImageTest-12436347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-360794c0-f3ca-4fa6-80b4-70f9c574ebaa" returned: 0 in 0.417s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:33 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c5383e9a-e960-49e7-a7e7-cd3384dc15f4 tempest-CreateVolumesFromImageTest-12436347 None] Lock "cinder-quobyte-360794c0-f3ca-4fa6-80b4-70f9c574ebaa" released by "delete_volume" :: held 1.132s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:33 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-c5383e9a-e960-49e7-a7e7-cd3384dc15f4 tempest-CreateVolumesFromImageTest-12436347 None] Created reservations ['df5b3d01-099f-48fc-a602-80d98af338a0', '3a13c3ba-61eb-4fc7-8f24-6b008fe02488', '36ce290a-6ffd-421c-9d63-5dd0cad7b756', 'e88cce6c-92a8-4bba-a8b9-cbe24f5a482f'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:33 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a41bcd92-50f6-4c01-9ff6-b88ecf778e70 tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb79ba0c-05f0-4e73-ae80-bced458d4385" returned: 0 in 0.353s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:33 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a41bcd92-50f6-4c01-9ff6-b88ecf778e70 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-quobyte-fb79ba0c-05f0-4e73-ae80-bced458d4385" released by "delete_volume" :: held 1.054s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:33 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f3336558-ea2c-487e-9fa1-d5bf7b9422df" returned: 0 in 0.370s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:33 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:21:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c5383e9a-e960-49e7-a7e7-cd3384dc15f4 tempest-CreateVolumesFromImageTest-12436347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c5383e9a-e960-49e7-a7e7-cd3384dc15f4 tempest-CreateVolumesFromImageTest-12436347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:33 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c5383e9a-e960-49e7-a7e7-cd3384dc15f4 tempest-CreateVolumesFromImageTest-12436347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:33 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c5383e9a-e960-49e7-a7e7-cd3384dc15f4 tempest-CreateVolumesFromImageTest-12436347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c5383e9a-e960-49e7-a7e7-cd3384dc15f4 tempest-CreateVolumesFromImageTest-12436347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c5383e9a-e960-49e7-a7e7-cd3384dc15f4 tempest-CreateVolumesFromImageTest-12436347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:33 devstack sudo[100327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:21:33 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:33 devstack cinder-volume[86917]: DEBUG cinder.volume.volume_utils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Attempting download of c6745967-1710-44a8-b5c7-d13153aa134c ((None, [{'url': 'file:///opt/stack/data/glance/images/c6745967-1710-44a8-b5c7-d13153aa134c', 'metadata': {}}])) to volume f3336558-ea2c-487e-9fa1-d5bf7b9422df. {{(pid=86917) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:21:33 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-a41bcd92-50f6-4c01-9ff6-b88ecf778e70 tempest-VolumesSnapshotTestJSON-803354126 None] Created reservations ['23649bab-0a3e-4a6a-818d-8ceb8aa79fae', '87c2248e-50dd-42c3-a945-1eeef8747a1f', '538d11c4-170c-41c3-9061-0d39fe3f9647', '00d91485-fa22-4197-8e4a-cfb509640372'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:34 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[20965a54-e1f5-46ff-81d0-2259e73a2da9]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c6745967-1710-44a8-b5c7-d13153aa134c_tkog3_96 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a41bcd92-50f6-4c01-9ff6-b88ecf778e70 tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a41bcd92-50f6-4c01-9ff6-b88ecf778e70 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:34 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a41bcd92-50f6-4c01-9ff6-b88ecf778e70 tempest-VolumesSnapshotTestJSON-803354126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:34 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a41bcd92-50f6-4c01-9ff6-b88ecf778e70 tempest-VolumesSnapshotTestJSON-803354126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a41bcd92-50f6-4c01-9ff6-b88ecf778e70 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a41bcd92-50f6-4c01-9ff6-b88ecf778e70 tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:34 devstack sudo[100329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c6745967-1710-44a8-b5c7-d13153aa134c_tkog3_96 Sep 28 17:21:34 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:34 devstack sudo[100334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:21:34 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:34 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c5383e9a-e960-49e7-a7e7-cd3384dc15f4 tempest-CreateVolumesFromImageTest-12436347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.503s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:34 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-c5383e9a-e960-49e7-a7e7-cd3384dc15f4 tempest-CreateVolumesFromImageTest-12436347 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:34 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-c5383e9a-e960-49e7-a7e7-cd3384dc15f4 tempest-CreateVolumesFromImageTest-12436347 None] Deleted volume successfully. Sep 28 17:21:34 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c5383e9a-e960-49e7-a7e7-cd3384dc15f4 tempest-CreateVolumesFromImageTest-12436347 None] Lock "cinder-360794c0-f3ca-4fa6-80b4-70f9c574ebaa-delete_volume" released by "delete_volume" :: held 2.082s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:34 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-aedf3d23-61cd-46e1-a3fd-a3a2fcd1c4c6 tempest-CreateVolumesFromImageTest-12436347 None] Acquiring lock "cinder-8d0410e7-257b-4c0a-a1a0-6f35cad15b60-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:34 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-aedf3d23-61cd-46e1-a3fd-a3a2fcd1c4c6 tempest-CreateVolumesFromImageTest-12436347 None] Lock "cinder-8d0410e7-257b-4c0a-a1a0-6f35cad15b60-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:34 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a41bcd92-50f6-4c01-9ff6-b88ecf778e70 tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.661s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:34 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-a41bcd92-50f6-4c01-9ff6-b88ecf778e70 tempest-VolumesSnapshotTestJSON-803354126 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:34 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-a41bcd92-50f6-4c01-9ff6-b88ecf778e70 tempest-VolumesSnapshotTestJSON-803354126 None] Deleted volume successfully. Sep 28 17:21:34 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-aedf3d23-61cd-46e1-a3fd-a3a2fcd1c4c6 tempest-CreateVolumesFromImageTest-12436347 None] Acquiring lock "cinder-quobyte-8d0410e7-257b-4c0a-a1a0-6f35cad15b60" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:34 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a41bcd92-50f6-4c01-9ff6-b88ecf778e70 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-fb79ba0c-05f0-4e73-ae80-bced458d4385-delete_volume" released by "delete_volume" :: held 2.358s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:35 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-aedf3d23-61cd-46e1-a3fd-a3a2fcd1c4c6 tempest-CreateVolumesFromImageTest-12436347 None] Lock "cinder-quobyte-8d0410e7-257b-4c0a-a1a0-6f35cad15b60" acquired by "delete_volume" :: waited 0.056s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:35 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c6745967-1710-44a8-b5c7-d13153aa134c_tkog3_96" returned: 0 in 1.049s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c6745967-1710-44a8-b5c7-d13153aa134c_tkog3_96 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:35 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6449962d-c281-455b-b89a-8d10a038a731]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-aedf3d23-61cd-46e1-a3fd-a3a2fcd1c4c6 tempest-CreateVolumesFromImageTest-12436347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8d0410e7-257b-4c0a-a1a0-6f35cad15b60 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:35 devstack sudo[100375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8d0410e7-257b-4c0a-a1a0-6f35cad15b60 Sep 28 17:21:35 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:35 devstack sudo[100374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c6745967-1710-44a8-b5c7-d13153aa134c_tkog3_96 Sep 28 17:21:35 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:35 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c6745967-1710-44a8-b5c7-d13153aa134c_tkog3_96" returned: 1 in 0.815s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c6745967-1710-44a8-b5c7-d13153aa134c_tkog3_96' failed. Not Retrying. {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:21:35 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8033b6b-b552-4f85-b9eb-3fd6f783f95f]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c6745967-1710-44a8-b5c7-d13153aa134c_25txw6rfdevstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:35 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-aedf3d23-61cd-46e1-a3fd-a3a2fcd1c4c6 tempest-CreateVolumesFromImageTest-12436347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8d0410e7-257b-4c0a-a1a0-6f35cad15b60" returned: 0 in 0.830s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-aedf3d23-61cd-46e1-a3fd-a3a2fcd1c4c6 tempest-CreateVolumesFromImageTest-12436347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8d0410e7-257b-4c0a-a1a0-6f35cad15b60 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:35 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8d0410e7-257b-4c0a-a1a0-6f35cad15b60 Sep 28 17:21:35 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:36 devstack sudo[100405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c6745967-1710-44a8-b5c7-d13153aa134c_25txw6rfdevstack@QuobyteHD Sep 28 17:21:36 devstack sudo[100405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:36 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-aedf3d23-61cd-46e1-a3fd-a3a2fcd1c4c6 tempest-CreateVolumesFromImageTest-12436347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8d0410e7-257b-4c0a-a1a0-6f35cad15b60" returned: 0 in 0.533s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-aedf3d23-61cd-46e1-a3fd-a3a2fcd1c4c6 tempest-CreateVolumesFromImageTest-12436347 None] Lock "cinder-quobyte-8d0410e7-257b-4c0a-a1a0-6f35cad15b60" released by "delete_volume" :: held 1.471s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=118,cinder:INSERT=38,cinder:UPDATE=135,cinder:DELETE=12 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b9b88a7-45f5-42e9-a0a6-4b6e58a3b3d3 tempest-VolumesSnapshotTestJSON-803354126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3b9b88a7-45f5-42e9-a0a6-4b6e58a3b3d3 tempest-VolumesSnapshotTestJSON-803354126 None] Flow 'volume_create_manager' (79be325a-55a4-4c81-8734-6c8f5d1242a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3b9b88a7-45f5-42e9-a0a6-4b6e58a3b3d3 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff8a40eb-5ac0-4754-b7ee-d658d144a9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:36 devstack sudo[100405]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c6745967-1710-44a8-b5c7-d13153aa134c_25txw6rfdevstack@QuobyteHD" returned: 0 in 0.685s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c6745967-1710-44a8-b5c7-d13153aa134c_25txw6rfdevstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3b9b88a7-45f5-42e9-a0a6-4b6e58a3b3d3 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff8a40eb-5ac0-4754-b7ee-d658d144a9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1422810295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f755ea3a-67f5-4662-a7db-534620bcc260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daababf0069a4500946ef3bd106e2e19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:36Z,use_quota=True,user_id='3b4641fc2a6e4cf592a96014ad60aeb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3b9b88a7-45f5-42e9-a0a6-4b6e58a3b3d3 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad730714-a03e-40a6-93a0-e3f765c96038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3b9b88a7-45f5-42e9-a0a6-4b6e58a3b3d3 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad730714-a03e-40a6-93a0-e3f765c96038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3b9b88a7-45f5-42e9-a0a6-4b6e58a3b3d3 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c64b08d8-747f-4c21-87e6-d175dc68099f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3b9b88a7-45f5-42e9-a0a6-4b6e58a3b3d3 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c64b08d8-747f-4c21-87e6-d175dc68099f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f755ea3a-67f5-4662-a7db-534620bcc260', 'volume_name': 'volume-f755ea3a-67f5-4662-a7db-534620bcc260', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3b9b88a7-45f5-42e9-a0a6-4b6e58a3b3d3 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbb5a518-daae-4e90-9f15-bef6d581012e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3b9b88a7-45f5-42e9-a0a6-4b6e58a3b3d3 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbb5a518-daae-4e90-9f15-bef6d581012e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3b9b88a7-45f5-42e9-a0a6-4b6e58a3b3d3 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64b730ae-e6dd-4a53-bbdf-80c64727e3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:36 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-3b9b88a7-45f5-42e9-a0a6-4b6e58a3b3d3 tempest-VolumesSnapshotTestJSON-803354126 None] Volume f755ea3a-67f5-4662-a7db-534620bcc260: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f755ea3a-67f5-4662-a7db-534620bcc260', 'volume_size': 1} Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3b9b88a7-45f5-42e9-a0a6-4b6e58a3b3d3 tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3b9b88a7-45f5-42e9-a0a6-4b6e58a3b3d3 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-3b9b88a7-45f5-42e9-a0a6-4b6e58a3b3d3 tempest-VolumesSnapshotTestJSON-803354126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1422810295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f755ea3a-67f5-4662-a7db-534620bcc260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daababf0069a4500946ef3bd106e2e19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:36Z,use_quota=True,user_id='3b4641fc2a6e4cf592a96014ad60aeb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-3b9b88a7-45f5-42e9-a0a6-4b6e58a3b3d3 tempest-VolumesSnapshotTestJSON-803354126 None] Creating volume f755ea3a-67f5-4662-a7db-534620bcc260 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3b9b88a7-45f5-42e9-a0a6-4b6e58a3b3d3 tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3b9b88a7-45f5-42e9-a0a6-4b6e58a3b3d3 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-3b9b88a7-45f5-42e9-a0a6-4b6e58a3b3d3 tempest-VolumesSnapshotTestJSON-803354126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-3b9b88a7-45f5-42e9-a0a6-4b6e58a3b3d3 tempest-VolumesSnapshotTestJSON-803354126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3b9b88a7-45f5-42e9-a0a6-4b6e58a3b3d3 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-3b9b88a7-45f5-42e9-a0a6-4b6e58a3b3d3 tempest-VolumesSnapshotTestJSON-803354126 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:21:36 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-3b9b88a7-45f5-42e9-a0a6-4b6e58a3b3d3 tempest-VolumesSnapshotTestJSON-803354126 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3b9b88a7-45f5-42e9-a0a6-4b6e58a3b3d3 tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:36 devstack sudo[100433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c6745967-1710-44a8-b5c7-d13153aa134c_25txw6rfdevstack@QuobyteHD Sep 28 17:21:36 devstack sudo[100433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:36 devstack sudo[100435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260 1073741824 Sep 28 17:21:36 devstack sudo[100435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-aedf3d23-61cd-46e1-a3fd-a3a2fcd1c4c6 tempest-CreateVolumesFromImageTest-12436347 None] Created reservations ['f3a31cd8-1b9e-4f57-a8ec-2a4de61f659d', 'ef7d1963-9dd8-43c7-ab97-a341a2100892', '624f8b53-8e73-452d-9932-84eab0ae67fc', '2f423241-9d8e-4314-b121-fbfb8d1812a3'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-aedf3d23-61cd-46e1-a3fd-a3a2fcd1c4c6 tempest-CreateVolumesFromImageTest-12436347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-aedf3d23-61cd-46e1-a3fd-a3a2fcd1c4c6 tempest-CreateVolumesFromImageTest-12436347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-aedf3d23-61cd-46e1-a3fd-a3a2fcd1c4c6 tempest-CreateVolumesFromImageTest-12436347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-aedf3d23-61cd-46e1-a3fd-a3a2fcd1c4c6 tempest-CreateVolumesFromImageTest-12436347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-aedf3d23-61cd-46e1-a3fd-a3a2fcd1c4c6 tempest-CreateVolumesFromImageTest-12436347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-aedf3d23-61cd-46e1-a3fd-a3a2fcd1c4c6 tempest-CreateVolumesFromImageTest-12436347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:36 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:21:36 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:36 devstack sudo[100433]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c6745967-1710-44a8-b5c7-d13153aa134c_25txw6rfdevstack@QuobyteHD" returned: 1 in 0.417s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c6745967-1710-44a8-b5c7-d13153aa134c_25txw6rfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:21:36 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] c6745967-1710-44a8-b5c7-d13153aa134c was raw, converting to qcow2 {{(pid=86917) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:21:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c6745967-1710-44a8-b5c7-d13153aa134c_25txw6rfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f3336558-ea2c-487e-9fa1-d5bf7b9422df {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:37 devstack sudo[100445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c6745967-1710-44a8-b5c7-d13153aa134c_25txw6rfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f3336558-ea2c-487e-9fa1-d5bf7b9422df Sep 28 17:21:37 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:37 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-aedf3d23-61cd-46e1-a3fd-a3a2fcd1c4c6 tempest-CreateVolumesFromImageTest-12436347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.358s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:37 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-aedf3d23-61cd-46e1-a3fd-a3a2fcd1c4c6 tempest-CreateVolumesFromImageTest-12436347 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:37 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-aedf3d23-61cd-46e1-a3fd-a3a2fcd1c4c6 tempest-CreateVolumesFromImageTest-12436347 None] Deleted volume successfully. Sep 28 17:21:37 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-aedf3d23-61cd-46e1-a3fd-a3a2fcd1c4c6 tempest-CreateVolumesFromImageTest-12436347 None] Lock "cinder-8d0410e7-257b-4c0a-a1a0-6f35cad15b60-delete_volume" released by "delete_volume" :: held 2.494s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:37 devstack sudo[100435]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3b9b88a7-45f5-42e9-a0a6-4b6e58a3b3d3 tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260 1073741824" returned: 0 in 0.711s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:37 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d104f710-acf3-4338-baca-5a167315a5d8 tempest-CreateVolumesFromImageTest-12436347 None] Acquiring lock "cinder-dff83d2a-d8f2-43b1-8bec-93d56b52980e-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:37 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d104f710-acf3-4338-baca-5a167315a5d8 tempest-CreateVolumesFromImageTest-12436347 None] Lock "cinder-dff83d2a-d8f2-43b1-8bec-93d56b52980e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3b9b88a7-45f5-42e9-a0a6-4b6e58a3b3d3 tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:37 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d104f710-acf3-4338-baca-5a167315a5d8 tempest-CreateVolumesFromImageTest-12436347 None] Acquiring lock "cinder-quobyte-dff83d2a-d8f2-43b1-8bec-93d56b52980e" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:37 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260 Sep 28 17:21:37 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:37 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d104f710-acf3-4338-baca-5a167315a5d8 tempest-CreateVolumesFromImageTest-12436347 None] Lock "cinder-quobyte-dff83d2a-d8f2-43b1-8bec-93d56b52980e" acquired by "delete_volume" :: waited 0.019s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:37 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f69a032-2c5f-48f9-a3a5-64ba6febb04f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d104f710-acf3-4338-baca-5a167315a5d8 tempest-CreateVolumesFromImageTest-12436347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dff83d2a-d8f2-43b1-8bec-93d56b52980e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:37 devstack sudo[100455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dff83d2a-d8f2-43b1-8bec-93d56b52980e Sep 28 17:21:37 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:37 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c6745967-1710-44a8-b5c7-d13153aa134c_25txw6rfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f3336558-ea2c-487e-9fa1-d5bf7b9422df" returned: 0 in 0.874s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:37 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c6745967-1710-44a8-b5c7-d13153aa134c_25txw6rfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f3336558-ea2c-487e-9fa1-d5bf7b9422df {{(pid=86917) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:21:37 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 17:21:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f3336558-ea2c-487e-9fa1-d5bf7b9422df 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:37 devstack sudo[100459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f3336558-ea2c-487e-9fa1-d5bf7b9422df 1G Sep 28 17:21:37 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:38 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3b9b88a7-45f5-42e9-a0a6-4b6e58a3b3d3 tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260" returned: 0 in 0.758s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:38 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-3b9b88a7-45f5-42e9-a0a6-4b6e58a3b3d3 tempest-VolumesSnapshotTestJSON-803354126 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:21:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3b9b88a7-45f5-42e9-a0a6-4b6e58a3b3d3 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:38 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3b9b88a7-45f5-42e9-a0a6-4b6e58a3b3d3 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64b730ae-e6dd-4a53-bbdf-80c64727e3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f755ea3a-67f5-4662-a7db-534620bcc260', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3b9b88a7-45f5-42e9-a0a6-4b6e58a3b3d3 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff849ac9-f65e-4ce6-bf2d-0a80d2438414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d104f710-acf3-4338-baca-5a167315a5d8 tempest-CreateVolumesFromImageTest-12436347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dff83d2a-d8f2-43b1-8bec-93d56b52980e" returned: 0 in 0.706s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d104f710-acf3-4338-baca-5a167315a5d8 tempest-CreateVolumesFromImageTest-12436347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dff83d2a-d8f2-43b1-8bec-93d56b52980e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:38 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-3b9b88a7-45f5-42e9-a0a6-4b6e58a3b3d3 tempest-VolumesSnapshotTestJSON-803354126 None] Volume volume-f755ea3a-67f5-4662-a7db-534620bcc260 (f755ea3a-67f5-4662-a7db-534620bcc260): created successfully Sep 28 17:21:38 devstack sudo[100467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dff83d2a-d8f2-43b1-8bec-93d56b52980e Sep 28 17:21:38 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3b9b88a7-45f5-42e9-a0a6-4b6e58a3b3d3 tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff849ac9-f65e-4ce6-bf2d-0a80d2438414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3b9b88a7-45f5-42e9-a0a6-4b6e58a3b3d3 tempest-VolumesSnapshotTestJSON-803354126 None] Flow 'volume_create_manager' (79be325a-55a4-4c81-8734-6c8f5d1242a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:38 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-3b9b88a7-45f5-42e9-a0a6-4b6e58a3b3d3 tempest-VolumesSnapshotTestJSON-803354126 None] Created volume successfully. Sep 28 17:21:38 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f3336558-ea2c-487e-9fa1-d5bf7b9422df 1G" returned: 0 in 0.769s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:38 devstack cinder-volume[86917]: DEBUG cinder.volume.volume_utils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Downloaded image c6745967-1710-44a8-b5c7-d13153aa134c ((None, [{'url': 'file:///opt/stack/data/glance/images/c6745967-1710-44a8-b5c7-d13153aa134c', 'metadata': {}}])) to volume f3336558-ea2c-487e-9fa1-d5bf7b9422df successfully. {{(pid=86917) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:21:38 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Temporary image c6745967-1710-44a8-b5c7-d13153aa134c for user 1970ced9fa624f7ead084e7de7a6931b is deleted. {{(pid=86917) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:21:38 devstack cinder-volume[86917]: DEBUG cinder.volume.volume_utils [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Marking volume f3336558-ea2c-487e-9fa1-d5bf7b9422df as bootable. {{(pid=86917) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:21:38 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Copying metadata from image c6745967-1710-44a8-b5c7-d13153aa134c to f3336558-ea2c-487e-9fa1-d5bf7b9422df. {{(pid=86917) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:21:38 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Creating volume glance metadata for volume f3336558-ea2c-487e-9fa1-d5bf7b9422df backed by image c6745967-1710-44a8-b5c7-d13153aa134c with: {'image_id': 'c6745967-1710-44a8-b5c7-d13153aa134c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '8a98bdac125c6a3e0625679b2b42f6fc', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86917) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:21:38 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05549eab-4217-4a36-86c3-799dfaea19a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3336558-ea2c-487e-9fa1-d5bf7b9422df', 'volume_size': 1, 'image_id': 'c6745967-1710-44a8-b5c7-d13153aa134c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c6745967-1710-44a8-b5c7-d13153aa134c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8a98bdac125c6a3e0625679b2b42f6fc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '956e50999ae8428d9eedb94d1c5eec08', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a6c18abfd79fe0b2c192583a92afaef237f920faa445549892c7136a44276859462574c1677b16e6d565a1a7d2206858374b3dada02af86cef8ff3fb56360934', 'id': 'c6745967-1710-44a8-b5c7-d13153aa134c', 'created_at': datetime.datetime(2026, 9, 28, 15, 21, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 21, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c6745967-1710-44a8-b5c7-d13153aa134c/file', 'properties': {}}, 'image_service': }' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c494a95c-d61f-423c-9120-de25e0626473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d104f710-acf3-4338-baca-5a167315a5d8 tempest-CreateVolumesFromImageTest-12436347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dff83d2a-d8f2-43b1-8bec-93d56b52980e" returned: 0 in 0.515s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:38 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d104f710-acf3-4338-baca-5a167315a5d8 tempest-CreateVolumesFromImageTest-12436347 None] Lock "cinder-quobyte-dff83d2a-d8f2-43b1-8bec-93d56b52980e" released by "delete_volume" :: held 1.298s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:38 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Volume volume-f3336558-ea2c-487e-9fa1-d5bf7b9422df (f3336558-ea2c-487e-9fa1-d5bf7b9422df): created successfully Sep 28 17:21:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c494a95c-d61f-423c-9120-de25e0626473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Flow 'volume_create_manager' (705e9f4c-afd0-4310-b9da-6b32a3011ebf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:38 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-6b203113-ac48-4af4-9606-397c6c9c6837 tempest-VolumeImageDependencyTests-1544513458 None] Created volume successfully. Sep 28 17:21:38 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-d104f710-acf3-4338-baca-5a167315a5d8 tempest-CreateVolumesFromImageTest-12436347 None] Created reservations ['f48f208c-25ab-44b3-a345-225415de06bb', 'e12417d6-23cc-4eb1-90c5-9b79ad8ea212', 'e02d2c6f-0c5f-4996-9147-8386e8d45ac8', 'e4137185-c377-4820-84a1-1b67fdb0c22d'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9e915a33-2b64-40c0-b2f3-991287fd13cf tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9e915a33-2b64-40c0-b2f3-991287fd13cf tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:39 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-9e915a33-2b64-40c0-b2f3-991287fd13cf tempest-VolumesSnapshotTestJSON-803354126 None] Creating offline snapshot 6f7dea5b-50c5-4a44-beed-c7099e0bb9d4 of volume f755ea3a-67f5-4662-a7db-534620bcc260 {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:21:39 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebdbc02-59c8-49f2-ba20-b2a10b2bd3c7]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9e915a33-2b64-40c0-b2f3-991287fd13cf tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d104f710-acf3-4338-baca-5a167315a5d8 tempest-CreateVolumesFromImageTest-12436347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d104f710-acf3-4338-baca-5a167315a5d8 tempest-CreateVolumesFromImageTest-12436347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:39 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d104f710-acf3-4338-baca-5a167315a5d8 tempest-CreateVolumesFromImageTest-12436347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:39 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d104f710-acf3-4338-baca-5a167315a5d8 tempest-CreateVolumesFromImageTest-12436347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d104f710-acf3-4338-baca-5a167315a5d8 tempest-CreateVolumesFromImageTest-12436347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d104f710-acf3-4338-baca-5a167315a5d8 tempest-CreateVolumesFromImageTest-12436347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:39 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:21:39 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:39 devstack sudo[100472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260 Sep 28 17:21:39 devstack sudo[100472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:39 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d104f710-acf3-4338-baca-5a167315a5d8 tempest-CreateVolumesFromImageTest-12436347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.302s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:39 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-d104f710-acf3-4338-baca-5a167315a5d8 tempest-CreateVolumesFromImageTest-12436347 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:39 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-d104f710-acf3-4338-baca-5a167315a5d8 tempest-CreateVolumesFromImageTest-12436347 None] Deleted volume successfully. Sep 28 17:21:39 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d104f710-acf3-4338-baca-5a167315a5d8 tempest-CreateVolumesFromImageTest-12436347 None] Lock "cinder-dff83d2a-d8f2-43b1-8bec-93d56b52980e-delete_volume" released by "delete_volume" :: held 2.016s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:39 devstack sudo[100472]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9e915a33-2b64-40c0-b2f3-991287fd13cf tempest-VolumesSnapshotTestJSON-803354126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260" returned: 0 in 0.489s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9e915a33-2b64-40c0-b2f3-991287fd13cf tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260.6f7dea5b-50c5-4a44-beed-c7099e0bb9d4 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:39 devstack sudo[100480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260.6f7dea5b-50c5-4a44-beed-c7099e0bb9d4 1G Sep 28 17:21:39 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:39 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e2c60eb1-96dc-448a-8a90-432cc981800f tempest-CreateVolumesFromImageTest-12436347 None] Acquiring lock "cinder-2113e623-9fd7-4bbe-8ee6-85627752c4e2-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:39 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e2c60eb1-96dc-448a-8a90-432cc981800f tempest-CreateVolumesFromImageTest-12436347 None] Lock "cinder-2113e623-9fd7-4bbe-8ee6-85627752c4e2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:39 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-524c59a0-bcc7-438d-87c9-6964ba14e976 tempest-VolumeImageDependencyTests-1544513458 None] Acquiring lock "cinder-f3336558-ea2c-487e-9fa1-d5bf7b9422df-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:40 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e2c60eb1-96dc-448a-8a90-432cc981800f tempest-CreateVolumesFromImageTest-12436347 None] Acquiring lock "cinder-quobyte-2113e623-9fd7-4bbe-8ee6-85627752c4e2" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:40 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-524c59a0-bcc7-438d-87c9-6964ba14e976 tempest-VolumeImageDependencyTests-1544513458 None] Lock "cinder-f3336558-ea2c-487e-9fa1-d5bf7b9422df-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:40 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e2c60eb1-96dc-448a-8a90-432cc981800f tempest-CreateVolumesFromImageTest-12436347 None] Lock "cinder-quobyte-2113e623-9fd7-4bbe-8ee6-85627752c4e2" acquired by "delete_volume" :: waited 0.061s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:40 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[281d940f-abf1-4a2c-bf3f-ea2e10414279]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e2c60eb1-96dc-448a-8a90-432cc981800f tempest-CreateVolumesFromImageTest-12436347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2113e623-9fd7-4bbe-8ee6-85627752c4e2 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:40 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-524c59a0-bcc7-438d-87c9-6964ba14e976 tempest-VolumeImageDependencyTests-1544513458 None] Acquiring lock "cinder-quobyte-f3336558-ea2c-487e-9fa1-d5bf7b9422df" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:40 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-524c59a0-bcc7-438d-87c9-6964ba14e976 tempest-VolumeImageDependencyTests-1544513458 None] Lock "cinder-quobyte-f3336558-ea2c-487e-9fa1-d5bf7b9422df" acquired by "delete_volume" :: waited 0.036s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:40 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8929e38-af0e-40e1-88d9-b9ffdfd5e5c9]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-524c59a0-bcc7-438d-87c9-6964ba14e976 tempest-VolumeImageDependencyTests-1544513458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f3336558-ea2c-487e-9fa1-d5bf7b9422df {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:40 devstack sudo[100484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2113e623-9fd7-4bbe-8ee6-85627752c4e2 Sep 28 17:21:40 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:40 devstack sudo[100486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f3336558-ea2c-487e-9fa1-d5bf7b9422df Sep 28 17:21:40 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:40 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9e915a33-2b64-40c0-b2f3-991287fd13cf tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260.6f7dea5b-50c5-4a44-beed-c7099e0bb9d4 1G" returned: 0 in 1.149s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9e915a33-2b64-40c0-b2f3-991287fd13cf tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f755ea3a-67f5-4662-a7db-534620bcc260 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260.6f7dea5b-50c5-4a44-beed-c7099e0bb9d4 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:40 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f755ea3a-67f5-4662-a7db-534620bcc260 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260.6f7dea5b-50c5-4a44-beed-c7099e0bb9d4 Sep 28 17:21:40 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:40 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e2c60eb1-96dc-448a-8a90-432cc981800f tempest-CreateVolumesFromImageTest-12436347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2113e623-9fd7-4bbe-8ee6-85627752c4e2" returned: 0 in 0.656s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e2c60eb1-96dc-448a-8a90-432cc981800f tempest-CreateVolumesFromImageTest-12436347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2113e623-9fd7-4bbe-8ee6-85627752c4e2 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:40 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2113e623-9fd7-4bbe-8ee6-85627752c4e2 Sep 28 17:21:40 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:41 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-524c59a0-bcc7-438d-87c9-6964ba14e976 tempest-VolumeImageDependencyTests-1544513458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f3336558-ea2c-487e-9fa1-d5bf7b9422df" returned: 0 in 0.751s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-524c59a0-bcc7-438d-87c9-6964ba14e976 tempest-VolumeImageDependencyTests-1544513458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f3336558-ea2c-487e-9fa1-d5bf7b9422df {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:41 devstack sudo[100502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f3336558-ea2c-487e-9fa1-d5bf7b9422df Sep 28 17:21:41 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:41 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9e915a33-2b64-40c0-b2f3-991287fd13cf tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f755ea3a-67f5-4662-a7db-534620bcc260 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260.6f7dea5b-50c5-4a44-beed-c7099e0bb9d4" returned: 0 in 0.590s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:41 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-9e915a33-2b64-40c0-b2f3-991287fd13cf tempest-VolumesSnapshotTestJSON-803354126 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260.6f7dea5b-50c5-4a44-beed-c7099e0bb9d4 is being set with open permissions: ugo+rw Sep 28 17:21:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9e915a33-2b64-40c0-b2f3-991287fd13cf tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260.6f7dea5b-50c5-4a44-beed-c7099e0bb9d4 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:41 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260.6f7dea5b-50c5-4a44-beed-c7099e0bb9d4 Sep 28 17:21:41 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:41 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e2c60eb1-96dc-448a-8a90-432cc981800f tempest-CreateVolumesFromImageTest-12436347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2113e623-9fd7-4bbe-8ee6-85627752c4e2" returned: 0 in 0.651s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:41 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e2c60eb1-96dc-448a-8a90-432cc981800f tempest-CreateVolumesFromImageTest-12436347 None] Lock "cinder-quobyte-2113e623-9fd7-4bbe-8ee6-85627752c4e2" released by "delete_volume" :: held 1.447s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:41 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-524c59a0-bcc7-438d-87c9-6964ba14e976 tempest-VolumeImageDependencyTests-1544513458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f3336558-ea2c-487e-9fa1-d5bf7b9422df" returned: 0 in 0.576s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:41 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-524c59a0-bcc7-438d-87c9-6964ba14e976 tempest-VolumeImageDependencyTests-1544513458 None] Lock "cinder-quobyte-f3336558-ea2c-487e-9fa1-d5bf7b9422df" released by "delete_volume" :: held 1.414s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:41 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-e2c60eb1-96dc-448a-8a90-432cc981800f tempest-CreateVolumesFromImageTest-12436347 None] Created reservations ['5fb760e7-a84d-4db7-a335-c0ccf353119d', '0ad318ca-8933-44ea-ad46-2c003d8f0f59', '000ac027-610c-48f2-93ee-e09e0853231e', 'ef62e15a-321f-4d97-975b-c7b6871dd950'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:41 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9e915a33-2b64-40c0-b2f3-991287fd13cf tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260.6f7dea5b-50c5-4a44-beed-c7099e0bb9d4" returned: 0 in 0.447s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:41 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-524c59a0-bcc7-438d-87c9-6964ba14e976 tempest-VolumeImageDependencyTests-1544513458 None] Created reservations ['e81599ab-762e-4b1d-b9b8-d6a34cbc02e5', '32925ba5-6df2-45be-a3ad-deeb4c840a84', '9dfa130b-97f9-4e80-859f-d0aa5b128953', '07067ed4-7382-45c0-81f1-8d13fdb252c9'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9e915a33-2b64-40c0-b2f3-991287fd13cf tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e2c60eb1-96dc-448a-8a90-432cc981800f tempest-CreateVolumesFromImageTest-12436347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e2c60eb1-96dc-448a-8a90-432cc981800f tempest-CreateVolumesFromImageTest-12436347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:41 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-e2c60eb1-96dc-448a-8a90-432cc981800f tempest-CreateVolumesFromImageTest-12436347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:41 devstack sudo[100513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260.info Sep 28 17:21:41 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:41 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-e2c60eb1-96dc-448a-8a90-432cc981800f tempest-CreateVolumesFromImageTest-12436347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e2c60eb1-96dc-448a-8a90-432cc981800f tempest-CreateVolumesFromImageTest-12436347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e2c60eb1-96dc-448a-8a90-432cc981800f tempest-CreateVolumesFromImageTest-12436347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-524c59a0-bcc7-438d-87c9-6964ba14e976 tempest-VolumeImageDependencyTests-1544513458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-524c59a0-bcc7-438d-87c9-6964ba14e976 tempest-VolumeImageDependencyTests-1544513458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:41 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-524c59a0-bcc7-438d-87c9-6964ba14e976 tempest-VolumeImageDependencyTests-1544513458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:41 devstack sudo[100515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:21:41 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:41 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-524c59a0-bcc7-438d-87c9-6964ba14e976 tempest-VolumeImageDependencyTests-1544513458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-524c59a0-bcc7-438d-87c9-6964ba14e976 tempest-VolumeImageDependencyTests-1544513458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-524c59a0-bcc7-438d-87c9-6964ba14e976 tempest-VolumeImageDependencyTests-1544513458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:41 devstack sudo[100517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:21:41 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:42 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9e915a33-2b64-40c0-b2f3-991287fd13cf tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260.info" returned: 0 in 0.359s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:42 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-9e915a33-2b64-40c0-b2f3-991287fd13cf tempest-VolumesSnapshotTestJSON-803354126 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260.info is being set with open permissions: ugo+rw Sep 28 17:21:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9e915a33-2b64-40c0-b2f3-991287fd13cf tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:42 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260.info Sep 28 17:21:42 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:42 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-524c59a0-bcc7-438d-87c9-6964ba14e976 tempest-VolumeImageDependencyTests-1544513458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.437s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:42 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-524c59a0-bcc7-438d-87c9-6964ba14e976 tempest-VolumeImageDependencyTests-1544513458 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:42 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-524c59a0-bcc7-438d-87c9-6964ba14e976 tempest-VolumeImageDependencyTests-1544513458 None] Deleted volume successfully. Sep 28 17:21:42 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-524c59a0-bcc7-438d-87c9-6964ba14e976 tempest-VolumeImageDependencyTests-1544513458 None] Lock "cinder-f3336558-ea2c-487e-9fa1-d5bf7b9422df-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:42 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:42 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f79aea9e-5841-4d2c-828e-3047e4a9b8f9 tempest-CreateVolumesFromImageTest-12436347 None] Acquiring lock "cinder-cab41406-0e36-45b1-972c-8df53c2c3f9f-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e2c60eb1-96dc-448a-8a90-432cc981800f tempest-CreateVolumesFromImageTest-12436347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.651s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:42 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-e2c60eb1-96dc-448a-8a90-432cc981800f tempest-CreateVolumesFromImageTest-12436347 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:42 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-e2c60eb1-96dc-448a-8a90-432cc981800f tempest-CreateVolumesFromImageTest-12436347 None] Deleted volume successfully. Sep 28 17:21:42 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f79aea9e-5841-4d2c-828e-3047e4a9b8f9 tempest-CreateVolumesFromImageTest-12436347 None] Lock "cinder-cab41406-0e36-45b1-972c-8df53c2c3f9f-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:42 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e2c60eb1-96dc-448a-8a90-432cc981800f tempest-CreateVolumesFromImageTest-12436347 None] Lock "cinder-2113e623-9fd7-4bbe-8ee6-85627752c4e2-delete_volume" released by "delete_volume" :: held 2.673s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:42 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f79aea9e-5841-4d2c-828e-3047e4a9b8f9 tempest-CreateVolumesFromImageTest-12436347 None] Acquiring lock "cinder-quobyte-cab41406-0e36-45b1-972c-8df53c2c3f9f" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:42 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f79aea9e-5841-4d2c-828e-3047e4a9b8f9 tempest-CreateVolumesFromImageTest-12436347 None] Lock "cinder-quobyte-cab41406-0e36-45b1-972c-8df53c2c3f9f" acquired by "delete_volume" :: waited 0.046s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:42 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5be093-912c-456a-abb5-b70c5ba912ac]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f79aea9e-5841-4d2c-828e-3047e4a9b8f9 tempest-CreateVolumesFromImageTest-12436347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cab41406-0e36-45b1-972c-8df53c2c3f9f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:42 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9e915a33-2b64-40c0-b2f3-991287fd13cf tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260.info" returned: 0 in 0.637s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9e915a33-2b64-40c0-b2f3-991287fd13cf tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.823s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:42 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-9e915a33-2b64-40c0-b2f3-991287fd13cf tempest-VolumesSnapshotTestJSON-803354126 None] Create snapshot completed successfully Sep 28 17:21:42 devstack sudo[100526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cab41406-0e36-45b1-972c-8df53c2c3f9f Sep 28 17:21:42 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:43 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f79aea9e-5841-4d2c-828e-3047e4a9b8f9 tempest-CreateVolumesFromImageTest-12436347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cab41406-0e36-45b1-972c-8df53c2c3f9f" returned: 0 in 0.552s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f79aea9e-5841-4d2c-828e-3047e4a9b8f9 tempest-CreateVolumesFromImageTest-12436347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cab41406-0e36-45b1-972c-8df53c2c3f9f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:43 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cab41406-0e36-45b1-972c-8df53c2c3f9f Sep 28 17:21:43 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:43 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f79aea9e-5841-4d2c-828e-3047e4a9b8f9 tempest-CreateVolumesFromImageTest-12436347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cab41406-0e36-45b1-972c-8df53c2c3f9f" returned: 0 in 0.517s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:43 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f79aea9e-5841-4d2c-828e-3047e4a9b8f9 tempest-CreateVolumesFromImageTest-12436347 None] Lock "cinder-quobyte-cab41406-0e36-45b1-972c-8df53c2c3f9f" released by "delete_volume" :: held 1.158s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:43 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-f79aea9e-5841-4d2c-828e-3047e4a9b8f9 tempest-CreateVolumesFromImageTest-12436347 None] Created reservations ['bc13ad0b-fee5-410f-8594-436d2529d4b8', '4fa97cf5-05c6-4e10-a50d-afd429bb9d32', '775cc1f3-4373-4335-95e1-283166d134a5', 'ba0fa47a-baa2-487d-a2b6-db3ac3540e7e'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f79aea9e-5841-4d2c-828e-3047e4a9b8f9 tempest-CreateVolumesFromImageTest-12436347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f79aea9e-5841-4d2c-828e-3047e4a9b8f9 tempest-CreateVolumesFromImageTest-12436347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f79aea9e-5841-4d2c-828e-3047e4a9b8f9 tempest-CreateVolumesFromImageTest-12436347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f79aea9e-5841-4d2c-828e-3047e4a9b8f9 tempest-CreateVolumesFromImageTest-12436347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f79aea9e-5841-4d2c-828e-3047e4a9b8f9 tempest-CreateVolumesFromImageTest-12436347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f79aea9e-5841-4d2c-828e-3047e4a9b8f9 tempest-CreateVolumesFromImageTest-12436347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:44 devstack sudo[100536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:21:44 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Flow 'volume_create_manager' (3b5f6077-94fb-4d18-9e92-f22a1e68f70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4791c9e0-0e8c-42cb-8f70-484fd68e69f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4791c9e0-0e8c-42cb-8f70-484fd68e69f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1916226101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b6eb03d-7778-4c25-bc75-3bbc0f45b13f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daababf0069a4500946ef3bd106e2e19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6f7dea5b-50c5-4a44-beed-c7099e0bb9d4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:44Z,use_quota=True,user_id='3b4641fc2a6e4cf592a96014ad60aeb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feec1c77-dccc-4427-8b0c-2ec53bea1c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feec1c77-dccc-4427-8b0c-2ec53bea1c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e5283f-1a49-4569-95b8-27bbd9797514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e5283f-1a49-4569-95b8-27bbd9797514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7b6eb03d-7778-4c25-bc75-3bbc0f45b13f', 'volume_name': 'volume-7b6eb03d-7778-4c25-bc75-3bbc0f45b13f', 'volume_size': 1, 'snapshot_id': '6f7dea5b-50c5-4a44-beed-c7099e0bb9d4'}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7b962b2-c167-495f-ae62-5ce72f23fbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7b962b2-c167-495f-ae62-5ce72f23fbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c6a9f49-fd80-4357-94fb-2765fed75680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:44 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Volume 7b6eb03d-7778-4c25-bc75-3bbc0f45b13f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7b6eb03d-7778-4c25-bc75-3bbc0f45b13f', 'volume_size': 1, 'snapshot_id': '6f7dea5b-50c5-4a44-beed-c7099e0bb9d4'} Sep 28 17:21:44 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f79aea9e-5841-4d2c-828e-3047e4a9b8f9 tempest-CreateVolumesFromImageTest-12436347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.547s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-f79aea9e-5841-4d2c-828e-3047e4a9b8f9 tempest-CreateVolumesFromImageTest-12436347 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:44 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-f79aea9e-5841-4d2c-828e-3047e4a9b8f9 tempest-CreateVolumesFromImageTest-12436347 None] Deleted volume successfully. Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "cinder-quobyte-6f7dea5b-50c5-4a44-beed-c7099e0bb9d4-7b6eb03d-7778-4c25-bc75-3bbc0f45b13f" by "_create_volume_from_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f79aea9e-5841-4d2c-828e-3047e4a9b8f9 tempest-CreateVolumesFromImageTest-12436347 None] Lock "cinder-cab41406-0e36-45b1-972c-8df53c2c3f9f-delete_volume" released by "delete_volume" :: held 2.114s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-quobyte-6f7dea5b-50c5-4a44-beed-c7099e0bb9d4-7b6eb03d-7778-4c25-bc75-3bbc0f45b13f" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Creating volume 7b6eb03d-7778-4c25-bc75-3bbc0f45b13f from snapshot 6f7dea5b-50c5-4a44-beed-c7099e0bb9d4 {{(pid=86917) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "cinder-quobyte-7b6eb03d-7778-4c25-bc75-3bbc0f45b13f" by "_copy_volume_from_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-quobyte-7b6eb03d-7778-4c25-bc75-3bbc0f45b13f" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] snapshot: 6f7dea5b-50c5-4a44-beed-c7099e0bb9d4, volume: 7b6eb03d-7778-4c25-bc75-3bbc0f45b13f, {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b231b67c-e660-4ed2-801d-7a07a3b129a0]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260.6f7dea5b-50c5-4a44-beed-c7099e0bb9d4 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:44 devstack sudo[100539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260.6f7dea5b-50c5-4a44-beed-c7099e0bb9d4 Sep 28 17:21:44 devstack sudo[100539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:45 devstack sudo[100539]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260.6f7dea5b-50c5-4a44-beed-c7099e0bb9d4" returned: 0 in 0.565s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f755ea3a-67f5-4662-a7db-534620bcc260(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:21:45 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c382f6a0-c33a-4d5b-a45f-2ade9d1e7c24]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:45 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260 Sep 28 17:21:45 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:45 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260" returned: 0 in 0.516s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260 {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:21:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Creating direct copy from snapshot {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:21:45 devstack cinder-volume[86917]: DEBUG cinder.utils [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Path /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-7b6eb03d-7778-4c25-bc75-3bbc0f45b13f not found in is_blk_device check {{(pid=86917) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:21:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-7b6eb03d-7778-4c25-bc75-3bbc0f45b13f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:45 devstack sudo[100551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-7b6eb03d-7778-4c25-bc75-3bbc0f45b13f Sep 28 17:21:45 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:21:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:49 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-440238b0-efe5-42d2-9372-6c1494181952 tempest-CinderUnicodeTest-1578719717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:21:49 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:21:49 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-440238b0-efe5-42d2-9372-6c1494181952 tempest-CinderUnicodeTest-1578719717 None] Flow 'volume_create_manager' (94f4e1a2-6d5a-4a86-ac0c-bf46fbc15680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-440238b0-efe5-42d2-9372-6c1494181952 tempest-CinderUnicodeTest-1578719717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (129bb281-5989-419a-bd36-41f18d7cb74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-440238b0-efe5-42d2-9372-6c1494181952 tempest-CinderUnicodeTest-1578719717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (129bb281-5989-419a-bd36-41f18d7cb74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409c5de1-ccac-4aca-98c9-e1e80ec15255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e654cede180449a9bb0673375537bdda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:49Z,use_quota=True,user_id='5640d99608224fe5a9cbe66caadf89e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-440238b0-efe5-42d2-9372-6c1494181952 tempest-CinderUnicodeTest-1578719717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24434c13-4f5c-4ded-9d4e-a47f219abd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-440238b0-efe5-42d2-9372-6c1494181952 tempest-CinderUnicodeTest-1578719717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24434c13-4f5c-4ded-9d4e-a47f219abd36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-440238b0-efe5-42d2-9372-6c1494181952 tempest-CinderUnicodeTest-1578719717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1606bbd1-78f3-4305-ab87-72304acecbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-440238b0-efe5-42d2-9372-6c1494181952 tempest-CinderUnicodeTest-1578719717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1606bbd1-78f3-4305-ab87-72304acecbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '409c5de1-ccac-4aca-98c9-e1e80ec15255', 'volume_name': 'volume-409c5de1-ccac-4aca-98c9-e1e80ec15255', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-440238b0-efe5-42d2-9372-6c1494181952 tempest-CinderUnicodeTest-1578719717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6767736-a7f9-4ce9-aaf5-1bd24c9e0399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-440238b0-efe5-42d2-9372-6c1494181952 tempest-CinderUnicodeTest-1578719717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6767736-a7f9-4ce9-aaf5-1bd24c9e0399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-440238b0-efe5-42d2-9372-6c1494181952 tempest-CinderUnicodeTest-1578719717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (197d83c7-7386-496f-8c3f-94a76f0d4bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:49 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-440238b0-efe5-42d2-9372-6c1494181952 tempest-CinderUnicodeTest-1578719717 None] Volume 409c5de1-ccac-4aca-98c9-e1e80ec15255: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-409c5de1-ccac-4aca-98c9-e1e80ec15255', 'volume_size': 1} Sep 28 17:21:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-440238b0-efe5-42d2-9372-6c1494181952 tempest-CinderUnicodeTest-1578719717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:50 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.755s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:50 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:50 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager._thread_info {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:21:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread count: 28 {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:21:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread info: [<_MainThread(MainThread, started 132915553284224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:21:53 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-353c6b2d-8e40-4a74-a38b-22ea0786c9b7 tempest-CreateVolumesFromSnapshotTest-611704133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:21:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-353c6b2d-8e40-4a74-a38b-22ea0786c9b7 tempest-CreateVolumesFromSnapshotTest-611704133 None] Flow 'volume_create_manager' (3f52872e-e12f-4b18-ab17-fdf4b63d1e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-353c6b2d-8e40-4a74-a38b-22ea0786c9b7 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a750ef3-57db-470d-9cae-243fe2a1ff8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-353c6b2d-8e40-4a74-a38b-22ea0786c9b7 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a750ef3-57db-470d-9cae-243fe2a1ff8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-529771620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=157d6ace-3ae4-48ac-80a5-d0e9179df6c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc0eb4e3cd874a98bc8405b3ebc37f25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:53Z,use_quota=True,user_id='7d2fdeefabaf42a6b31800d6ddf81b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-353c6b2d-8e40-4a74-a38b-22ea0786c9b7 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ec9647d-6789-4e98-ae89-4d7b3d175818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-353c6b2d-8e40-4a74-a38b-22ea0786c9b7 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ec9647d-6789-4e98-ae89-4d7b3d175818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-353c6b2d-8e40-4a74-a38b-22ea0786c9b7 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dd4d939-78a7-4b88-b06d-1689ffe8a797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-353c6b2d-8e40-4a74-a38b-22ea0786c9b7 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dd4d939-78a7-4b88-b06d-1689ffe8a797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '157d6ace-3ae4-48ac-80a5-d0e9179df6c9', 'volume_name': 'volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-353c6b2d-8e40-4a74-a38b-22ea0786c9b7 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb69af3f-a3e0-4885-bc7d-ebd106681d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-353c6b2d-8e40-4a74-a38b-22ea0786c9b7 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb69af3f-a3e0-4885-bc7d-ebd106681d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-353c6b2d-8e40-4a74-a38b-22ea0786c9b7 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcbb0439-c702-4337-a487-cfe95288cc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:53 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-353c6b2d-8e40-4a74-a38b-22ea0786c9b7 tempest-CreateVolumesFromSnapshotTest-611704133 None] Volume 157d6ace-3ae4-48ac-80a5-d0e9179df6c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9', 'volume_size': 1} Sep 28 17:21:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-353c6b2d-8e40-4a74-a38b-22ea0786c9b7 tempest-CreateVolumesFromSnapshotTest-611704133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:55 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-7b6eb03d-7778-4c25-bc75-3bbc0f45b13f" returned: 0 in 9.503s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:55 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Image conversion details: src /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260, size 1024.00 MB, duration 9.50 sec, destination /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-7b6eb03d-7778-4c25-bc75-3bbc0f45b13f {{(pid=86917) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:21:55 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Converted 1024.00 MB image at 107.75 MB/s Sep 28 17:21:55 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-7b6eb03d-7778-4c25-bc75-3bbc0f45b13f is being set with open permissions: ugo+rw Sep 28 17:21:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-7b6eb03d-7778-4c25-bc75-3bbc0f45b13f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:55 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-7b6eb03d-7778-4c25-bc75-3bbc0f45b13f Sep 28 17:21:55 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:55 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-7b6eb03d-7778-4c25-bc75-3bbc0f45b13f" returned: 0 in 0.270s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:55 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-quobyte-7b6eb03d-7778-4c25-bc75-3bbc0f45b13f" released by "_copy_volume_from_snapshot" :: held 10.989s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:55 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-quobyte-6f7dea5b-50c5-4a44-beed-c7099e0bb9d4-7b6eb03d-7778-4c25-bc75-3bbc0f45b13f" released by "_create_volume_from_snapshot" :: held 11.071s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.108s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-440238b0-efe5-42d2-9372-6c1494181952 tempest-CinderUnicodeTest-1578719717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.872s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:55 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-440238b0-efe5-42d2-9372-6c1494181952 tempest-CinderUnicodeTest-1578719717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409c5de1-ccac-4aca-98c9-e1e80ec15255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e654cede180449a9bb0673375537bdda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:49Z,use_quota=True,user_id='5640d99608224fe5a9cbe66caadf89e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:21:55 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-440238b0-efe5-42d2-9372-6c1494181952 tempest-CinderUnicodeTest-1578719717 None] Creating volume 409c5de1-ccac-4aca-98c9-e1e80ec15255 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:21:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-440238b0-efe5-42d2-9372-6c1494181952 tempest-CinderUnicodeTest-1578719717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-440238b0-efe5-42d2-9372-6c1494181952 tempest-CinderUnicodeTest-1578719717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:55 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-440238b0-efe5-42d2-9372-6c1494181952 tempest-CinderUnicodeTest-1578719717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:55 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-440238b0-efe5-42d2-9372-6c1494181952 tempest-CinderUnicodeTest-1578719717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-440238b0-efe5-42d2-9372-6c1494181952 tempest-CinderUnicodeTest-1578719717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:55 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-440238b0-efe5-42d2-9372-6c1494181952 tempest-CinderUnicodeTest-1578719717 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:21:55 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-440238b0-efe5-42d2-9372-6c1494181952 tempest-CinderUnicodeTest-1578719717 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:21:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-440238b0-efe5-42d2-9372-6c1494181952 tempest-CinderUnicodeTest-1578719717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-409c5de1-ccac-4aca-98c9-e1e80ec15255 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:55 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-409c5de1-ccac-4aca-98c9-e1e80ec15255 1073741824 Sep 28 17:21:55 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c6a9f49-fd80-4357-94fb-2765fed75680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b6eb03d-7778-4c25-bc75-3bbc0f45b13f', 'volume_size': 1, 'snapshot_id': '6f7dea5b-50c5-4a44-beed-c7099e0bb9d4'}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b21a4a9d-4d34-4673-b5a2-a3fb22066b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:55 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Volume volume-7b6eb03d-7778-4c25-bc75-3bbc0f45b13f (7b6eb03d-7778-4c25-bc75-3bbc0f45b13f): created successfully Sep 28 17:21:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b21a4a9d-4d34-4673-b5a2-a3fb22066b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Flow 'volume_create_manager' (3b5f6077-94fb-4d18-9e92-f22a1e68f70c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:55 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-75cc9b15-99ca-4dcd-b19f-d4a02cf7675b tempest-VolumesSnapshotTestJSON-803354126 None] Created volume successfully. Sep 28 17:21:56 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fdfd9340-2dbb-4390-8094-a9f54f613082 tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "cinder-7b6eb03d-7778-4c25-bc75-3bbc0f45b13f-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:56 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fdfd9340-2dbb-4390-8094-a9f54f613082 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-7b6eb03d-7778-4c25-bc75-3bbc0f45b13f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:56 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:56 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fdfd9340-2dbb-4390-8094-a9f54f613082 tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "cinder-quobyte-7b6eb03d-7778-4c25-bc75-3bbc0f45b13f" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-440238b0-efe5-42d2-9372-6c1494181952 tempest-CinderUnicodeTest-1578719717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-409c5de1-ccac-4aca-98c9-e1e80ec15255 1073741824" returned: 0 in 0.557s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:56 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fdfd9340-2dbb-4390-8094-a9f54f613082 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-quobyte-7b6eb03d-7778-4c25-bc75-3bbc0f45b13f" acquired by "delete_volume" :: waited 0.026s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:56 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e7f01b-0feb-46a2-9bc8-06c19e5c696c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fdfd9340-2dbb-4390-8094-a9f54f613082 tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-7b6eb03d-7778-4c25-bc75-3bbc0f45b13f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-440238b0-efe5-42d2-9372-6c1494181952 tempest-CinderUnicodeTest-1578719717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-409c5de1-ccac-4aca-98c9-e1e80ec15255 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:56 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-409c5de1-ccac-4aca-98c9-e1e80ec15255 Sep 28 17:21:56 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:56 devstack sudo[100592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-7b6eb03d-7778-4c25-bc75-3bbc0f45b13f Sep 28 17:21:56 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:56 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-440238b0-efe5-42d2-9372-6c1494181952 tempest-CinderUnicodeTest-1578719717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-409c5de1-ccac-4aca-98c9-e1e80ec15255" returned: 0 in 0.342s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:56 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-440238b0-efe5-42d2-9372-6c1494181952 tempest-CinderUnicodeTest-1578719717 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:21:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-440238b0-efe5-42d2-9372-6c1494181952 tempest-CinderUnicodeTest-1578719717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-353c6b2d-8e40-4a74-a38b-22ea0786c9b7 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.168s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:56 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-353c6b2d-8e40-4a74-a38b-22ea0786c9b7 tempest-CreateVolumesFromSnapshotTest-611704133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-529771620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=157d6ace-3ae4-48ac-80a5-d0e9179df6c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc0eb4e3cd874a98bc8405b3ebc37f25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:53Z,use_quota=True,user_id='7d2fdeefabaf42a6b31800d6ddf81b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:21:56 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-353c6b2d-8e40-4a74-a38b-22ea0786c9b7 tempest-CreateVolumesFromSnapshotTest-611704133 None] Creating volume 157d6ace-3ae4-48ac-80a5-d0e9179df6c9 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:21:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-353c6b2d-8e40-4a74-a38b-22ea0786c9b7 tempest-CreateVolumesFromSnapshotTest-611704133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-353c6b2d-8e40-4a74-a38b-22ea0786c9b7 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:56 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-353c6b2d-8e40-4a74-a38b-22ea0786c9b7 tempest-CreateVolumesFromSnapshotTest-611704133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:56 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-353c6b2d-8e40-4a74-a38b-22ea0786c9b7 tempest-CreateVolumesFromSnapshotTest-611704133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-353c6b2d-8e40-4a74-a38b-22ea0786c9b7 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:56 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-353c6b2d-8e40-4a74-a38b-22ea0786c9b7 tempest-CreateVolumesFromSnapshotTest-611704133 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:21:56 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-353c6b2d-8e40-4a74-a38b-22ea0786c9b7 tempest-CreateVolumesFromSnapshotTest-611704133 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:21:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-353c6b2d-8e40-4a74-a38b-22ea0786c9b7 tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:56 devstack sudo[100600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9 1073741824 Sep 28 17:21:56 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:56 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-440238b0-efe5-42d2-9372-6c1494181952 tempest-CinderUnicodeTest-1578719717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (197d83c7-7386-496f-8c3f-94a76f0d4bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-409c5de1-ccac-4aca-98c9-e1e80ec15255', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:56 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-440238b0-efe5-42d2-9372-6c1494181952 tempest-CinderUnicodeTest-1578719717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a95dc8e-3b8f-4f50-848e-3fbb74c1bdf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:56 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-440238b0-efe5-42d2-9372-6c1494181952 tempest-CinderUnicodeTest-1578719717 None] Volume volume-409c5de1-ccac-4aca-98c9-e1e80ec15255 (409c5de1-ccac-4aca-98c9-e1e80ec15255): created successfully Sep 28 17:21:56 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-440238b0-efe5-42d2-9372-6c1494181952 tempest-CinderUnicodeTest-1578719717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a95dc8e-3b8f-4f50-848e-3fbb74c1bdf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:56 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:56 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-440238b0-efe5-42d2-9372-6c1494181952 tempest-CinderUnicodeTest-1578719717 None] Flow 'volume_create_manager' (94f4e1a2-6d5a-4a86-ac0c-bf46fbc15680) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fdfd9340-2dbb-4390-8094-a9f54f613082 tempest-VolumesSnapshotTestJSON-803354126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-7b6eb03d-7778-4c25-bc75-3bbc0f45b13f" returned: 0 in 0.471s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fdfd9340-2dbb-4390-8094-a9f54f613082 tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-7b6eb03d-7778-4c25-bc75-3bbc0f45b13f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:56 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-440238b0-efe5-42d2-9372-6c1494181952 tempest-CinderUnicodeTest-1578719717 None] Created volume successfully. Sep 28 17:21:56 devstack sudo[100602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-7b6eb03d-7778-4c25-bc75-3bbc0f45b13f Sep 28 17:21:56 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:57 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fdfd9340-2dbb-4390-8094-a9f54f613082 tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-7b6eb03d-7778-4c25-bc75-3bbc0f45b13f" returned: 0 in 0.331s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:57 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fdfd9340-2dbb-4390-8094-a9f54f613082 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-quobyte-7b6eb03d-7778-4c25-bc75-3bbc0f45b13f" released by "delete_volume" :: held 0.861s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:57 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-fdfd9340-2dbb-4390-8094-a9f54f613082 tempest-VolumesSnapshotTestJSON-803354126 None] Created reservations ['69879a27-861c-4f5d-8e27-8d5816e7da02', '12146eb1-a901-4029-abea-4ab1e373b08f', '7d6c04be-1770-4632-8bba-b753fe1bf850', '51060834-34f9-400b-bb2d-72e7c45013a1'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:57 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-353c6b2d-8e40-4a74-a38b-22ea0786c9b7 tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9 1073741824" returned: 0 in 0.570s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-353c6b2d-8e40-4a74-a38b-22ea0786c9b7 tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-fdfd9340-2dbb-4390-8094-a9f54f613082 tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-fdfd9340-2dbb-4390-8094-a9f54f613082 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:57 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-fdfd9340-2dbb-4390-8094-a9f54f613082 tempest-VolumesSnapshotTestJSON-803354126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:57 devstack sudo[100609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9 Sep 28 17:21:57 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:57 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-fdfd9340-2dbb-4390-8094-a9f54f613082 tempest-VolumesSnapshotTestJSON-803354126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-fdfd9340-2dbb-4390-8094-a9f54f613082 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fdfd9340-2dbb-4390-8094-a9f54f613082 tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:57 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:21:57 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:57 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-08221c65-0f64-4d81-a701-e8216553e7de tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "cinder-6f7dea5b-50c5-4a44-beed-c7099e0bb9d4-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:57 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-08221c65-0f64-4d81-a701-e8216553e7de tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-6f7dea5b-50c5-4a44-beed-c7099e0bb9d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:57 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-08221c65-0f64-4d81-a701-e8216553e7de tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "cinder-quobyte-f755ea3a-67f5-4662-a7db-534620bcc260" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:57 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-08221c65-0f64-4d81-a701-e8216553e7de tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-quobyte-f755ea3a-67f5-4662-a7db-534620bcc260" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:57 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-08221c65-0f64-4d81-a701-e8216553e7de tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "cinder-quobyte-6f7dea5b-50c5-4a44-beed-c7099e0bb9d4" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:57 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-08221c65-0f64-4d81-a701-e8216553e7de tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-quobyte-6f7dea5b-50c5-4a44-beed-c7099e0bb9d4" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:57 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-08221c65-0f64-4d81-a701-e8216553e7de tempest-VolumesSnapshotTestJSON-803354126 None] Deleting offline snapshot 6f7dea5b-50c5-4a44-beed-c7099e0bb9d4 of volume f755ea3a-67f5-4662-a7db-534620bcc260 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:21:57 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-08221c65-0f64-4d81-a701-e8216553e7de tempest-VolumesSnapshotTestJSON-803354126 None] snapshot_file for this snap is: volume-f755ea3a-67f5-4662-a7db-534620bcc260.6f7dea5b-50c5-4a44-beed-c7099e0bb9d4 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:21:57 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfaaa84-3342-4b25-8f1a-3d048a50ab84]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-08221c65-0f64-4d81-a701-e8216553e7de tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260.6f7dea5b-50c5-4a44-beed-c7099e0bb9d4 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:57 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:57 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-353c6b2d-8e40-4a74-a38b-22ea0786c9b7 tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9" returned: 0 in 0.431s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fdfd9340-2dbb-4390-8094-a9f54f613082 tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.385s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:57 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-353c6b2d-8e40-4a74-a38b-22ea0786c9b7 tempest-CreateVolumesFromSnapshotTest-611704133 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:21:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-353c6b2d-8e40-4a74-a38b-22ea0786c9b7 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:57 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-fdfd9340-2dbb-4390-8094-a9f54f613082 tempest-VolumesSnapshotTestJSON-803354126 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:57 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-fdfd9340-2dbb-4390-8094-a9f54f613082 tempest-VolumesSnapshotTestJSON-803354126 None] Deleted volume successfully. Sep 28 17:21:57 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-353c6b2d-8e40-4a74-a38b-22ea0786c9b7 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcbb0439-c702-4337-a487-cfe95288cc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:57 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-353c6b2d-8e40-4a74-a38b-22ea0786c9b7 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14d556c3-9de4-4259-928a-092db0256f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:57 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fdfd9340-2dbb-4390-8094-a9f54f613082 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-7b6eb03d-7778-4c25-bc75-3bbc0f45b13f-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:57 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-353c6b2d-8e40-4a74-a38b-22ea0786c9b7 tempest-CreateVolumesFromSnapshotTest-611704133 None] Volume volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9 (157d6ace-3ae4-48ac-80a5-d0e9179df6c9): created successfully Sep 28 17:21:57 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-353c6b2d-8e40-4a74-a38b-22ea0786c9b7 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14d556c3-9de4-4259-928a-092db0256f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:57 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-353c6b2d-8e40-4a74-a38b-22ea0786c9b7 tempest-CreateVolumesFromSnapshotTest-611704133 None] Flow 'volume_create_manager' (3f52872e-e12f-4b18-ab17-fdf4b63d1e36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:57 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-353c6b2d-8e40-4a74-a38b-22ea0786c9b7 tempest-CreateVolumesFromSnapshotTest-611704133 None] Created volume successfully. Sep 28 17:21:58 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260.6f7dea5b-50c5-4a44-beed-c7099e0bb9d4 Sep 28 17:21:58 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:58 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6923f17-e6e6-4b31-9471-60c001c3f2bd tempest-CinderUnicodeTest-1578719717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:21:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b6923f17-e6e6-4b31-9471-60c001c3f2bd tempest-CinderUnicodeTest-1578719717 None] Flow 'volume_create_manager' (8e4df6da-e4d0-48e7-80c9-22a8dafad959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b6923f17-e6e6-4b31-9471-60c001c3f2bd tempest-CinderUnicodeTest-1578719717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f56c292-0a93-476b-b29e-a7f828524061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b6923f17-e6e6-4b31-9471-60c001c3f2bd tempest-CinderUnicodeTest-1578719717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f56c292-0a93-476b-b29e-a7f828524061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1698378735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5881830-0e5e-4fa6-bfc9-818d37181c32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e654cede180449a9bb0673375537bdda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:58Z,use_quota=True,user_id='5640d99608224fe5a9cbe66caadf89e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b6923f17-e6e6-4b31-9471-60c001c3f2bd tempest-CinderUnicodeTest-1578719717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c3ac9b-f4c9-4b07-839f-a4e4ca67479e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b6923f17-e6e6-4b31-9471-60c001c3f2bd tempest-CinderUnicodeTest-1578719717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c3ac9b-f4c9-4b07-839f-a4e4ca67479e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b6923f17-e6e6-4b31-9471-60c001c3f2bd tempest-CinderUnicodeTest-1578719717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19cc5ccf-89d5-4aa2-993a-a9c0314f030b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b6923f17-e6e6-4b31-9471-60c001c3f2bd tempest-CinderUnicodeTest-1578719717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19cc5ccf-89d5-4aa2-993a-a9c0314f030b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5881830-0e5e-4fa6-bfc9-818d37181c32', 'volume_name': 'volume-d5881830-0e5e-4fa6-bfc9-818d37181c32', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b6923f17-e6e6-4b31-9471-60c001c3f2bd tempest-CinderUnicodeTest-1578719717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e389bf4d-e067-4eb9-a5ad-1201f57600eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b6923f17-e6e6-4b31-9471-60c001c3f2bd tempest-CinderUnicodeTest-1578719717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e389bf4d-e067-4eb9-a5ad-1201f57600eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b6923f17-e6e6-4b31-9471-60c001c3f2bd tempest-CinderUnicodeTest-1578719717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6d3f42d-f34f-48e6-ac32-dd3f7c952e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:58 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-b6923f17-e6e6-4b31-9471-60c001c3f2bd tempest-CinderUnicodeTest-1578719717 None] Volume d5881830-0e5e-4fa6-bfc9-818d37181c32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5881830-0e5e-4fa6-bfc9-818d37181c32', 'volume_size': 1} Sep 28 17:21:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b6923f17-e6e6-4b31-9471-60c001c3f2bd tempest-CinderUnicodeTest-1578719717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b6923f17-e6e6-4b31-9471-60c001c3f2bd tempest-CinderUnicodeTest-1578719717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:58 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b6923f17-e6e6-4b31-9471-60c001c3f2bd tempest-CinderUnicodeTest-1578719717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1698378735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5881830-0e5e-4fa6-bfc9-818d37181c32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e654cede180449a9bb0673375537bdda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:58Z,use_quota=True,user_id='5640d99608224fe5a9cbe66caadf89e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:21:58 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-b6923f17-e6e6-4b31-9471-60c001c3f2bd tempest-CinderUnicodeTest-1578719717 None] Creating volume d5881830-0e5e-4fa6-bfc9-818d37181c32 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:21:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b6923f17-e6e6-4b31-9471-60c001c3f2bd tempest-CinderUnicodeTest-1578719717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b6923f17-e6e6-4b31-9471-60c001c3f2bd tempest-CinderUnicodeTest-1578719717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:58 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b6923f17-e6e6-4b31-9471-60c001c3f2bd tempest-CinderUnicodeTest-1578719717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:58 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:58 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b6923f17-e6e6-4b31-9471-60c001c3f2bd tempest-CinderUnicodeTest-1578719717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b6923f17-e6e6-4b31-9471-60c001c3f2bd tempest-CinderUnicodeTest-1578719717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:58 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b6923f17-e6e6-4b31-9471-60c001c3f2bd tempest-CinderUnicodeTest-1578719717 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:21:58 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-b6923f17-e6e6-4b31-9471-60c001c3f2bd tempest-CinderUnicodeTest-1578719717 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:21:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b6923f17-e6e6-4b31-9471-60c001c3f2bd tempest-CinderUnicodeTest-1578719717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-08221c65-0f64-4d81-a701-e8216553e7de tempest-VolumesSnapshotTestJSON-803354126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260.6f7dea5b-50c5-4a44-beed-c7099e0bb9d4" returned: 0 in 0.489s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:58 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-08221c65-0f64-4d81-a701-e8216553e7de tempest-VolumesSnapshotTestJSON-803354126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f755ea3a-67f5-4662-a7db-534620bcc260(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:21:58 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32 1073741824 Sep 28 17:21:58 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:58 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bf9ca5-6d20-4684-99cb-8d831a865cfe]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-08221c65-0f64-4d81-a701-e8216553e7de tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:58 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260 Sep 28 17:21:58 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:58 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b6923f17-e6e6-4b31-9471-60c001c3f2bd tempest-CinderUnicodeTest-1578719717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32 1073741824" returned: 0 in 0.644s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b6923f17-e6e6-4b31-9471-60c001c3f2bd tempest-CinderUnicodeTest-1578719717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:59 devstack sudo[100632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32 Sep 28 17:21:59 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2a0bd531-f269-4f87-b215-ec0d78d987b8 tempest-CreateVolumesFromSnapshotTest-611704133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:59 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-08221c65-0f64-4d81-a701-e8216553e7de tempest-VolumesSnapshotTestJSON-803354126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260" returned: 0 in 0.768s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-08221c65-0f64-4d81-a701-e8216553e7de tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260.6f7dea5b-50c5-4a44-beed-c7099e0bb9d4 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:59 devstack sudo[100634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260.6f7dea5b-50c5-4a44-beed-c7099e0bb9d4 Sep 28 17:21:59 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:59 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b6923f17-e6e6-4b31-9471-60c001c3f2bd tempest-CinderUnicodeTest-1578719717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32" returned: 0 in 0.337s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:59 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b6923f17-e6e6-4b31-9471-60c001c3f2bd tempest-CinderUnicodeTest-1578719717 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:21:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b6923f17-e6e6-4b31-9471-60c001c3f2bd tempest-CinderUnicodeTest-1578719717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2a0bd531-f269-4f87-b215-ec0d78d987b8 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.235s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b6923f17-e6e6-4b31-9471-60c001c3f2bd tempest-CinderUnicodeTest-1578719717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6d3f42d-f34f-48e6-ac32-dd3f7c952e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5881830-0e5e-4fa6-bfc9-818d37181c32', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b6923f17-e6e6-4b31-9471-60c001c3f2bd tempest-CinderUnicodeTest-1578719717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f00409e-d1d0-46d3-ab59-bb4c2f007550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:59 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-2a0bd531-f269-4f87-b215-ec0d78d987b8 tempest-CreateVolumesFromSnapshotTest-611704133 None] Creating offline snapshot cded6e6d-f0ed-4e62-a5fa-5e1049435774 of volume 157d6ace-3ae4-48ac-80a5-d0e9179df6c9 {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:21:59 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-b6923f17-e6e6-4b31-9471-60c001c3f2bd tempest-CinderUnicodeTest-1578719717 None] Volume volume-d5881830-0e5e-4fa6-bfc9-818d37181c32 (d5881830-0e5e-4fa6-bfc9-818d37181c32): created successfully Sep 28 17:21:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b6923f17-e6e6-4b31-9471-60c001c3f2bd tempest-CinderUnicodeTest-1578719717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f00409e-d1d0-46d3-ab59-bb4c2f007550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b6923f17-e6e6-4b31-9471-60c001c3f2bd tempest-CinderUnicodeTest-1578719717 None] Flow 'volume_create_manager' (8e4df6da-e4d0-48e7-80c9-22a8dafad959) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:59 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf83f8c2-dfa3-48b4-b156-a84293ce1e3b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2a0bd531-f269-4f87-b215-ec0d78d987b8 tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:59 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-b6923f17-e6e6-4b31-9471-60c001c3f2bd tempest-CinderUnicodeTest-1578719717 None] Created volume successfully. Sep 28 17:21:59 devstack sudo[100640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9 Sep 28 17:21:59 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:59 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-08221c65-0f64-4d81-a701-e8216553e7de tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260.6f7dea5b-50c5-4a44-beed-c7099e0bb9d4" returned: 0 in 0.501s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-08221c65-0f64-4d81-a701-e8216553e7de tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260.6f7dea5b-50c5-4a44-beed-c7099e0bb9d4 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:59 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260.6f7dea5b-50c5-4a44-beed-c7099e0bb9d4 Sep 28 17:21:59 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:59 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2a0bd531-f269-4f87-b215-ec0d78d987b8 tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9" returned: 0 in 0.478s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2a0bd531-f269-4f87-b215-ec0d78d987b8 tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9.cded6e6d-f0ed-4e62-a5fa-5e1049435774 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:59 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:59 devstack sudo[100651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9.cded6e6d-f0ed-4e62-a5fa-5e1049435774 1G Sep 28 17:21:59 devstack sudo[100651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-08221c65-0f64-4d81-a701-e8216553e7de tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260.6f7dea5b-50c5-4a44-beed-c7099e0bb9d4" returned: 0 in 0.304s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:59 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-08221c65-0f64-4d81-a701-e8216553e7de tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-quobyte-6f7dea5b-50c5-4a44-beed-c7099e0bb9d4" released by "_delete_snapshot" :: held 2.230s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:00 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-08221c65-0f64-4d81-a701-e8216553e7de tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-quobyte-f755ea3a-67f5-4662-a7db-534620bcc260" released by "delete_snapshot" :: held 2.273s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:00 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-08221c65-0f64-4d81-a701-e8216553e7de tempest-VolumesSnapshotTestJSON-803354126 None] Created reservations ['9b8eba39-4270-4d9a-903c-478e6200aeec', '30d9c7ba-af9d-4b11-9958-47ab5a713790', '1d94cf1b-543f-42be-9f88-55780f6b4e19', '5781b57e-93a4-445c-b970-576385fb9197'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:00 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-08221c65-0f64-4d81-a701-e8216553e7de tempest-VolumesSnapshotTestJSON-803354126 None] Delete snapshot completed successfully. Sep 28 17:22:00 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-08221c65-0f64-4d81-a701-e8216553e7de tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-6f7dea5b-50c5-4a44-beed-c7099e0bb9d4-delete_snapshot" released by "delete_snapshot" :: held 2.482s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:00 devstack sudo[100651]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2a0bd531-f269-4f87-b215-ec0d78d987b8 tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9.cded6e6d-f0ed-4e62-a5fa-5e1049435774 1G" returned: 0 in 0.548s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2a0bd531-f269-4f87-b215-ec0d78d987b8 tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9.cded6e6d-f0ed-4e62-a5fa-5e1049435774 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:00 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9.cded6e6d-f0ed-4e62-a5fa-5e1049435774 Sep 28 17:22:00 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-38c24157-833e-41a8-a018-55c9f770090b tempest-CinderUnicodeTest-1578719717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:00 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2a0bd531-f269-4f87-b215-ec0d78d987b8 tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9.cded6e6d-f0ed-4e62-a5fa-5e1049435774" returned: 0 in 0.400s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:00 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-2a0bd531-f269-4f87-b215-ec0d78d987b8 tempest-CreateVolumesFromSnapshotTest-611704133 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9.cded6e6d-f0ed-4e62-a5fa-5e1049435774 is being set with open permissions: ugo+rw Sep 28 17:22:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2a0bd531-f269-4f87-b215-ec0d78d987b8 tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9.cded6e6d-f0ed-4e62-a5fa-5e1049435774 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:00 devstack sudo[100664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9.cded6e6d-f0ed-4e62-a5fa-5e1049435774 Sep 28 17:22:00 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:00 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e942d113-d885-4350-a262-f76ecc06f6b4 tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "cinder-f755ea3a-67f5-4662-a7db-534620bcc260-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:01 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e942d113-d885-4350-a262-f76ecc06f6b4 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-f755ea3a-67f5-4662-a7db-534620bcc260-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:01 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e942d113-d885-4350-a262-f76ecc06f6b4 tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "cinder-quobyte-f755ea3a-67f5-4662-a7db-534620bcc260" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:01 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e942d113-d885-4350-a262-f76ecc06f6b4 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-quobyte-f755ea3a-67f5-4662-a7db-534620bcc260" acquired by "delete_volume" :: waited 0.023s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:01 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcaa3f5d-3912-4013-8363-28a5d3188972]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e942d113-d885-4350-a262-f76ecc06f6b4 tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:01 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2a0bd531-f269-4f87-b215-ec0d78d987b8 tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9.cded6e6d-f0ed-4e62-a5fa-5e1049435774" returned: 0 in 0.308s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2a0bd531-f269-4f87-b215-ec0d78d987b8 tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:01 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9.info Sep 28 17:22:01 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:01 devstack sudo[100667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260 Sep 28 17:22:01 devstack sudo[100667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:01 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2a0bd531-f269-4f87-b215-ec0d78d987b8 tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9.info" returned: 0 in 0.292s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:01 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-2a0bd531-f269-4f87-b215-ec0d78d987b8 tempest-CreateVolumesFromSnapshotTest-611704133 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9.info is being set with open permissions: ugo+rw Sep 28 17:22:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2a0bd531-f269-4f87-b215-ec0d78d987b8 tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:01 devstack sudo[100672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9.info Sep 28 17:22:01 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:01 devstack sudo[100667]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e942d113-d885-4350-a262-f76ecc06f6b4 tempest-VolumesSnapshotTestJSON-803354126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260" returned: 0 in 0.450s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e942d113-d885-4350-a262-f76ecc06f6b4 tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:01 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260 Sep 28 17:22:01 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:01 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2a0bd531-f269-4f87-b215-ec0d78d987b8 tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9.info" returned: 0 in 0.294s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2a0bd531-f269-4f87-b215-ec0d78d987b8 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.454s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-38c24157-833e-41a8-a018-55c9f770090b tempest-CinderUnicodeTest-1578719717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.152s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:01 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-38c24157-833e-41a8-a018-55c9f770090b tempest-CinderUnicodeTest-1578719717 None] Creating offline snapshot fba6a598-01ec-4dd5-95e3-4ab64f03223a of volume d5881830-0e5e-4fa6-bfc9-818d37181c32 {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:22:01 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-2a0bd531-f269-4f87-b215-ec0d78d987b8 tempest-CreateVolumesFromSnapshotTest-611704133 None] Create snapshot completed successfully Sep 28 17:22:01 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[56569ed4-c50f-4245-be30-2502e8447f8a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-38c24157-833e-41a8-a018-55c9f770090b tempest-CinderUnicodeTest-1578719717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:01 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e942d113-d885-4350-a262-f76ecc06f6b4 tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f755ea3a-67f5-4662-a7db-534620bcc260" returned: 0 in 0.352s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:02 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e942d113-d885-4350-a262-f76ecc06f6b4 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-quobyte-f755ea3a-67f5-4662-a7db-534620bcc260" released by "delete_volume" :: held 0.901s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:02 devstack sudo[100681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32 Sep 28 17:22:02 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:02 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-e942d113-d885-4350-a262-f76ecc06f6b4 tempest-VolumesSnapshotTestJSON-803354126 None] Created reservations ['5e7c3e51-5bec-4ece-a7d0-f4434102b4de', '3114841d-29e5-46a8-ab85-d5b4bf7abfb0', 'ed87e617-996c-462d-96d2-b891e8d2cadc', '86a132ff-4e6e-40f5-9331-f0761c80ab32'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e942d113-d885-4350-a262-f76ecc06f6b4 tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e942d113-d885-4350-a262-f76ecc06f6b4 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:02 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-e942d113-d885-4350-a262-f76ecc06f6b4 tempest-VolumesSnapshotTestJSON-803354126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:02 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-e942d113-d885-4350-a262-f76ecc06f6b4 tempest-VolumesSnapshotTestJSON-803354126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e942d113-d885-4350-a262-f76ecc06f6b4 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e942d113-d885-4350-a262-f76ecc06f6b4 tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:02 devstack sudo[100683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:22:02 devstack sudo[100683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:02 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-38c24157-833e-41a8-a018-55c9f770090b tempest-CinderUnicodeTest-1578719717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32" returned: 0 in 0.600s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-38c24157-833e-41a8-a018-55c9f770090b tempest-CinderUnicodeTest-1578719717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32.fba6a598-01ec-4dd5-95e3-4ab64f03223a 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:02 devstack sudo[100689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32.fba6a598-01ec-4dd5-95e3-4ab64f03223a 1G Sep 28 17:22:02 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:02 devstack sudo[100683]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e942d113-d885-4350-a262-f76ecc06f6b4 tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.346s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:02 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-e942d113-d885-4350-a262-f76ecc06f6b4 tempest-VolumesSnapshotTestJSON-803354126 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:02 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-e942d113-d885-4350-a262-f76ecc06f6b4 tempest-VolumesSnapshotTestJSON-803354126 None] Deleted volume successfully. Sep 28 17:22:02 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e942d113-d885-4350-a262-f76ecc06f6b4 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-f755ea3a-67f5-4662-a7db-534620bcc260-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:03 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-60c58728-d719-4f05-a746-b994a4075ec4 tempest-CreateVolumesFromSnapshotTest-611704133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-60c58728-d719-4f05-a746-b994a4075ec4 tempest-CreateVolumesFromSnapshotTest-611704133 None] Flow 'volume_create_manager' (f1574c30-7408-477a-a621-11a29e983b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-60c58728-d719-4f05-a746-b994a4075ec4 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33b55a27-5a7f-4a07-840b-6c7a951a41af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:03 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-38c24157-833e-41a8-a018-55c9f770090b tempest-CinderUnicodeTest-1578719717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32.fba6a598-01ec-4dd5-95e3-4ab64f03223a 1G" returned: 0 in 0.730s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-38c24157-833e-41a8-a018-55c9f770090b tempest-CinderUnicodeTest-1578719717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5881830-0e5e-4fa6-bfc9-818d37181c32 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32.fba6a598-01ec-4dd5-95e3-4ab64f03223a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-60c58728-d719-4f05-a746-b994a4075ec4 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33b55a27-5a7f-4a07-840b-6c7a951a41af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1016357417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4deda24e-6a80-4eff-8eed-366316267b24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc0eb4e3cd874a98bc8405b3ebc37f25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:03Z,use_quota=True,user_id='7d2fdeefabaf42a6b31800d6ddf81b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:03 devstack sudo[100695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5881830-0e5e-4fa6-bfc9-818d37181c32 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32.fba6a598-01ec-4dd5-95e3-4ab64f03223a Sep 28 17:22:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-60c58728-d719-4f05-a746-b994a4075ec4 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93596ad9-b134-431a-a8da-da89dd900b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:03 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-60c58728-d719-4f05-a746-b994a4075ec4 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93596ad9-b134-431a-a8da-da89dd900b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-60c58728-d719-4f05-a746-b994a4075ec4 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b534c58-b29c-4a04-af92-810134bbf01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-60c58728-d719-4f05-a746-b994a4075ec4 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b534c58-b29c-4a04-af92-810134bbf01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4deda24e-6a80-4eff-8eed-366316267b24', 'volume_name': 'volume-4deda24e-6a80-4eff-8eed-366316267b24', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-60c58728-d719-4f05-a746-b994a4075ec4 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9586cbb-2402-4ba8-8cf3-4f62eac17ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-60c58728-d719-4f05-a746-b994a4075ec4 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9586cbb-2402-4ba8-8cf3-4f62eac17ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-60c58728-d719-4f05-a746-b994a4075ec4 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (879a3aab-fb12-44b7-961d-94d51a4adef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:03 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-60c58728-d719-4f05-a746-b994a4075ec4 tempest-CreateVolumesFromSnapshotTest-611704133 None] Volume 4deda24e-6a80-4eff-8eed-366316267b24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4deda24e-6a80-4eff-8eed-366316267b24', 'volume_size': 1} Sep 28 17:22:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-60c58728-d719-4f05-a746-b994a4075ec4 tempest-CreateVolumesFromSnapshotTest-611704133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:03 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-713138a6-831b-41fc-8b14-0f1ee3ef68b9 tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "cinder-dc34ab6f-ffce-46b3-ac22-5a65393ac200-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:03 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-713138a6-831b-41fc-8b14-0f1ee3ef68b9 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-dc34ab6f-ffce-46b3-ac22-5a65393ac200-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:03 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-713138a6-831b-41fc-8b14-0f1ee3ef68b9 tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "cinder-quobyte-dc34ab6f-ffce-46b3-ac22-5a65393ac200" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:03 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-713138a6-831b-41fc-8b14-0f1ee3ef68b9 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-quobyte-dc34ab6f-ffce-46b3-ac22-5a65393ac200" acquired by "delete_volume" :: waited 0.019s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:03 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a771f452-8077-41f9-882c-3c8ecd02d988]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-713138a6-831b-41fc-8b14-0f1ee3ef68b9 tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:03 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-38c24157-833e-41a8-a018-55c9f770090b tempest-CinderUnicodeTest-1578719717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5881830-0e5e-4fa6-bfc9-818d37181c32 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32.fba6a598-01ec-4dd5-95e3-4ab64f03223a" returned: 0 in 0.518s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:03 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-38c24157-833e-41a8-a018-55c9f770090b tempest-CinderUnicodeTest-1578719717 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32.fba6a598-01ec-4dd5-95e3-4ab64f03223a is being set with open permissions: ugo+rw Sep 28 17:22:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-38c24157-833e-41a8-a018-55c9f770090b tempest-CinderUnicodeTest-1578719717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32.fba6a598-01ec-4dd5-95e3-4ab64f03223a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:03 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200 Sep 28 17:22:03 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:03 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32.fba6a598-01ec-4dd5-95e3-4ab64f03223a Sep 28 17:22:03 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fbc9a4e-7567-4596-ac74-a2393c69d035 tempest-CreateVolumesFromSnapshotTest-611704133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:03 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5fbc9a4e-7567-4596-ac74-a2393c69d035 tempest-CreateVolumesFromSnapshotTest-611704133 None] Flow 'volume_create_manager' (c18065c8-c141-4f16-bb48-78635ff7a67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5fbc9a4e-7567-4596-ac74-a2393c69d035 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d598e5-0d4d-4a15-84ea-e0f001937d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5fbc9a4e-7567-4596-ac74-a2393c69d035 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d598e5-0d4d-4a15-84ea-e0f001937d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-362636008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d47ab7e-379b-4c82-bac7-ae13e3e1ac02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc0eb4e3cd874a98bc8405b3ebc37f25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:04Z,use_quota=True,user_id='7d2fdeefabaf42a6b31800d6ddf81b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5fbc9a4e-7567-4596-ac74-a2393c69d035 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e73932-314c-4ba5-b4b2-6a2e3a678736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5fbc9a4e-7567-4596-ac74-a2393c69d035 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e73932-314c-4ba5-b4b2-6a2e3a678736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5fbc9a4e-7567-4596-ac74-a2393c69d035 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b96fcba-75bf-41bf-8735-0d950959eedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5fbc9a4e-7567-4596-ac74-a2393c69d035 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b96fcba-75bf-41bf-8735-0d950959eedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d47ab7e-379b-4c82-bac7-ae13e3e1ac02', 'volume_name': 'volume-7d47ab7e-379b-4c82-bac7-ae13e3e1ac02', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5fbc9a4e-7567-4596-ac74-a2393c69d035 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e90b2024-bbfb-40c3-a45e-a113f6c15ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5fbc9a4e-7567-4596-ac74-a2393c69d035 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e90b2024-bbfb-40c3-a45e-a113f6c15ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5fbc9a4e-7567-4596-ac74-a2393c69d035 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed93e1cb-d900-4475-bfa9-db4b7e7ebe9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:03 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-5fbc9a4e-7567-4596-ac74-a2393c69d035 tempest-CreateVolumesFromSnapshotTest-611704133 None] Volume 7d47ab7e-379b-4c82-bac7-ae13e3e1ac02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d47ab7e-379b-4c82-bac7-ae13e3e1ac02', 'volume_size': 1} Sep 28 17:22:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5fbc9a4e-7567-4596-ac74-a2393c69d035 tempest-CreateVolumesFromSnapshotTest-611704133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:04 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-38c24157-833e-41a8-a018-55c9f770090b tempest-CinderUnicodeTest-1578719717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32.fba6a598-01ec-4dd5-95e3-4ab64f03223a" returned: 0 in 0.363s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-38c24157-833e-41a8-a018-55c9f770090b tempest-CinderUnicodeTest-1578719717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:04 devstack sudo[100709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32.info Sep 28 17:22:04 devstack sudo[100709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:04 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-713138a6-831b-41fc-8b14-0f1ee3ef68b9 tempest-VolumesSnapshotTestJSON-803354126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200" returned: 0 in 0.642s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-713138a6-831b-41fc-8b14-0f1ee3ef68b9 tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:04 devstack sudo[100712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200 Sep 28 17:22:04 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:04 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-53c1b90c-6aa0-41eb-83c8-3c28f28e95ec tempest-CreateVolumesFromSnapshotTest-611704133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:04 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-53c1b90c-6aa0-41eb-83c8-3c28f28e95ec tempest-CreateVolumesFromSnapshotTest-611704133 None] Flow 'volume_create_manager' (4335b063-65ee-4161-88e7-aecc559f5fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:04 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-53c1b90c-6aa0-41eb-83c8-3c28f28e95ec tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab61fce3-2411-477b-82b5-99eb5a8ea625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:04 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-53c1b90c-6aa0-41eb-83c8-3c28f28e95ec tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab61fce3-2411-477b-82b5-99eb5a8ea625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1252460630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cde0bd22-f005-482f-80a6-2ad328c81ea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc0eb4e3cd874a98bc8405b3ebc37f25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:04Z,use_quota=True,user_id='7d2fdeefabaf42a6b31800d6ddf81b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:04 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-53c1b90c-6aa0-41eb-83c8-3c28f28e95ec tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa30bf62-f4df-4baa-ac7e-4352a02d44de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:04 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-53c1b90c-6aa0-41eb-83c8-3c28f28e95ec tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa30bf62-f4df-4baa-ac7e-4352a02d44de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:04 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-53c1b90c-6aa0-41eb-83c8-3c28f28e95ec tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f49c2a2-7680-4a7f-b1e4-959c1bb5b288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:04 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-53c1b90c-6aa0-41eb-83c8-3c28f28e95ec tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f49c2a2-7680-4a7f-b1e4-959c1bb5b288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cde0bd22-f005-482f-80a6-2ad328c81ea5', 'volume_name': 'volume-cde0bd22-f005-482f-80a6-2ad328c81ea5', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:04 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-53c1b90c-6aa0-41eb-83c8-3c28f28e95ec tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2b80705-b3e4-4f25-ad63-89efc8a78a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:04 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-53c1b90c-6aa0-41eb-83c8-3c28f28e95ec tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2b80705-b3e4-4f25-ad63-89efc8a78a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:04 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-53c1b90c-6aa0-41eb-83c8-3c28f28e95ec tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed49ec23-7fd8-43f9-bde4-fc13a2bbe601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:04 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-53c1b90c-6aa0-41eb-83c8-3c28f28e95ec tempest-CreateVolumesFromSnapshotTest-611704133 None] Volume cde0bd22-f005-482f-80a6-2ad328c81ea5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cde0bd22-f005-482f-80a6-2ad328c81ea5', 'volume_size': 1} Sep 28 17:22:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-53c1b90c-6aa0-41eb-83c8-3c28f28e95ec tempest-CreateVolumesFromSnapshotTest-611704133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:04 devstack sudo[100709]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-38c24157-833e-41a8-a018-55c9f770090b tempest-CinderUnicodeTest-1578719717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32.info" returned: 0 in 0.494s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:04 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-38c24157-833e-41a8-a018-55c9f770090b tempest-CinderUnicodeTest-1578719717 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32.info is being set with open permissions: ugo+rw Sep 28 17:22:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-38c24157-833e-41a8-a018-55c9f770090b tempest-CinderUnicodeTest-1578719717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:04 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-713138a6-831b-41fc-8b14-0f1ee3ef68b9 tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-dc34ab6f-ffce-46b3-ac22-5a65393ac200" returned: 0 in 0.421s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:04 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32.info Sep 28 17:22:04 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:04 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-713138a6-831b-41fc-8b14-0f1ee3ef68b9 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-quobyte-dc34ab6f-ffce-46b3-ac22-5a65393ac200" released by "delete_volume" :: held 1.197s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:04 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-713138a6-831b-41fc-8b14-0f1ee3ef68b9 tempest-VolumesSnapshotTestJSON-803354126 None] Created reservations ['f5b8427f-ebf9-4eb0-8737-f0aae21c325c', 'eef98f66-e3b6-42f9-9cdb-73db0262963e', '31a58073-c529-4c8f-b5c5-dec0f7aabe0d', '9780bfee-16ab-4b5d-bc4d-28ae941e29ae'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:04 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-39e0ee23-b6f1-45e1-9770-060c47445a2b tempest-CreateVolumesFromSnapshotTest-611704133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-39e0ee23-b6f1-45e1-9770-060c47445a2b tempest-CreateVolumesFromSnapshotTest-611704133 None] Flow 'volume_create_manager' (85c1fd17-56b9-4ca0-a6e4-0433fa1f9adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-39e0ee23-b6f1-45e1-9770-060c47445a2b tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ae270c-6f5e-41a1-8980-028f4f9be4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:05 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-38c24157-833e-41a8-a018-55c9f770090b tempest-CinderUnicodeTest-1578719717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32.info" returned: 0 in 0.386s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-38c24157-833e-41a8-a018-55c9f770090b tempest-CinderUnicodeTest-1578719717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.242s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-60c58728-d719-4f05-a746-b994a4075ec4 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.768s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-60c58728-d719-4f05-a746-b994a4075ec4 tempest-CreateVolumesFromSnapshotTest-611704133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1016357417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4deda24e-6a80-4eff-8eed-366316267b24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc0eb4e3cd874a98bc8405b3ebc37f25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:03Z,use_quota=True,user_id='7d2fdeefabaf42a6b31800d6ddf81b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-60c58728-d719-4f05-a746-b994a4075ec4 tempest-CreateVolumesFromSnapshotTest-611704133 None] Creating volume 4deda24e-6a80-4eff-8eed-366316267b24 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-60c58728-d719-4f05-a746-b994a4075ec4 tempest-CreateVolumesFromSnapshotTest-611704133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-60c58728-d719-4f05-a746-b994a4075ec4 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-60c58728-d719-4f05-a746-b994a4075ec4 tempest-CreateVolumesFromSnapshotTest-611704133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-60c58728-d719-4f05-a746-b994a4075ec4 tempest-CreateVolumesFromSnapshotTest-611704133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-60c58728-d719-4f05-a746-b994a4075ec4 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-60c58728-d719-4f05-a746-b994a4075ec4 tempest-CreateVolumesFromSnapshotTest-611704133 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:05 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-60c58728-d719-4f05-a746-b994a4075ec4 tempest-CreateVolumesFromSnapshotTest-611704133 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-60c58728-d719-4f05-a746-b994a4075ec4 tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4deda24e-6a80-4eff-8eed-366316267b24 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:05 devstack sudo[100721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4deda24e-6a80-4eff-8eed-366316267b24 1073741824 Sep 28 17:22:05 devstack sudo[100721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-39e0ee23-b6f1-45e1-9770-060c47445a2b tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ae270c-6f5e-41a1-8980-028f4f9be4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-295969530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83bcad6f-9707-4c91-ba9f-05d4763c51c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc0eb4e3cd874a98bc8405b3ebc37f25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:05Z,use_quota=True,user_id='7d2fdeefabaf42a6b31800d6ddf81b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-39e0ee23-b6f1-45e1-9770-060c47445a2b tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10ae5715-ea0b-4ac1-91b0-b10e425a0dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-39e0ee23-b6f1-45e1-9770-060c47445a2b tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10ae5715-ea0b-4ac1-91b0-b10e425a0dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-39e0ee23-b6f1-45e1-9770-060c47445a2b tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (723e4df5-e541-4188-b10d-d61c8f0e3911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-39e0ee23-b6f1-45e1-9770-060c47445a2b tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (723e4df5-e541-4188-b10d-d61c8f0e3911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83bcad6f-9707-4c91-ba9f-05d4763c51c3', 'volume_name': 'volume-83bcad6f-9707-4c91-ba9f-05d4763c51c3', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-39e0ee23-b6f1-45e1-9770-060c47445a2b tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7ae3950-2795-4e69-8c47-a554119b5480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-39e0ee23-b6f1-45e1-9770-060c47445a2b tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7ae3950-2795-4e69-8c47-a554119b5480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-39e0ee23-b6f1-45e1-9770-060c47445a2b tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d60bcba9-1bd8-4339-b32a-90ed317369c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:05 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-39e0ee23-b6f1-45e1-9770-060c47445a2b tempest-CreateVolumesFromSnapshotTest-611704133 None] Volume 83bcad6f-9707-4c91-ba9f-05d4763c51c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83bcad6f-9707-4c91-ba9f-05d4763c51c3', 'volume_size': 1} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-39e0ee23-b6f1-45e1-9770-060c47445a2b tempest-CreateVolumesFromSnapshotTest-611704133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:05 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-38c24157-833e-41a8-a018-55c9f770090b tempest-CinderUnicodeTest-1578719717 None] Create snapshot completed successfully Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-713138a6-831b-41fc-8b14-0f1ee3ef68b9 tempest-VolumesSnapshotTestJSON-803354126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-713138a6-831b-41fc-8b14-0f1ee3ef68b9 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-713138a6-831b-41fc-8b14-0f1ee3ef68b9 tempest-VolumesSnapshotTestJSON-803354126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-713138a6-831b-41fc-8b14-0f1ee3ef68b9 tempest-VolumesSnapshotTestJSON-803354126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-713138a6-831b-41fc-8b14-0f1ee3ef68b9 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-713138a6-831b-41fc-8b14-0f1ee3ef68b9 tempest-VolumesSnapshotTestJSON-803354126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:05 devstack sudo[100723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:22:05 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-31da06cb-78fa-4dd5-8618-fe08a307a1ae tempest-CinderUnicodeTest-1578719717 None] Acquiring lock "cinder-fba6a598-01ec-4dd5-95e3-4ab64f03223a-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-31da06cb-78fa-4dd5-8618-fe08a307a1ae tempest-CinderUnicodeTest-1578719717 None] Lock "cinder-fba6a598-01ec-4dd5-95e3-4ab64f03223a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-31da06cb-78fa-4dd5-8618-fe08a307a1ae tempest-CinderUnicodeTest-1578719717 None] Acquiring lock "cinder-quobyte-d5881830-0e5e-4fa6-bfc9-818d37181c32" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-31da06cb-78fa-4dd5-8618-fe08a307a1ae tempest-CinderUnicodeTest-1578719717 None] Lock "cinder-quobyte-d5881830-0e5e-4fa6-bfc9-818d37181c32" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-31da06cb-78fa-4dd5-8618-fe08a307a1ae tempest-CinderUnicodeTest-1578719717 None] Acquiring lock "cinder-quobyte-fba6a598-01ec-4dd5-95e3-4ab64f03223a" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-31da06cb-78fa-4dd5-8618-fe08a307a1ae tempest-CinderUnicodeTest-1578719717 None] Lock "cinder-quobyte-fba6a598-01ec-4dd5-95e3-4ab64f03223a" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-31da06cb-78fa-4dd5-8618-fe08a307a1ae tempest-CinderUnicodeTest-1578719717 None] Deleting offline snapshot fba6a598-01ec-4dd5-95e3-4ab64f03223a of volume d5881830-0e5e-4fa6-bfc9-818d37181c32 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:22:05 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-31da06cb-78fa-4dd5-8618-fe08a307a1ae tempest-CinderUnicodeTest-1578719717 None] snapshot_file for this snap is: volume-d5881830-0e5e-4fa6-bfc9-818d37181c32.fba6a598-01ec-4dd5-95e3-4ab64f03223a {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-713138a6-831b-41fc-8b14-0f1ee3ef68b9 tempest-VolumesSnapshotTestJSON-803354126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.493s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-713138a6-831b-41fc-8b14-0f1ee3ef68b9 tempest-VolumesSnapshotTestJSON-803354126 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:05 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-713138a6-831b-41fc-8b14-0f1ee3ef68b9 tempest-VolumesSnapshotTestJSON-803354126 None] Deleted volume successfully. Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bb89f8-3dc5-43df-96c4-7f9853121aa3]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-31da06cb-78fa-4dd5-8618-fe08a307a1ae tempest-CinderUnicodeTest-1578719717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32.fba6a598-01ec-4dd5-95e3-4ab64f03223a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-713138a6-831b-41fc-8b14-0f1ee3ef68b9 tempest-VolumesSnapshotTestJSON-803354126 None] Lock "cinder-dc34ab6f-ffce-46b3-ac22-5a65393ac200-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:05 devstack sudo[100721]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-11b1794a-61bd-46fe-9c98-3e164084cd04 tempest-AttachVolumeNegativeTest-158509557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:05 devstack sudo[100731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32.fba6a598-01ec-4dd5-95e3-4ab64f03223a Sep 28 17:22:05 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-11b1794a-61bd-46fe-9c98-3e164084cd04 tempest-AttachVolumeNegativeTest-158509557 None] Flow 'volume_create_manager' (f0a8d0ab-7f4a-4dbb-b189-d57ed76a9723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-11b1794a-61bd-46fe-9c98-3e164084cd04 tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6823f388-d660-4343-b13e-c51b4ae90771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-60c58728-d719-4f05-a746-b994a4075ec4 tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4deda24e-6a80-4eff-8eed-366316267b24 1073741824" returned: 0 in 0.829s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-11b1794a-61bd-46fe-9c98-3e164084cd04 tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6823f388-d660-4343-b13e-c51b4ae90771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2078770748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e615c73c-4f44-4215-a039-776f9398eb32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e41dab614240d2b055b96b240d7125',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:06Z,use_quota=True,user_id='f95bafa9537c4a559275623e6bb50109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-11b1794a-61bd-46fe-9c98-3e164084cd04 tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c367ac41-db50-4a29-94f6-5f3e6f35f942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-11b1794a-61bd-46fe-9c98-3e164084cd04 tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c367ac41-db50-4a29-94f6-5f3e6f35f942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-11b1794a-61bd-46fe-9c98-3e164084cd04 tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b88d80c-7599-47d9-923b-ef16dd128354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-11b1794a-61bd-46fe-9c98-3e164084cd04 tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b88d80c-7599-47d9-923b-ef16dd128354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e615c73c-4f44-4215-a039-776f9398eb32', 'volume_name': 'volume-e615c73c-4f44-4215-a039-776f9398eb32', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-11b1794a-61bd-46fe-9c98-3e164084cd04 tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d35eb1-84c2-4d37-8945-55444725b596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-11b1794a-61bd-46fe-9c98-3e164084cd04 tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d35eb1-84c2-4d37-8945-55444725b596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-11b1794a-61bd-46fe-9c98-3e164084cd04 tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3dc3e22-6457-48f4-bf78-8830c9976ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:05 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-11b1794a-61bd-46fe-9c98-3e164084cd04 tempest-AttachVolumeNegativeTest-158509557 None] Volume e615c73c-4f44-4215-a039-776f9398eb32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e615c73c-4f44-4215-a039-776f9398eb32', 'volume_size': 1} Sep 28 17:22:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-11b1794a-61bd-46fe-9c98-3e164084cd04 tempest-AttachVolumeNegativeTest-158509557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-60c58728-d719-4f05-a746-b994a4075ec4 tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4deda24e-6a80-4eff-8eed-366316267b24 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:06 devstack sudo[100733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4deda24e-6a80-4eff-8eed-366316267b24 Sep 28 17:22:06 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b7f348e-e7c0-4321-8aa0-de46255cbef6 tempest-CreateVolumesFromSnapshotTest-611704133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4b7f348e-e7c0-4321-8aa0-de46255cbef6 tempest-CreateVolumesFromSnapshotTest-611704133 None] Flow 'volume_create_manager' (3dcfcbf8-ab98-4880-b6fb-dcbd266e59df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4b7f348e-e7c0-4321-8aa0-de46255cbef6 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a586e944-5963-447c-bf7e-6afeb01a950c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4b7f348e-e7c0-4321-8aa0-de46255cbef6 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a586e944-5963-447c-bf7e-6afeb01a950c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-471563627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bde1a03-6edc-4528-ab27-675806014024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc0eb4e3cd874a98bc8405b3ebc37f25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:06Z,use_quota=True,user_id='7d2fdeefabaf42a6b31800d6ddf81b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4b7f348e-e7c0-4321-8aa0-de46255cbef6 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d904441-caab-47b7-ac19-4abf074093c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4b7f348e-e7c0-4321-8aa0-de46255cbef6 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d904441-caab-47b7-ac19-4abf074093c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4b7f348e-e7c0-4321-8aa0-de46255cbef6 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (285ef227-53b2-4f91-adaa-d25e846ed575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4b7f348e-e7c0-4321-8aa0-de46255cbef6 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (285ef227-53b2-4f91-adaa-d25e846ed575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bde1a03-6edc-4528-ab27-675806014024', 'volume_name': 'volume-8bde1a03-6edc-4528-ab27-675806014024', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4b7f348e-e7c0-4321-8aa0-de46255cbef6 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7d4dca-1617-4750-b722-23c290369bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4b7f348e-e7c0-4321-8aa0-de46255cbef6 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7d4dca-1617-4750-b722-23c290369bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4b7f348e-e7c0-4321-8aa0-de46255cbef6 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a471f2-e088-4fcf-9583-6b2872a6120b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:06 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-4b7f348e-e7c0-4321-8aa0-de46255cbef6 tempest-CreateVolumesFromSnapshotTest-611704133 None] Volume 8bde1a03-6edc-4528-ab27-675806014024: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bde1a03-6edc-4528-ab27-675806014024', 'volume_size': 1} Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4b7f348e-e7c0-4321-8aa0-de46255cbef6 tempest-CreateVolumesFromSnapshotTest-611704133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:06 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-31da06cb-78fa-4dd5-8618-fe08a307a1ae tempest-CinderUnicodeTest-1578719717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32.fba6a598-01ec-4dd5-95e3-4ab64f03223a" returned: 0 in 0.549s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-31da06cb-78fa-4dd5-8618-fe08a307a1ae tempest-CinderUnicodeTest-1578719717 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5881830-0e5e-4fa6-bfc9-818d37181c32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca84c72-1eff-47b7-a929-018baa5ea368]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-31da06cb-78fa-4dd5-8618-fe08a307a1ae tempest-CinderUnicodeTest-1578719717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:06 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-60c58728-d719-4f05-a746-b994a4075ec4 tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4deda24e-6a80-4eff-8eed-366316267b24" returned: 0 in 0.360s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-60c58728-d719-4f05-a746-b994a4075ec4 tempest-CreateVolumesFromSnapshotTest-611704133 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-60c58728-d719-4f05-a746-b994a4075ec4 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5fbc9a4e-7567-4596-ac74-a2393c69d035 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.502s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-5fbc9a4e-7567-4596-ac74-a2393c69d035 tempest-CreateVolumesFromSnapshotTest-611704133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-362636008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d47ab7e-379b-4c82-bac7-ae13e3e1ac02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc0eb4e3cd874a98bc8405b3ebc37f25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:04Z,use_quota=True,user_id='7d2fdeefabaf42a6b31800d6ddf81b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-5fbc9a4e-7567-4596-ac74-a2393c69d035 tempest-CreateVolumesFromSnapshotTest-611704133 None] Creating volume 7d47ab7e-379b-4c82-bac7-ae13e3e1ac02 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5fbc9a4e-7567-4596-ac74-a2393c69d035 tempest-CreateVolumesFromSnapshotTest-611704133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5fbc9a4e-7567-4596-ac74-a2393c69d035 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-5fbc9a4e-7567-4596-ac74-a2393c69d035 tempest-CreateVolumesFromSnapshotTest-611704133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-5fbc9a4e-7567-4596-ac74-a2393c69d035 tempest-CreateVolumesFromSnapshotTest-611704133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5fbc9a4e-7567-4596-ac74-a2393c69d035 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-5fbc9a4e-7567-4596-ac74-a2393c69d035 tempest-CreateVolumesFromSnapshotTest-611704133 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:06 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-5fbc9a4e-7567-4596-ac74-a2393c69d035 tempest-CreateVolumesFromSnapshotTest-611704133 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5fbc9a4e-7567-4596-ac74-a2393c69d035 tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-7d47ab7e-379b-4c82-bac7-ae13e3e1ac02 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-60c58728-d719-4f05-a746-b994a4075ec4 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (879a3aab-fb12-44b7-961d-94d51a4adef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4deda24e-6a80-4eff-8eed-366316267b24', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-60c58728-d719-4f05-a746-b994a4075ec4 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2c6c3da-3a88-40bd-91ee-2f0605c00fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:06 devstack sudo[100740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-7d47ab7e-379b-4c82-bac7-ae13e3e1ac02 1073741824 Sep 28 17:22:06 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:06 devstack sudo[100738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32 Sep 28 17:22:06 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:06 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-60c58728-d719-4f05-a746-b994a4075ec4 tempest-CreateVolumesFromSnapshotTest-611704133 None] Volume volume-4deda24e-6a80-4eff-8eed-366316267b24 (4deda24e-6a80-4eff-8eed-366316267b24): created successfully Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-60c58728-d719-4f05-a746-b994a4075ec4 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2c6c3da-3a88-40bd-91ee-2f0605c00fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-60c58728-d719-4f05-a746-b994a4075ec4 tempest-CreateVolumesFromSnapshotTest-611704133 None] Flow 'volume_create_manager' (f1574c30-7408-477a-a621-11a29e983b32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:06 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-60c58728-d719-4f05-a746-b994a4075ec4 tempest-CreateVolumesFromSnapshotTest-611704133 None] Created volume successfully. Sep 28 17:22:06 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-31da06cb-78fa-4dd5-8618-fe08a307a1ae tempest-CinderUnicodeTest-1578719717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32" returned: 0 in 0.560s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-31da06cb-78fa-4dd5-8618-fe08a307a1ae tempest-CinderUnicodeTest-1578719717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32.fba6a598-01ec-4dd5-95e3-4ab64f03223a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:06 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32.fba6a598-01ec-4dd5-95e3-4ab64f03223a Sep 28 17:22:06 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:07 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5fbc9a4e-7567-4596-ac74-a2393c69d035 tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-7d47ab7e-379b-4c82-bac7-ae13e3e1ac02 1073741824" returned: 0 in 0.710s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5fbc9a4e-7567-4596-ac74-a2393c69d035 tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-7d47ab7e-379b-4c82-bac7-ae13e3e1ac02 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:07 devstack sudo[100756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-7d47ab7e-379b-4c82-bac7-ae13e3e1ac02 Sep 28 17:22:07 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:07 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-31da06cb-78fa-4dd5-8618-fe08a307a1ae tempest-CinderUnicodeTest-1578719717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32.fba6a598-01ec-4dd5-95e3-4ab64f03223a" returned: 0 in 0.572s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-31da06cb-78fa-4dd5-8618-fe08a307a1ae tempest-CinderUnicodeTest-1578719717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32.fba6a598-01ec-4dd5-95e3-4ab64f03223a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:07 devstack sudo[100760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32.fba6a598-01ec-4dd5-95e3-4ab64f03223a Sep 28 17:22:07 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:07 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5fbc9a4e-7567-4596-ac74-a2393c69d035 tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-7d47ab7e-379b-4c82-bac7-ae13e3e1ac02" returned: 0 in 0.332s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:07 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-5fbc9a4e-7567-4596-ac74-a2393c69d035 tempest-CreateVolumesFromSnapshotTest-611704133 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5fbc9a4e-7567-4596-ac74-a2393c69d035 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-53c1b90c-6aa0-41eb-83c8-3c28f28e95ec tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:07 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-53c1b90c-6aa0-41eb-83c8-3c28f28e95ec tempest-CreateVolumesFromSnapshotTest-611704133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1252460630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cde0bd22-f005-482f-80a6-2ad328c81ea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc0eb4e3cd874a98bc8405b3ebc37f25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:04Z,use_quota=True,user_id='7d2fdeefabaf42a6b31800d6ddf81b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:07 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-53c1b90c-6aa0-41eb-83c8-3c28f28e95ec tempest-CreateVolumesFromSnapshotTest-611704133 None] Creating volume cde0bd22-f005-482f-80a6-2ad328c81ea5 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-53c1b90c-6aa0-41eb-83c8-3c28f28e95ec tempest-CreateVolumesFromSnapshotTest-611704133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-53c1b90c-6aa0-41eb-83c8-3c28f28e95ec tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:07 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-53c1b90c-6aa0-41eb-83c8-3c28f28e95ec tempest-CreateVolumesFromSnapshotTest-611704133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:07 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-53c1b90c-6aa0-41eb-83c8-3c28f28e95ec tempest-CreateVolumesFromSnapshotTest-611704133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-53c1b90c-6aa0-41eb-83c8-3c28f28e95ec tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:07 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-53c1b90c-6aa0-41eb-83c8-3c28f28e95ec tempest-CreateVolumesFromSnapshotTest-611704133 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:07 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-53c1b90c-6aa0-41eb-83c8-3c28f28e95ec tempest-CreateVolumesFromSnapshotTest-611704133 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:22:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-53c1b90c-6aa0-41eb-83c8-3c28f28e95ec tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cde0bd22-f005-482f-80a6-2ad328c81ea5 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5fbc9a4e-7567-4596-ac74-a2393c69d035 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed93e1cb-d900-4475-bfa9-db4b7e7ebe9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d47ab7e-379b-4c82-bac7-ae13e3e1ac02', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5fbc9a4e-7567-4596-ac74-a2393c69d035 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29a200ea-3823-434c-abb6-b5105f7b2499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:07 devstack sudo[100763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cde0bd22-f005-482f-80a6-2ad328c81ea5 1073741824 Sep 28 17:22:07 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:07 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-5fbc9a4e-7567-4596-ac74-a2393c69d035 tempest-CreateVolumesFromSnapshotTest-611704133 None] Volume volume-7d47ab7e-379b-4c82-bac7-ae13e3e1ac02 (7d47ab7e-379b-4c82-bac7-ae13e3e1ac02): created successfully Sep 28 17:22:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5fbc9a4e-7567-4596-ac74-a2393c69d035 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29a200ea-3823-434c-abb6-b5105f7b2499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5fbc9a4e-7567-4596-ac74-a2393c69d035 tempest-CreateVolumesFromSnapshotTest-611704133 None] Flow 'volume_create_manager' (c18065c8-c141-4f16-bb48-78635ff7a67b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:07 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-5fbc9a4e-7567-4596-ac74-a2393c69d035 tempest-CreateVolumesFromSnapshotTest-611704133 None] Created volume successfully. Sep 28 17:22:07 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-31da06cb-78fa-4dd5-8618-fe08a307a1ae tempest-CinderUnicodeTest-1578719717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32.fba6a598-01ec-4dd5-95e3-4ab64f03223a" returned: 0 in 0.400s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:07 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-31da06cb-78fa-4dd5-8618-fe08a307a1ae tempest-CinderUnicodeTest-1578719717 None] Lock "cinder-quobyte-fba6a598-01ec-4dd5-95e3-4ab64f03223a" released by "_delete_snapshot" :: held 2.248s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:07 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-31da06cb-78fa-4dd5-8618-fe08a307a1ae tempest-CinderUnicodeTest-1578719717 None] Lock "cinder-quobyte-d5881830-0e5e-4fa6-bfc9-818d37181c32" released by "delete_snapshot" :: held 2.290s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:08 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-31da06cb-78fa-4dd5-8618-fe08a307a1ae tempest-CinderUnicodeTest-1578719717 None] Created reservations ['23c6d554-a99c-4de4-893b-99d2fe65bcf3', '897e27ec-79f7-4026-bcab-aeb817967b3f', '3569986d-627f-4420-9bb8-b51baed03c37', 'fa37f00a-6270-4bc8-aa4b-bbc733691e88'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:08 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-31da06cb-78fa-4dd5-8618-fe08a307a1ae tempest-CinderUnicodeTest-1578719717 None] Delete snapshot completed successfully. Sep 28 17:22:08 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-31da06cb-78fa-4dd5-8618-fe08a307a1ae tempest-CinderUnicodeTest-1578719717 None] Lock "cinder-fba6a598-01ec-4dd5-95e3-4ab64f03223a-delete_snapshot" released by "delete_snapshot" :: held 2.517s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:08 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-53c1b90c-6aa0-41eb-83c8-3c28f28e95ec tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cde0bd22-f005-482f-80a6-2ad328c81ea5 1073741824" returned: 0 in 0.662s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-53c1b90c-6aa0-41eb-83c8-3c28f28e95ec tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cde0bd22-f005-482f-80a6-2ad328c81ea5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:08 devstack sudo[100770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cde0bd22-f005-482f-80a6-2ad328c81ea5 Sep 28 17:22:08 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:08 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-53c1b90c-6aa0-41eb-83c8-3c28f28e95ec tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cde0bd22-f005-482f-80a6-2ad328c81ea5" returned: 0 in 0.375s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:08 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-53c1b90c-6aa0-41eb-83c8-3c28f28e95ec tempest-CreateVolumesFromSnapshotTest-611704133 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-53c1b90c-6aa0-41eb-83c8-3c28f28e95ec tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-39e0ee23-b6f1-45e1-9770-060c47445a2b tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.494s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:08 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-39e0ee23-b6f1-45e1-9770-060c47445a2b tempest-CreateVolumesFromSnapshotTest-611704133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-295969530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83bcad6f-9707-4c91-ba9f-05d4763c51c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc0eb4e3cd874a98bc8405b3ebc37f25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:05Z,use_quota=True,user_id='7d2fdeefabaf42a6b31800d6ddf81b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:08 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-39e0ee23-b6f1-45e1-9770-060c47445a2b tempest-CreateVolumesFromSnapshotTest-611704133 None] Creating volume 83bcad6f-9707-4c91-ba9f-05d4763c51c3 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-39e0ee23-b6f1-45e1-9770-060c47445a2b tempest-CreateVolumesFromSnapshotTest-611704133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-39e0ee23-b6f1-45e1-9770-060c47445a2b tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:08 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-39e0ee23-b6f1-45e1-9770-060c47445a2b tempest-CreateVolumesFromSnapshotTest-611704133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:08 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-39e0ee23-b6f1-45e1-9770-060c47445a2b tempest-CreateVolumesFromSnapshotTest-611704133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-39e0ee23-b6f1-45e1-9770-060c47445a2b tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:08 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-39e0ee23-b6f1-45e1-9770-060c47445a2b tempest-CreateVolumesFromSnapshotTest-611704133 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:08 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-39e0ee23-b6f1-45e1-9770-060c47445a2b tempest-CreateVolumesFromSnapshotTest-611704133 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:22:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-39e0ee23-b6f1-45e1-9770-060c47445a2b tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-83bcad6f-9707-4c91-ba9f-05d4763c51c3 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:08 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-53c1b90c-6aa0-41eb-83c8-3c28f28e95ec tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed49ec23-7fd8-43f9-bde4-fc13a2bbe601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cde0bd22-f005-482f-80a6-2ad328c81ea5', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:08 devstack sudo[100773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-83bcad6f-9707-4c91-ba9f-05d4763c51c3 1073741824 Sep 28 17:22:08 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-53c1b90c-6aa0-41eb-83c8-3c28f28e95ec tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c5eaa7e-1cd3-4736-a871-5fc7dde79056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:08 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:08 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-53c1b90c-6aa0-41eb-83c8-3c28f28e95ec tempest-CreateVolumesFromSnapshotTest-611704133 None] Volume volume-cde0bd22-f005-482f-80a6-2ad328c81ea5 (cde0bd22-f005-482f-80a6-2ad328c81ea5): created successfully Sep 28 17:22:08 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-53c1b90c-6aa0-41eb-83c8-3c28f28e95ec tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c5eaa7e-1cd3-4736-a871-5fc7dde79056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:08 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-53c1b90c-6aa0-41eb-83c8-3c28f28e95ec tempest-CreateVolumesFromSnapshotTest-611704133 None] Flow 'volume_create_manager' (4335b063-65ee-4161-88e7-aecc559f5fde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:08 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-53c1b90c-6aa0-41eb-83c8-3c28f28e95ec tempest-CreateVolumesFromSnapshotTest-611704133 None] Created volume successfully. Sep 28 17:22:08 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1fa7cd5a-f079-483d-b042-ab8b0fca7c33 tempest-CinderUnicodeTest-1578719717 None] Acquiring lock "cinder-d5881830-0e5e-4fa6-bfc9-818d37181c32-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:08 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1fa7cd5a-f079-483d-b042-ab8b0fca7c33 tempest-CinderUnicodeTest-1578719717 None] Lock "cinder-d5881830-0e5e-4fa6-bfc9-818d37181c32-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:09 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1fa7cd5a-f079-483d-b042-ab8b0fca7c33 tempest-CinderUnicodeTest-1578719717 None] Acquiring lock "cinder-quobyte-d5881830-0e5e-4fa6-bfc9-818d37181c32" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:09 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1fa7cd5a-f079-483d-b042-ab8b0fca7c33 tempest-CinderUnicodeTest-1578719717 None] Lock "cinder-quobyte-d5881830-0e5e-4fa6-bfc9-818d37181c32" acquired by "delete_volume" :: waited 0.039s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:09 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbf7d01-4761-491c-98c4-ab76c7e8d92d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1fa7cd5a-f079-483d-b042-ab8b0fca7c33 tempest-CinderUnicodeTest-1578719717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:09 devstack sudo[100778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32 Sep 28 17:22:09 devstack sudo[100778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:09 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-39e0ee23-b6f1-45e1-9770-060c47445a2b tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-83bcad6f-9707-4c91-ba9f-05d4763c51c3 1073741824" returned: 0 in 0.821s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-39e0ee23-b6f1-45e1-9770-060c47445a2b tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-83bcad6f-9707-4c91-ba9f-05d4763c51c3 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:09 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-83bcad6f-9707-4c91-ba9f-05d4763c51c3 Sep 28 17:22:09 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:09 devstack sudo[100778]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1fa7cd5a-f079-483d-b042-ab8b0fca7c33 tempest-CinderUnicodeTest-1578719717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32" returned: 0 in 0.536s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1fa7cd5a-f079-483d-b042-ab8b0fca7c33 tempest-CinderUnicodeTest-1578719717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:09 devstack sudo[100786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32 Sep 28 17:22:09 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:09 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-39e0ee23-b6f1-45e1-9770-060c47445a2b tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-83bcad6f-9707-4c91-ba9f-05d4763c51c3" returned: 0 in 0.324s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-39e0ee23-b6f1-45e1-9770-060c47445a2b tempest-CreateVolumesFromSnapshotTest-611704133 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-39e0ee23-b6f1-45e1-9770-060c47445a2b tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-11b1794a-61bd-46fe-9c98-3e164084cd04 tempest-AttachVolumeNegativeTest-158509557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.895s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-11b1794a-61bd-46fe-9c98-3e164084cd04 tempest-AttachVolumeNegativeTest-158509557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2078770748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e615c73c-4f44-4215-a039-776f9398eb32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e41dab614240d2b055b96b240d7125',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:06Z,use_quota=True,user_id='f95bafa9537c4a559275623e6bb50109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-11b1794a-61bd-46fe-9c98-3e164084cd04 tempest-AttachVolumeNegativeTest-158509557 None] Creating volume e615c73c-4f44-4215-a039-776f9398eb32 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-11b1794a-61bd-46fe-9c98-3e164084cd04 tempest-AttachVolumeNegativeTest-158509557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-11b1794a-61bd-46fe-9c98-3e164084cd04 tempest-AttachVolumeNegativeTest-158509557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-11b1794a-61bd-46fe-9c98-3e164084cd04 tempest-AttachVolumeNegativeTest-158509557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-11b1794a-61bd-46fe-9c98-3e164084cd04 tempest-AttachVolumeNegativeTest-158509557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-11b1794a-61bd-46fe-9c98-3e164084cd04 tempest-AttachVolumeNegativeTest-158509557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-11b1794a-61bd-46fe-9c98-3e164084cd04 tempest-AttachVolumeNegativeTest-158509557 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:09 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-11b1794a-61bd-46fe-9c98-3e164084cd04 tempest-AttachVolumeNegativeTest-158509557 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:22:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-11b1794a-61bd-46fe-9c98-3e164084cd04 tempest-AttachVolumeNegativeTest-158509557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e615c73c-4f44-4215-a039-776f9398eb32 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-39e0ee23-b6f1-45e1-9770-060c47445a2b tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d60bcba9-1bd8-4339-b32a-90ed317369c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83bcad6f-9707-4c91-ba9f-05d4763c51c3', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-39e0ee23-b6f1-45e1-9770-060c47445a2b tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a08ba733-54ab-46af-b90f-e8e50c821947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:09 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e615c73c-4f44-4215-a039-776f9398eb32 1073741824 Sep 28 17:22:09 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:09 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-39e0ee23-b6f1-45e1-9770-060c47445a2b tempest-CreateVolumesFromSnapshotTest-611704133 None] Volume volume-83bcad6f-9707-4c91-ba9f-05d4763c51c3 (83bcad6f-9707-4c91-ba9f-05d4763c51c3): created successfully Sep 28 17:22:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-39e0ee23-b6f1-45e1-9770-060c47445a2b tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a08ba733-54ab-46af-b90f-e8e50c821947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-39e0ee23-b6f1-45e1-9770-060c47445a2b tempest-CreateVolumesFromSnapshotTest-611704133 None] Flow 'volume_create_manager' (85c1fd17-56b9-4ca0-a6e4-0433fa1f9adb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:10 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-39e0ee23-b6f1-45e1-9770-060c47445a2b tempest-CreateVolumesFromSnapshotTest-611704133 None] Created volume successfully. Sep 28 17:22:10 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1fa7cd5a-f079-483d-b042-ab8b0fca7c33 tempest-CinderUnicodeTest-1578719717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d5881830-0e5e-4fa6-bfc9-818d37181c32" returned: 0 in 0.438s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:10 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1fa7cd5a-f079-483d-b042-ab8b0fca7c33 tempest-CinderUnicodeTest-1578719717 None] Lock "cinder-quobyte-d5881830-0e5e-4fa6-bfc9-818d37181c32" released by "delete_volume" :: held 1.092s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:10 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-1fa7cd5a-f079-483d-b042-ab8b0fca7c33 tempest-CinderUnicodeTest-1578719717 None] Created reservations ['afa78d13-2d9b-4c02-9993-abc7a0f00953', 'dfde92d7-fe91-487a-ad8d-23e884b4a72c', '00f9a068-edb1-4ee2-9387-56029e1a1fcd', 'd06d6b6f-d56a-40a8-9ad0-c0f29f3f6418'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1fa7cd5a-f079-483d-b042-ab8b0fca7c33 tempest-CinderUnicodeTest-1578719717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1fa7cd5a-f079-483d-b042-ab8b0fca7c33 tempest-CinderUnicodeTest-1578719717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:10 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-1fa7cd5a-f079-483d-b042-ab8b0fca7c33 tempest-CinderUnicodeTest-1578719717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:10 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-1fa7cd5a-f079-483d-b042-ab8b0fca7c33 tempest-CinderUnicodeTest-1578719717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1fa7cd5a-f079-483d-b042-ab8b0fca7c33 tempest-CinderUnicodeTest-1578719717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1fa7cd5a-f079-483d-b042-ab8b0fca7c33 tempest-CinderUnicodeTest-1578719717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:10 devstack sudo[100795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:22:10 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:10 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-11b1794a-61bd-46fe-9c98-3e164084cd04 tempest-AttachVolumeNegativeTest-158509557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e615c73c-4f44-4215-a039-776f9398eb32 1073741824" returned: 0 in 0.726s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-11b1794a-61bd-46fe-9c98-3e164084cd04 tempest-AttachVolumeNegativeTest-158509557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e615c73c-4f44-4215-a039-776f9398eb32 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:10 devstack sudo[100799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e615c73c-4f44-4215-a039-776f9398eb32 Sep 28 17:22:10 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:10 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1fa7cd5a-f079-483d-b042-ab8b0fca7c33 tempest-CinderUnicodeTest-1578719717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.350s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:10 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-1fa7cd5a-f079-483d-b042-ab8b0fca7c33 tempest-CinderUnicodeTest-1578719717 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:10 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-1fa7cd5a-f079-483d-b042-ab8b0fca7c33 tempest-CinderUnicodeTest-1578719717 None] Deleted volume successfully. Sep 28 17:22:10 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1fa7cd5a-f079-483d-b042-ab8b0fca7c33 tempest-CinderUnicodeTest-1578719717 None] Lock "cinder-d5881830-0e5e-4fa6-bfc9-818d37181c32-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:11 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-11b1794a-61bd-46fe-9c98-3e164084cd04 tempest-AttachVolumeNegativeTest-158509557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e615c73c-4f44-4215-a039-776f9398eb32" returned: 0 in 0.325s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-11b1794a-61bd-46fe-9c98-3e164084cd04 tempest-AttachVolumeNegativeTest-158509557 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-11b1794a-61bd-46fe-9c98-3e164084cd04 tempest-AttachVolumeNegativeTest-158509557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4b7f348e-e7c0-4321-8aa0-de46255cbef6 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.832s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4b7f348e-e7c0-4321-8aa0-de46255cbef6 tempest-CreateVolumesFromSnapshotTest-611704133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-471563627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bde1a03-6edc-4528-ab27-675806014024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc0eb4e3cd874a98bc8405b3ebc37f25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:06Z,use_quota=True,user_id='7d2fdeefabaf42a6b31800d6ddf81b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-4b7f348e-e7c0-4321-8aa0-de46255cbef6 tempest-CreateVolumesFromSnapshotTest-611704133 None] Creating volume 8bde1a03-6edc-4528-ab27-675806014024 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4b7f348e-e7c0-4321-8aa0-de46255cbef6 tempest-CreateVolumesFromSnapshotTest-611704133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4b7f348e-e7c0-4321-8aa0-de46255cbef6 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4b7f348e-e7c0-4321-8aa0-de46255cbef6 tempest-CreateVolumesFromSnapshotTest-611704133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4b7f348e-e7c0-4321-8aa0-de46255cbef6 tempest-CreateVolumesFromSnapshotTest-611704133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4b7f348e-e7c0-4321-8aa0-de46255cbef6 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4b7f348e-e7c0-4321-8aa0-de46255cbef6 tempest-CreateVolumesFromSnapshotTest-611704133 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:11 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-4b7f348e-e7c0-4321-8aa0-de46255cbef6 tempest-CreateVolumesFromSnapshotTest-611704133 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:22:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4b7f348e-e7c0-4321-8aa0-de46255cbef6 tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8bde1a03-6edc-4528-ab27-675806014024 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-11b1794a-61bd-46fe-9c98-3e164084cd04 tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3dc3e22-6457-48f4-bf78-8830c9976ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e615c73c-4f44-4215-a039-776f9398eb32', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-11b1794a-61bd-46fe-9c98-3e164084cd04 tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a61ca2c-e662-4bf1-a697-8ac253a23413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:11 devstack sudo[100803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8bde1a03-6edc-4528-ab27-675806014024 1073741824 Sep 28 17:22:11 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:11 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-11b1794a-61bd-46fe-9c98-3e164084cd04 tempest-AttachVolumeNegativeTest-158509557 None] Volume volume-e615c73c-4f44-4215-a039-776f9398eb32 (e615c73c-4f44-4215-a039-776f9398eb32): created successfully Sep 28 17:22:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-11b1794a-61bd-46fe-9c98-3e164084cd04 tempest-AttachVolumeNegativeTest-158509557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a61ca2c-e662-4bf1-a697-8ac253a23413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-11b1794a-61bd-46fe-9c98-3e164084cd04 tempest-AttachVolumeNegativeTest-158509557 None] Flow 'volume_create_manager' (f0a8d0ab-7f4a-4dbb-b189-d57ed76a9723) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:11 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-11b1794a-61bd-46fe-9c98-3e164084cd04 tempest-AttachVolumeNegativeTest-158509557 None] Created volume successfully. Sep 28 17:22:11 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1fdb2c0e-0b03-48d7-9038-8bc75732d821 tempest-CinderUnicodeTest-1578719717 None] Acquiring lock "cinder-409c5de1-ccac-4aca-98c9-e1e80ec15255-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:11 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1fdb2c0e-0b03-48d7-9038-8bc75732d821 tempest-CinderUnicodeTest-1578719717 None] Lock "cinder-409c5de1-ccac-4aca-98c9-e1e80ec15255-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:11 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1fdb2c0e-0b03-48d7-9038-8bc75732d821 tempest-CinderUnicodeTest-1578719717 None] Acquiring lock "cinder-quobyte-409c5de1-ccac-4aca-98c9-e1e80ec15255" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:11 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1fdb2c0e-0b03-48d7-9038-8bc75732d821 tempest-CinderUnicodeTest-1578719717 None] Lock "cinder-quobyte-409c5de1-ccac-4aca-98c9-e1e80ec15255" acquired by "delete_volume" :: waited 0.023s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:11 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bf2fed-0d9a-4cff-a222-24ce813c4369]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1fdb2c0e-0b03-48d7-9038-8bc75732d821 tempest-CinderUnicodeTest-1578719717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-409c5de1-ccac-4aca-98c9-e1e80ec15255 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:11 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-409c5de1-ccac-4aca-98c9-e1e80ec15255 Sep 28 17:22:11 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:11 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4b7f348e-e7c0-4321-8aa0-de46255cbef6 tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8bde1a03-6edc-4528-ab27-675806014024 1073741824" returned: 0 in 0.768s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4b7f348e-e7c0-4321-8aa0-de46255cbef6 tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8bde1a03-6edc-4528-ab27-675806014024 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:11 devstack sudo[100811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8bde1a03-6edc-4528-ab27-675806014024 Sep 28 17:22:11 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:12 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1fdb2c0e-0b03-48d7-9038-8bc75732d821 tempest-CinderUnicodeTest-1578719717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-409c5de1-ccac-4aca-98c9-e1e80ec15255" returned: 0 in 0.641s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1fdb2c0e-0b03-48d7-9038-8bc75732d821 tempest-CinderUnicodeTest-1578719717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-409c5de1-ccac-4aca-98c9-e1e80ec15255 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:12 devstack sudo[100817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-409c5de1-ccac-4aca-98c9-e1e80ec15255 Sep 28 17:22:12 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:12 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4b7f348e-e7c0-4321-8aa0-de46255cbef6 tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8bde1a03-6edc-4528-ab27-675806014024" returned: 0 in 0.345s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:12 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4b7f348e-e7c0-4321-8aa0-de46255cbef6 tempest-CreateVolumesFromSnapshotTest-611704133 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4b7f348e-e7c0-4321-8aa0-de46255cbef6 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4b7f348e-e7c0-4321-8aa0-de46255cbef6 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a471f2-e088-4fcf-9583-6b2872a6120b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bde1a03-6edc-4528-ab27-675806014024', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4b7f348e-e7c0-4321-8aa0-de46255cbef6 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (663932d2-3620-44e8-a145-e3ce9ca8cd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:12 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-4b7f348e-e7c0-4321-8aa0-de46255cbef6 tempest-CreateVolumesFromSnapshotTest-611704133 None] Volume volume-8bde1a03-6edc-4528-ab27-675806014024 (8bde1a03-6edc-4528-ab27-675806014024): created successfully Sep 28 17:22:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4b7f348e-e7c0-4321-8aa0-de46255cbef6 tempest-CreateVolumesFromSnapshotTest-611704133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (663932d2-3620-44e8-a145-e3ce9ca8cd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4b7f348e-e7c0-4321-8aa0-de46255cbef6 tempest-CreateVolumesFromSnapshotTest-611704133 None] Flow 'volume_create_manager' (3dcfcbf8-ab98-4880-b6fb-dcbd266e59df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:12 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-4b7f348e-e7c0-4321-8aa0-de46255cbef6 tempest-CreateVolumesFromSnapshotTest-611704133 None] Created volume successfully. Sep 28 17:22:12 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1fdb2c0e-0b03-48d7-9038-8bc75732d821 tempest-CinderUnicodeTest-1578719717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-409c5de1-ccac-4aca-98c9-e1e80ec15255" returned: 0 in 0.398s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:12 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1fdb2c0e-0b03-48d7-9038-8bc75732d821 tempest-CinderUnicodeTest-1578719717 None] Lock "cinder-quobyte-409c5de1-ccac-4aca-98c9-e1e80ec15255" released by "delete_volume" :: held 1.133s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:12 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-1fdb2c0e-0b03-48d7-9038-8bc75732d821 tempest-CinderUnicodeTest-1578719717 None] Created reservations ['61d8d10c-b17a-4f82-bff2-b043b678b857', 'd4d85a26-ef88-4b5a-8fdd-e6539666a31d', '65006093-53f9-4cbf-a06a-20129c06f580', '580c1364-93ce-4ee6-ad71-5a47e7a7abd2'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1fdb2c0e-0b03-48d7-9038-8bc75732d821 tempest-CinderUnicodeTest-1578719717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1fdb2c0e-0b03-48d7-9038-8bc75732d821 tempest-CinderUnicodeTest-1578719717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:12 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-1fdb2c0e-0b03-48d7-9038-8bc75732d821 tempest-CinderUnicodeTest-1578719717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:12 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-1fdb2c0e-0b03-48d7-9038-8bc75732d821 tempest-CinderUnicodeTest-1578719717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1fdb2c0e-0b03-48d7-9038-8bc75732d821 tempest-CinderUnicodeTest-1578719717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1fdb2c0e-0b03-48d7-9038-8bc75732d821 tempest-CinderUnicodeTest-1578719717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:12 devstack sudo[100823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:22:12 devstack sudo[100823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:12 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-611ba503-2519-41a7-ba76-0cfcf895d791 tempest-CreateVolumesFromSnapshotTest-611704133 None] Acquiring lock "cinder-8bde1a03-6edc-4528-ab27-675806014024-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:12 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-611ba503-2519-41a7-ba76-0cfcf895d791 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "cinder-8bde1a03-6edc-4528-ab27-675806014024-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:13 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-611ba503-2519-41a7-ba76-0cfcf895d791 tempest-CreateVolumesFromSnapshotTest-611704133 None] Acquiring lock "cinder-quobyte-8bde1a03-6edc-4528-ab27-675806014024" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:13 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-611ba503-2519-41a7-ba76-0cfcf895d791 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "cinder-quobyte-8bde1a03-6edc-4528-ab27-675806014024" acquired by "delete_volume" :: waited 0.033s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:13 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d350cd9b-bd9f-4e49-bcf0-3d0bf22c9edb]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-611ba503-2519-41a7-ba76-0cfcf895d791 tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8bde1a03-6edc-4528-ab27-675806014024 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:13 devstack sudo[100823]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1fdb2c0e-0b03-48d7-9038-8bc75732d821 tempest-CinderUnicodeTest-1578719717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.427s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:13 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-1fdb2c0e-0b03-48d7-9038-8bc75732d821 tempest-CinderUnicodeTest-1578719717 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:13 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-1fdb2c0e-0b03-48d7-9038-8bc75732d821 tempest-CinderUnicodeTest-1578719717 None] Deleted volume successfully. Sep 28 17:22:13 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1fdb2c0e-0b03-48d7-9038-8bc75732d821 tempest-CinderUnicodeTest-1578719717 None] Lock "cinder-409c5de1-ccac-4aca-98c9-e1e80ec15255-delete_volume" released by "delete_volume" :: held 1.979s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:13 devstack sudo[100829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8bde1a03-6edc-4528-ab27-675806014024 Sep 28 17:22:13 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-611ba503-2519-41a7-ba76-0cfcf895d791 tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8bde1a03-6edc-4528-ab27-675806014024" returned: 0 in 0.682s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-611ba503-2519-41a7-ba76-0cfcf895d791 tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8bde1a03-6edc-4528-ab27-675806014024 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:13 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:13 devstack sudo[100849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8bde1a03-6edc-4528-ab27-675806014024 Sep 28 17:22:13 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-8865a7b4-a545-427a-8b15-683f97879cd7 req-c7f4ca94-1f72-4a19-870c-ccea1803ab8f tempest-AttachVolumeNegativeTest-158509557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-8865a7b4-a545-427a-8b15-683f97879cd7 req-c7f4ca94-1f72-4a19-870c-ccea1803ab8f tempest-AttachVolumeNegativeTest-158509557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-8865a7b4-a545-427a-8b15-683f97879cd7 req-c7f4ca94-1f72-4a19-870c-ccea1803ab8f tempest-AttachVolumeNegativeTest-158509557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-8865a7b4-a545-427a-8b15-683f97879cd7 req-c7f4ca94-1f72-4a19-870c-ccea1803ab8f tempest-AttachVolumeNegativeTest-158509557 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069', 'name': 'volume-e615c73c-4f44-4215-a039-776f9398eb32', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dbf15670-04dc-4c60-a83b-4bc1cd9045ca', 'enforce_multipath': True} {{(pid=86917) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:22:14 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-8865a7b4-a545-427a-8b15-683f97879cd7 req-c7f4ca94-1f72-4a19-870c-ccea1803ab8f tempest-AttachVolumeNegativeTest-158509557 None] attachment_update completed successfully. Sep 28 17:22:14 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-611ba503-2519-41a7-ba76-0cfcf895d791 tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8bde1a03-6edc-4528-ab27-675806014024" returned: 0 in 0.424s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:14 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-611ba503-2519-41a7-ba76-0cfcf895d791 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "cinder-quobyte-8bde1a03-6edc-4528-ab27-675806014024" released by "delete_volume" :: held 1.202s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:14 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-611ba503-2519-41a7-ba76-0cfcf895d791 tempest-CreateVolumesFromSnapshotTest-611704133 None] Created reservations ['f0adba88-ec2c-4881-b807-e1f315a08587', 'f5dd554e-4782-4418-84dc-ce609424eccc', '1d82e583-6c29-452d-b03a-d814e0c1b94a', '6175b9e7-bdaf-4856-8d9e-2c4df46148e4'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-611ba503-2519-41a7-ba76-0cfcf895d791 tempest-CreateVolumesFromSnapshotTest-611704133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-611ba503-2519-41a7-ba76-0cfcf895d791 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:14 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-611ba503-2519-41a7-ba76-0cfcf895d791 tempest-CreateVolumesFromSnapshotTest-611704133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:14 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-611ba503-2519-41a7-ba76-0cfcf895d791 tempest-CreateVolumesFromSnapshotTest-611704133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-611ba503-2519-41a7-ba76-0cfcf895d791 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-611ba503-2519-41a7-ba76-0cfcf895d791 tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:14 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:22:14 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:15 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-611ba503-2519-41a7-ba76-0cfcf895d791 tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.420s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:15 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-611ba503-2519-41a7-ba76-0cfcf895d791 tempest-CreateVolumesFromSnapshotTest-611704133 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:15 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-611ba503-2519-41a7-ba76-0cfcf895d791 tempest-CreateVolumesFromSnapshotTest-611704133 None] Deleted volume successfully. Sep 28 17:22:15 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-611ba503-2519-41a7-ba76-0cfcf895d791 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "cinder-8bde1a03-6edc-4528-ab27-675806014024-delete_volume" released by "delete_volume" :: held 2.123s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:15 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-595b1841-bf9f-4a86-80e1-f7e4f06ad76e tempest-CreateVolumesFromSnapshotTest-611704133 None] Acquiring lock "cinder-83bcad6f-9707-4c91-ba9f-05d4763c51c3-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:15 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-595b1841-bf9f-4a86-80e1-f7e4f06ad76e tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "cinder-83bcad6f-9707-4c91-ba9f-05d4763c51c3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:15 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-595b1841-bf9f-4a86-80e1-f7e4f06ad76e tempest-CreateVolumesFromSnapshotTest-611704133 None] Acquiring lock "cinder-quobyte-83bcad6f-9707-4c91-ba9f-05d4763c51c3" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:15 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-595b1841-bf9f-4a86-80e1-f7e4f06ad76e tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "cinder-quobyte-83bcad6f-9707-4c91-ba9f-05d4763c51c3" acquired by "delete_volume" :: waited 0.034s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:15 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21cfd92-7c07-489c-ac2c-61099d3d7831]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-595b1841-bf9f-4a86-80e1-f7e4f06ad76e tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-83bcad6f-9707-4c91-ba9f-05d4763c51c3 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:15 devstack sudo[101273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-83bcad6f-9707-4c91-ba9f-05d4763c51c3 Sep 28 17:22:15 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:16 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-595b1841-bf9f-4a86-80e1-f7e4f06ad76e tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-83bcad6f-9707-4c91-ba9f-05d4763c51c3" returned: 0 in 0.527s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-595b1841-bf9f-4a86-80e1-f7e4f06ad76e tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-83bcad6f-9707-4c91-ba9f-05d4763c51c3 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:16 devstack sudo[101278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-83bcad6f-9707-4c91-ba9f-05d4763c51c3 Sep 28 17:22:16 devstack sudo[101278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:16 devstack sudo[101278]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-595b1841-bf9f-4a86-80e1-f7e4f06ad76e tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-83bcad6f-9707-4c91-ba9f-05d4763c51c3" returned: 0 in 0.319s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:16 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-595b1841-bf9f-4a86-80e1-f7e4f06ad76e tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "cinder-quobyte-83bcad6f-9707-4c91-ba9f-05d4763c51c3" released by "delete_volume" :: held 0.944s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:16 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-595b1841-bf9f-4a86-80e1-f7e4f06ad76e tempest-CreateVolumesFromSnapshotTest-611704133 None] Created reservations ['a47f33e1-404b-4198-98d5-144fcbd82229', '3b19da32-72e2-40c2-a4c7-dcc94fd3a29b', '83ad72ac-9c0f-43b3-bfe8-e1e3c319f957', '1e30edd1-b5b3-4568-9de1-ee5568ac3d1f'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-595b1841-bf9f-4a86-80e1-f7e4f06ad76e tempest-CreateVolumesFromSnapshotTest-611704133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-595b1841-bf9f-4a86-80e1-f7e4f06ad76e tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:16 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-595b1841-bf9f-4a86-80e1-f7e4f06ad76e tempest-CreateVolumesFromSnapshotTest-611704133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:16 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-595b1841-bf9f-4a86-80e1-f7e4f06ad76e tempest-CreateVolumesFromSnapshotTest-611704133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-595b1841-bf9f-4a86-80e1-f7e4f06ad76e tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-595b1841-bf9f-4a86-80e1-f7e4f06ad76e tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:16 devstack sudo[101281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:22:16 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:17 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-595b1841-bf9f-4a86-80e1-f7e4f06ad76e tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.310s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:17 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-595b1841-bf9f-4a86-80e1-f7e4f06ad76e tempest-CreateVolumesFromSnapshotTest-611704133 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:17 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-595b1841-bf9f-4a86-80e1-f7e4f06ad76e tempest-CreateVolumesFromSnapshotTest-611704133 None] Deleted volume successfully. Sep 28 17:22:17 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-595b1841-bf9f-4a86-80e1-f7e4f06ad76e tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "cinder-83bcad6f-9707-4c91-ba9f-05d4763c51c3-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:17 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-37ffcea1-3c5a-442a-8e12-3ff86f1e49c5 tempest-CreateVolumesFromSnapshotTest-611704133 None] Acquiring lock "cinder-cde0bd22-f005-482f-80a6-2ad328c81ea5-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:17 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-37ffcea1-3c5a-442a-8e12-3ff86f1e49c5 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "cinder-cde0bd22-f005-482f-80a6-2ad328c81ea5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:17 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-37ffcea1-3c5a-442a-8e12-3ff86f1e49c5 tempest-CreateVolumesFromSnapshotTest-611704133 None] Acquiring lock "cinder-quobyte-cde0bd22-f005-482f-80a6-2ad328c81ea5" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:17 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-37ffcea1-3c5a-442a-8e12-3ff86f1e49c5 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "cinder-quobyte-cde0bd22-f005-482f-80a6-2ad328c81ea5" acquired by "delete_volume" :: waited 0.019s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:17 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[02aeea20-b717-4188-b922-5933d06f0bef]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-37ffcea1-3c5a-442a-8e12-3ff86f1e49c5 tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cde0bd22-f005-482f-80a6-2ad328c81ea5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:18 devstack sudo[101284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cde0bd22-f005-482f-80a6-2ad328c81ea5 Sep 28 17:22:18 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:18 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-37ffcea1-3c5a-442a-8e12-3ff86f1e49c5 tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cde0bd22-f005-482f-80a6-2ad328c81ea5" returned: 0 in 0.599s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-37ffcea1-3c5a-442a-8e12-3ff86f1e49c5 tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cde0bd22-f005-482f-80a6-2ad328c81ea5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:18 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cde0bd22-f005-482f-80a6-2ad328c81ea5 Sep 28 17:22:18 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:18 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-37ffcea1-3c5a-442a-8e12-3ff86f1e49c5 tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cde0bd22-f005-482f-80a6-2ad328c81ea5" returned: 0 in 0.410s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:19 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-37ffcea1-3c5a-442a-8e12-3ff86f1e49c5 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "cinder-quobyte-cde0bd22-f005-482f-80a6-2ad328c81ea5" released by "delete_volume" :: held 1.084s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:19 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-c110b6f6-7464-4d56-9519-1276d01d3c39 req-fd213563-f549-4a45-8953-80c664e5ca1c tempest-AttachVolumeNegativeTest-158509557 None] Terminate volume connection completed successfully. Sep 28 17:22:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-c110b6f6-7464-4d56-9519-1276d01d3c39 req-fd213563-f549-4a45-8953-80c664e5ca1c tempest-AttachVolumeNegativeTest-158509557 None] Deleting attachment dbf15670-04dc-4c60-a83b-4bc1cd9045ca. {{(pid=86917) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:22:19 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-37ffcea1-3c5a-442a-8e12-3ff86f1e49c5 tempest-CreateVolumesFromSnapshotTest-611704133 None] Created reservations ['47197fa3-1a0f-407f-95e4-00ea24a23b25', 'e78ddcbe-01f4-418c-8ad2-3270b1d6bbc9', '728396a6-81ba-48c2-8a34-fcde3ebb9876', 'dd6ebfa9-ebad-41ff-ac19-1679f754fa2c'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-37ffcea1-3c5a-442a-8e12-3ff86f1e49c5 tempest-CreateVolumesFromSnapshotTest-611704133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-37ffcea1-3c5a-442a-8e12-3ff86f1e49c5 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-37ffcea1-3c5a-442a-8e12-3ff86f1e49c5 tempest-CreateVolumesFromSnapshotTest-611704133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-37ffcea1-3c5a-442a-8e12-3ff86f1e49c5 tempest-CreateVolumesFromSnapshotTest-611704133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-37ffcea1-3c5a-442a-8e12-3ff86f1e49c5 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-37ffcea1-3c5a-442a-8e12-3ff86f1e49c5 tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:19 devstack sudo[101328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:22:19 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:19 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-37ffcea1-3c5a-442a-8e12-3ff86f1e49c5 tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.321s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:19 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-37ffcea1-3c5a-442a-8e12-3ff86f1e49c5 tempest-CreateVolumesFromSnapshotTest-611704133 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:19 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-37ffcea1-3c5a-442a-8e12-3ff86f1e49c5 tempest-CreateVolumesFromSnapshotTest-611704133 None] Deleted volume successfully. Sep 28 17:22:19 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-37ffcea1-3c5a-442a-8e12-3ff86f1e49c5 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "cinder-cde0bd22-f005-482f-80a6-2ad328c81ea5-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:20 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b9bd20b5-0f68-4a90-9c7e-a36901047981 tempest-CreateVolumesFromSnapshotTest-611704133 None] Acquiring lock "cinder-7d47ab7e-379b-4c82-bac7-ae13e3e1ac02-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:20 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b9bd20b5-0f68-4a90-9c7e-a36901047981 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "cinder-7d47ab7e-379b-4c82-bac7-ae13e3e1ac02-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:20 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b9bd20b5-0f68-4a90-9c7e-a36901047981 tempest-CreateVolumesFromSnapshotTest-611704133 None] Acquiring lock "cinder-quobyte-7d47ab7e-379b-4c82-bac7-ae13e3e1ac02" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:20 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b9bd20b5-0f68-4a90-9c7e-a36901047981 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "cinder-quobyte-7d47ab7e-379b-4c82-bac7-ae13e3e1ac02" acquired by "delete_volume" :: waited 0.031s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:20 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c6df3f-d074-4a3a-8e51-2a8013b07b03]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b9bd20b5-0f68-4a90-9c7e-a36901047981 tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-7d47ab7e-379b-4c82-bac7-ae13e3e1ac02 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:20 devstack sudo[101352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-7d47ab7e-379b-4c82-bac7-ae13e3e1ac02 Sep 28 17:22:20 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:20 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b9bd20b5-0f68-4a90-9c7e-a36901047981 tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-7d47ab7e-379b-4c82-bac7-ae13e3e1ac02" returned: 0 in 0.493s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b9bd20b5-0f68-4a90-9c7e-a36901047981 tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-7d47ab7e-379b-4c82-bac7-ae13e3e1ac02 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:20 devstack sudo[101360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-7d47ab7e-379b-4c82-bac7-ae13e3e1ac02 Sep 28 17:22:20 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:21 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b9bd20b5-0f68-4a90-9c7e-a36901047981 tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-7d47ab7e-379b-4c82-bac7-ae13e3e1ac02" returned: 0 in 0.357s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:21 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b9bd20b5-0f68-4a90-9c7e-a36901047981 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "cinder-quobyte-7d47ab7e-379b-4c82-bac7-ae13e3e1ac02" released by "delete_volume" :: held 0.917s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:21 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-b9bd20b5-0f68-4a90-9c7e-a36901047981 tempest-CreateVolumesFromSnapshotTest-611704133 None] Created reservations ['73195ef4-bee1-47f7-a999-a696d313bc64', 'd205a236-1e09-412e-9283-4af64a767629', 'c9a6d4f9-72f2-4493-b413-07f409a5c152', '89495fcb-9f80-4f3a-a9dc-41e88df2f485'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b9bd20b5-0f68-4a90-9c7e-a36901047981 tempest-CreateVolumesFromSnapshotTest-611704133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b9bd20b5-0f68-4a90-9c7e-a36901047981 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:21 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b9bd20b5-0f68-4a90-9c7e-a36901047981 tempest-CreateVolumesFromSnapshotTest-611704133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:21 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b9bd20b5-0f68-4a90-9c7e-a36901047981 tempest-CreateVolumesFromSnapshotTest-611704133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b9bd20b5-0f68-4a90-9c7e-a36901047981 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b9bd20b5-0f68-4a90-9c7e-a36901047981 tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:21 devstack sudo[101363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:22:21 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:21 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b9bd20b5-0f68-4a90-9c7e-a36901047981 tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.372s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:21 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-b9bd20b5-0f68-4a90-9c7e-a36901047981 tempest-CreateVolumesFromSnapshotTest-611704133 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:21 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-b9bd20b5-0f68-4a90-9c7e-a36901047981 tempest-CreateVolumesFromSnapshotTest-611704133 None] Deleted volume successfully. Sep 28 17:22:21 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b9bd20b5-0f68-4a90-9c7e-a36901047981 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "cinder-7d47ab7e-379b-4c82-bac7-ae13e3e1ac02-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:22 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-588000de-2534-4fa7-a3f8-c6a945f11a5c tempest-CreateVolumesFromSnapshotTest-611704133 None] Acquiring lock "cinder-4deda24e-6a80-4eff-8eed-366316267b24-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:22 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-588000de-2534-4fa7-a3f8-c6a945f11a5c tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "cinder-4deda24e-6a80-4eff-8eed-366316267b24-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:22 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-588000de-2534-4fa7-a3f8-c6a945f11a5c tempest-CreateVolumesFromSnapshotTest-611704133 None] Acquiring lock "cinder-quobyte-4deda24e-6a80-4eff-8eed-366316267b24" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:22 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-588000de-2534-4fa7-a3f8-c6a945f11a5c tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "cinder-quobyte-4deda24e-6a80-4eff-8eed-366316267b24" acquired by "delete_volume" :: waited 0.035s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:22 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d19138c-11b3-49df-8586-1774dd812eab]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-588000de-2534-4fa7-a3f8-c6a945f11a5c tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4deda24e-6a80-4eff-8eed-366316267b24 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:22 devstack sudo[101369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4deda24e-6a80-4eff-8eed-366316267b24 Sep 28 17:22:22 devstack sudo[101369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:23 devstack sudo[101369]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-588000de-2534-4fa7-a3f8-c6a945f11a5c tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4deda24e-6a80-4eff-8eed-366316267b24" returned: 0 in 0.450s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-588000de-2534-4fa7-a3f8-c6a945f11a5c tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4deda24e-6a80-4eff-8eed-366316267b24 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:23 devstack sudo[101374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4deda24e-6a80-4eff-8eed-366316267b24 Sep 28 17:22:23 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:23 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-588000de-2534-4fa7-a3f8-c6a945f11a5c tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4deda24e-6a80-4eff-8eed-366316267b24" returned: 0 in 0.472s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:23 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-588000de-2534-4fa7-a3f8-c6a945f11a5c tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "cinder-quobyte-4deda24e-6a80-4eff-8eed-366316267b24" released by "delete_volume" :: held 0.989s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:23 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-588000de-2534-4fa7-a3f8-c6a945f11a5c tempest-CreateVolumesFromSnapshotTest-611704133 None] Created reservations ['85c2f243-6638-42ee-bc0d-0287a9587fa8', '6ddd23c5-f0c8-414e-80f0-74ad093bde15', '523c7982-0543-4718-9046-6b08e8522d81', '58205f38-f8aa-42bb-8369-bf8aadcdf491'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-588000de-2534-4fa7-a3f8-c6a945f11a5c tempest-CreateVolumesFromSnapshotTest-611704133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-588000de-2534-4fa7-a3f8-c6a945f11a5c tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:23 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-588000de-2534-4fa7-a3f8-c6a945f11a5c tempest-CreateVolumesFromSnapshotTest-611704133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:23 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-588000de-2534-4fa7-a3f8-c6a945f11a5c tempest-CreateVolumesFromSnapshotTest-611704133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-588000de-2534-4fa7-a3f8-c6a945f11a5c tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-588000de-2534-4fa7-a3f8-c6a945f11a5c tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:23 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:22:23 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:24 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-588000de-2534-4fa7-a3f8-c6a945f11a5c tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.388s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:24 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-588000de-2534-4fa7-a3f8-c6a945f11a5c tempest-CreateVolumesFromSnapshotTest-611704133 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:24 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-588000de-2534-4fa7-a3f8-c6a945f11a5c tempest-CreateVolumesFromSnapshotTest-611704133 None] Deleted volume successfully. Sep 28 17:22:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-588000de-2534-4fa7-a3f8-c6a945f11a5c tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "cinder-4deda24e-6a80-4eff-8eed-366316267b24-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:25 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-7aaa8296-154b-4479-92d1-10db66e46ec2 tempest-CreateVolumesFromSnapshotTest-611704133 None] Acquiring lock "cinder-cded6e6d-f0ed-4e62-a5fa-5e1049435774-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:25 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-7aaa8296-154b-4479-92d1-10db66e46ec2 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "cinder-cded6e6d-f0ed-4e62-a5fa-5e1049435774-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:25 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-7aaa8296-154b-4479-92d1-10db66e46ec2 tempest-CreateVolumesFromSnapshotTest-611704133 None] Acquiring lock "cinder-quobyte-157d6ace-3ae4-48ac-80a5-d0e9179df6c9" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:25 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-7aaa8296-154b-4479-92d1-10db66e46ec2 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "cinder-quobyte-157d6ace-3ae4-48ac-80a5-d0e9179df6c9" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:25 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-7aaa8296-154b-4479-92d1-10db66e46ec2 tempest-CreateVolumesFromSnapshotTest-611704133 None] Acquiring lock "cinder-quobyte-cded6e6d-f0ed-4e62-a5fa-5e1049435774" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:25 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-7aaa8296-154b-4479-92d1-10db66e46ec2 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "cinder-quobyte-cded6e6d-f0ed-4e62-a5fa-5e1049435774" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:25 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-7aaa8296-154b-4479-92d1-10db66e46ec2 tempest-CreateVolumesFromSnapshotTest-611704133 None] Deleting offline snapshot cded6e6d-f0ed-4e62-a5fa-5e1049435774 of volume 157d6ace-3ae4-48ac-80a5-d0e9179df6c9 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:22:25 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-7aaa8296-154b-4479-92d1-10db66e46ec2 tempest-CreateVolumesFromSnapshotTest-611704133 None] snapshot_file for this snap is: volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9.cded6e6d-f0ed-4e62-a5fa-5e1049435774 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:22:25 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1487b34-64ee-4ac6-8b87-fd1a3b9459ad]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7aaa8296-154b-4479-92d1-10db66e46ec2 tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9.cded6e6d-f0ed-4e62-a5fa-5e1049435774 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:25 devstack sudo[101416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9.cded6e6d-f0ed-4e62-a5fa-5e1049435774 Sep 28 17:22:25 devstack sudo[101416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:25 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e0802bb3-f318-491f-bb24-64cc0216b0fa tempest-AttachVolumeNegativeTest-158509557 None] Acquiring lock "cinder-e615c73c-4f44-4215-a039-776f9398eb32-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:25 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e0802bb3-f318-491f-bb24-64cc0216b0fa tempest-AttachVolumeNegativeTest-158509557 None] Lock "cinder-e615c73c-4f44-4215-a039-776f9398eb32-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:25 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e0802bb3-f318-491f-bb24-64cc0216b0fa tempest-AttachVolumeNegativeTest-158509557 None] Acquiring lock "cinder-quobyte-e615c73c-4f44-4215-a039-776f9398eb32" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:25 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e0802bb3-f318-491f-bb24-64cc0216b0fa tempest-AttachVolumeNegativeTest-158509557 None] Lock "cinder-quobyte-e615c73c-4f44-4215-a039-776f9398eb32" acquired by "delete_volume" :: waited 0.032s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:25 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0d4cbf-e4ba-4a35-8483-618fc293494e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e0802bb3-f318-491f-bb24-64cc0216b0fa tempest-AttachVolumeNegativeTest-158509557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e615c73c-4f44-4215-a039-776f9398eb32 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:25 devstack sudo[101416]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7aaa8296-154b-4479-92d1-10db66e46ec2 tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9.cded6e6d-f0ed-4e62-a5fa-5e1049435774" returned: 0 in 0.559s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:25 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-7aaa8296-154b-4479-92d1-10db66e46ec2 tempest-CreateVolumesFromSnapshotTest-611704133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:22:25 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e615c73c-4f44-4215-a039-776f9398eb32 Sep 28 17:22:25 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:25 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b455838-063c-401f-9043-eda1782e7716]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7aaa8296-154b-4479-92d1-10db66e46ec2 tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:25 devstack sudo[101424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9 Sep 28 17:22:25 devstack sudo[101424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:26 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e0802bb3-f318-491f-bb24-64cc0216b0fa tempest-AttachVolumeNegativeTest-158509557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e615c73c-4f44-4215-a039-776f9398eb32" returned: 0 in 0.548s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e0802bb3-f318-491f-bb24-64cc0216b0fa tempest-AttachVolumeNegativeTest-158509557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e615c73c-4f44-4215-a039-776f9398eb32 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:26 devstack sudo[101430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e615c73c-4f44-4215-a039-776f9398eb32 Sep 28 17:22:26 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:26 devstack sudo[101424]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7aaa8296-154b-4479-92d1-10db66e46ec2 tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9" returned: 0 in 0.554s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7aaa8296-154b-4479-92d1-10db66e46ec2 tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9.cded6e6d-f0ed-4e62-a5fa-5e1049435774 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:26 devstack sudo[101435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9.cded6e6d-f0ed-4e62-a5fa-5e1049435774 Sep 28 17:22:26 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:26 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e0802bb3-f318-491f-bb24-64cc0216b0fa tempest-AttachVolumeNegativeTest-158509557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e615c73c-4f44-4215-a039-776f9398eb32" returned: 0 in 0.335s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:26 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e0802bb3-f318-491f-bb24-64cc0216b0fa tempest-AttachVolumeNegativeTest-158509557 None] Lock "cinder-quobyte-e615c73c-4f44-4215-a039-776f9398eb32" released by "delete_volume" :: held 0.946s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:26 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-e0802bb3-f318-491f-bb24-64cc0216b0fa tempest-AttachVolumeNegativeTest-158509557 None] Created reservations ['af2521cb-bd45-4aac-8110-878d1a95a6cf', '94b6d88b-a4d2-4158-8069-f1c9df82ce9f', '5e0a5143-239c-455d-b47b-33999ee890ae', '7054dec0-9f2e-4124-8e74-1f5524d3b928'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e0802bb3-f318-491f-bb24-64cc0216b0fa tempest-AttachVolumeNegativeTest-158509557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e0802bb3-f318-491f-bb24-64cc0216b0fa tempest-AttachVolumeNegativeTest-158509557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:26 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-e0802bb3-f318-491f-bb24-64cc0216b0fa tempest-AttachVolumeNegativeTest-158509557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:26 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-e0802bb3-f318-491f-bb24-64cc0216b0fa tempest-AttachVolumeNegativeTest-158509557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e0802bb3-f318-491f-bb24-64cc0216b0fa tempest-AttachVolumeNegativeTest-158509557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e0802bb3-f318-491f-bb24-64cc0216b0fa tempest-AttachVolumeNegativeTest-158509557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:26 devstack sudo[101441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:22:26 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:26 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7aaa8296-154b-4479-92d1-10db66e46ec2 tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9.cded6e6d-f0ed-4e62-a5fa-5e1049435774" returned: 0 in 0.553s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7aaa8296-154b-4479-92d1-10db66e46ec2 tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9.cded6e6d-f0ed-4e62-a5fa-5e1049435774 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:26 devstack sudo[101443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9.cded6e6d-f0ed-4e62-a5fa-5e1049435774 Sep 28 17:22:26 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:27 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7aaa8296-154b-4479-92d1-10db66e46ec2 tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9.cded6e6d-f0ed-4e62-a5fa-5e1049435774" returned: 0 in 0.357s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:27 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e0802bb3-f318-491f-bb24-64cc0216b0fa tempest-AttachVolumeNegativeTest-158509557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.484s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:27 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-e0802bb3-f318-491f-bb24-64cc0216b0fa tempest-AttachVolumeNegativeTest-158509557 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:27 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-e0802bb3-f318-491f-bb24-64cc0216b0fa tempest-AttachVolumeNegativeTest-158509557 None] Deleted volume successfully. Sep 28 17:22:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-7aaa8296-154b-4479-92d1-10db66e46ec2 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "cinder-quobyte-cded6e6d-f0ed-4e62-a5fa-5e1049435774" released by "_delete_snapshot" :: held 2.231s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e0802bb3-f318-491f-bb24-64cc0216b0fa tempest-AttachVolumeNegativeTest-158509557 None] Lock "cinder-e615c73c-4f44-4215-a039-776f9398eb32-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-7aaa8296-154b-4479-92d1-10db66e46ec2 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "cinder-quobyte-157d6ace-3ae4-48ac-80a5-d0e9179df6c9" released by "delete_snapshot" :: held 2.263s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:27 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-7aaa8296-154b-4479-92d1-10db66e46ec2 tempest-CreateVolumesFromSnapshotTest-611704133 None] Created reservations ['bc29a47f-0305-4232-a7f7-0ca65b7e9033', '9f36e7ab-3d50-4f18-a474-e460da7a82e5', '9fa7b2b4-1153-47fb-947e-fd164dacada2', 'e6f321e4-3813-4397-a9f9-822e56e98b87'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:27 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-7aaa8296-154b-4479-92d1-10db66e46ec2 tempest-CreateVolumesFromSnapshotTest-611704133 None] Delete snapshot completed successfully. Sep 28 17:22:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-7aaa8296-154b-4479-92d1-10db66e46ec2 tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "cinder-cded6e6d-f0ed-4e62-a5fa-5e1049435774-delete_snapshot" released by "delete_snapshot" :: held 2.476s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ae209fb1-9225-4084-af37-a2ffe0fe7363 tempest-AttachVolumeNegativeTest-158509557 None] Acquiring lock "cinder-b31a6b5f-e9f6-4952-81df-f5ce9837504e-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ae209fb1-9225-4084-af37-a2ffe0fe7363 tempest-AttachVolumeNegativeTest-158509557 None] Lock "cinder-b31a6b5f-e9f6-4952-81df-f5ce9837504e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ae209fb1-9225-4084-af37-a2ffe0fe7363 tempest-AttachVolumeNegativeTest-158509557 None] Acquiring lock "cinder-quobyte-b31a6b5f-e9f6-4952-81df-f5ce9837504e" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ae209fb1-9225-4084-af37-a2ffe0fe7363 tempest-AttachVolumeNegativeTest-158509557 None] Lock "cinder-quobyte-b31a6b5f-e9f6-4952-81df-f5ce9837504e" acquired by "delete_volume" :: waited 0.025s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:28 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9b47f0-1f53-4a41-809f-388df80fcdd3]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ae209fb1-9225-4084-af37-a2ffe0fe7363 tempest-AttachVolumeNegativeTest-158509557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b31a6b5f-e9f6-4952-81df-f5ce9837504e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:28 devstack sudo[101447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b31a6b5f-e9f6-4952-81df-f5ce9837504e Sep 28 17:22:28 devstack sudo[101447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:28 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8cd334d6-1d50-4486-9865-06ae91349ddc tempest-CreateVolumesFromSnapshotTest-611704133 None] Acquiring lock "cinder-157d6ace-3ae4-48ac-80a5-d0e9179df6c9-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:28 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8cd334d6-1d50-4486-9865-06ae91349ddc tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "cinder-157d6ace-3ae4-48ac-80a5-d0e9179df6c9-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:28 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8cd334d6-1d50-4486-9865-06ae91349ddc tempest-CreateVolumesFromSnapshotTest-611704133 None] Acquiring lock "cinder-quobyte-157d6ace-3ae4-48ac-80a5-d0e9179df6c9" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:28 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8cd334d6-1d50-4486-9865-06ae91349ddc tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "cinder-quobyte-157d6ace-3ae4-48ac-80a5-d0e9179df6c9" acquired by "delete_volume" :: waited 0.025s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:28 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2789de16-1e3b-4d94-b4f4-4c03b463a5d9]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8cd334d6-1d50-4486-9865-06ae91349ddc tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:28 devstack sudo[101447]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ae209fb1-9225-4084-af37-a2ffe0fe7363 tempest-AttachVolumeNegativeTest-158509557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b31a6b5f-e9f6-4952-81df-f5ce9837504e" returned: 0 in 0.558s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ae209fb1-9225-4084-af37-a2ffe0fe7363 tempest-AttachVolumeNegativeTest-158509557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b31a6b5f-e9f6-4952-81df-f5ce9837504e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:28 devstack sudo[101453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b31a6b5f-e9f6-4952-81df-f5ce9837504e Sep 28 17:22:28 devstack sudo[101453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:28 devstack sudo[101452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9 Sep 28 17:22:28 devstack sudo[101452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:28 devstack sudo[101453]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ae209fb1-9225-4084-af37-a2ffe0fe7363 tempest-AttachVolumeNegativeTest-158509557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b31a6b5f-e9f6-4952-81df-f5ce9837504e" returned: 0 in 0.323s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:28 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ae209fb1-9225-4084-af37-a2ffe0fe7363 tempest-AttachVolumeNegativeTest-158509557 None] Lock "cinder-quobyte-b31a6b5f-e9f6-4952-81df-f5ce9837504e" released by "delete_volume" :: held 0.942s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:28 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-ae209fb1-9225-4084-af37-a2ffe0fe7363 tempest-AttachVolumeNegativeTest-158509557 None] Created reservations ['a6cc2af7-f16c-421c-a854-6f5d71bdb560', '915c5b4c-b5cb-48a1-90d5-d33d8d083a22', '6a8df89e-c683-41c0-8d4f-53e28157ee71', 'd7d081b4-03f4-4b8c-82c6-2bfbc0de364e'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:29 devstack sudo[101452]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8cd334d6-1d50-4486-9865-06ae91349ddc tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9" returned: 0 in 0.455s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8cd334d6-1d50-4486-9865-06ae91349ddc tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:29 devstack sudo[101460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9 Sep 28 17:22:29 devstack sudo[101460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ae209fb1-9225-4084-af37-a2ffe0fe7363 tempest-AttachVolumeNegativeTest-158509557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ae209fb1-9225-4084-af37-a2ffe0fe7363 tempest-AttachVolumeNegativeTest-158509557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ae209fb1-9225-4084-af37-a2ffe0fe7363 tempest-AttachVolumeNegativeTest-158509557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ae209fb1-9225-4084-af37-a2ffe0fe7363 tempest-AttachVolumeNegativeTest-158509557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ae209fb1-9225-4084-af37-a2ffe0fe7363 tempest-AttachVolumeNegativeTest-158509557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ae209fb1-9225-4084-af37-a2ffe0fe7363 tempest-AttachVolumeNegativeTest-158509557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:29 devstack sudo[101462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:22:29 devstack sudo[101462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:29 devstack sudo[101460]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8cd334d6-1d50-4486-9865-06ae91349ddc tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-157d6ace-3ae4-48ac-80a5-d0e9179df6c9" returned: 0 in 0.407s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8cd334d6-1d50-4486-9865-06ae91349ddc tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "cinder-quobyte-157d6ace-3ae4-48ac-80a5-d0e9179df6c9" released by "delete_volume" :: held 0.963s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:29 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-8cd334d6-1d50-4486-9865-06ae91349ddc tempest-CreateVolumesFromSnapshotTest-611704133 None] Created reservations ['1ea8dd09-3517-457b-a75a-62ef80c9f252', '5d2fe293-6990-4247-9a09-874920b82607', '8db723bf-0a0f-4eef-9242-1426ffa46517', '3e962004-8105-4f20-9229-41e489235d43'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:29 devstack sudo[101462]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ae209fb1-9225-4084-af37-a2ffe0fe7363 tempest-AttachVolumeNegativeTest-158509557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.405s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:29 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-ae209fb1-9225-4084-af37-a2ffe0fe7363 tempest-AttachVolumeNegativeTest-158509557 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:29 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-ae209fb1-9225-4084-af37-a2ffe0fe7363 tempest-AttachVolumeNegativeTest-158509557 None] Deleted volume successfully. Sep 28 17:22:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ae209fb1-9225-4084-af37-a2ffe0fe7363 tempest-AttachVolumeNegativeTest-158509557 None] Lock "cinder-b31a6b5f-e9f6-4952-81df-f5ce9837504e-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8cd334d6-1d50-4486-9865-06ae91349ddc tempest-CreateVolumesFromSnapshotTest-611704133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8cd334d6-1d50-4486-9865-06ae91349ddc tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-8cd334d6-1d50-4486-9865-06ae91349ddc tempest-CreateVolumesFromSnapshotTest-611704133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-8cd334d6-1d50-4486-9865-06ae91349ddc tempest-CreateVolumesFromSnapshotTest-611704133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8cd334d6-1d50-4486-9865-06ae91349ddc tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8cd334d6-1d50-4486-9865-06ae91349ddc tempest-CreateVolumesFromSnapshotTest-611704133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:29 devstack sudo[101466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:22:29 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:30 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8cd334d6-1d50-4486-9865-06ae91349ddc tempest-CreateVolumesFromSnapshotTest-611704133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.326s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:30 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-8cd334d6-1d50-4486-9865-06ae91349ddc tempest-CreateVolumesFromSnapshotTest-611704133 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:30 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-8cd334d6-1d50-4486-9865-06ae91349ddc tempest-CreateVolumesFromSnapshotTest-611704133 None] Deleted volume successfully. Sep 28 17:22:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8cd334d6-1d50-4486-9865-06ae91349ddc tempest-CreateVolumesFromSnapshotTest-611704133 None] Lock "cinder-157d6ace-3ae4-48ac-80a5-d0e9179df6c9-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-9a5e3b3a-3276-4b1f-b0c9-1e3c0ee8356c tempest-AttachVolumeNegativeTest-158509557 None] Acquiring lock "cinder-67182fbe-2e00-4b26-bf42-e2edf0d5d39c-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-9a5e3b3a-3276-4b1f-b0c9-1e3c0ee8356c tempest-AttachVolumeNegativeTest-158509557 None] Lock "cinder-67182fbe-2e00-4b26-bf42-e2edf0d5d39c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-9a5e3b3a-3276-4b1f-b0c9-1e3c0ee8356c tempest-AttachVolumeNegativeTest-158509557 None] Acquiring lock "cinder-quobyte-67182fbe-2e00-4b26-bf42-e2edf0d5d39c" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-9a5e3b3a-3276-4b1f-b0c9-1e3c0ee8356c tempest-AttachVolumeNegativeTest-158509557 None] Lock "cinder-quobyte-67182fbe-2e00-4b26-bf42-e2edf0d5d39c" acquired by "delete_volume" :: waited 0.022s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:30 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60f88ab-4a8a-4a74-8beb-3a2ee5024437]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9a5e3b3a-3276-4b1f-b0c9-1e3c0ee8356c tempest-AttachVolumeNegativeTest-158509557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-67182fbe-2e00-4b26-bf42-e2edf0d5d39c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:31 devstack sudo[101470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-67182fbe-2e00-4b26-bf42-e2edf0d5d39c Sep 28 17:22:31 devstack sudo[101470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:31 devstack sudo[101470]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9a5e3b3a-3276-4b1f-b0c9-1e3c0ee8356c tempest-AttachVolumeNegativeTest-158509557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-67182fbe-2e00-4b26-bf42-e2edf0d5d39c" returned: 0 in 0.663s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9a5e3b3a-3276-4b1f-b0c9-1e3c0ee8356c tempest-AttachVolumeNegativeTest-158509557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-67182fbe-2e00-4b26-bf42-e2edf0d5d39c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:31 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-67182fbe-2e00-4b26-bf42-e2edf0d5d39c Sep 28 17:22:31 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:32 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9a5e3b3a-3276-4b1f-b0c9-1e3c0ee8356c tempest-AttachVolumeNegativeTest-158509557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-67182fbe-2e00-4b26-bf42-e2edf0d5d39c" returned: 0 in 0.462s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-9a5e3b3a-3276-4b1f-b0c9-1e3c0ee8356c tempest-AttachVolumeNegativeTest-158509557 None] Lock "cinder-quobyte-67182fbe-2e00-4b26-bf42-e2edf0d5d39c" released by "delete_volume" :: held 1.197s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:32 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-9a5e3b3a-3276-4b1f-b0c9-1e3c0ee8356c tempest-AttachVolumeNegativeTest-158509557 None] Created reservations ['398e821d-f9ef-4a83-a3ff-e24b2b6ff051', '599a2e66-9c98-495a-a27d-159a3363c5a3', 'd2bed217-c879-4a40-ab22-5734e21a103b', '45698771-eeab-4ec1-9b3d-679064edacdd'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9a5e3b3a-3276-4b1f-b0c9-1e3c0ee8356c tempest-AttachVolumeNegativeTest-158509557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9a5e3b3a-3276-4b1f-b0c9-1e3c0ee8356c tempest-AttachVolumeNegativeTest-158509557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-9a5e3b3a-3276-4b1f-b0c9-1e3c0ee8356c tempest-AttachVolumeNegativeTest-158509557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-9a5e3b3a-3276-4b1f-b0c9-1e3c0ee8356c tempest-AttachVolumeNegativeTest-158509557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9a5e3b3a-3276-4b1f-b0c9-1e3c0ee8356c tempest-AttachVolumeNegativeTest-158509557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9a5e3b3a-3276-4b1f-b0c9-1e3c0ee8356c tempest-AttachVolumeNegativeTest-158509557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:32 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:22:32 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:32 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9a5e3b3a-3276-4b1f-b0c9-1e3c0ee8356c tempest-AttachVolumeNegativeTest-158509557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.321s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:32 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-9a5e3b3a-3276-4b1f-b0c9-1e3c0ee8356c tempest-AttachVolumeNegativeTest-158509557 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:32 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-9a5e3b3a-3276-4b1f-b0c9-1e3c0ee8356c tempest-AttachVolumeNegativeTest-158509557 None] Deleted volume successfully. Sep 28 17:22:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-9a5e3b3a-3276-4b1f-b0c9-1e3c0ee8356c tempest-AttachVolumeNegativeTest-158509557 None] Lock "cinder-67182fbe-2e00-4b26-bf42-e2edf0d5d39c-delete_volume" released by "delete_volume" :: held 1.990s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:36 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:UPDATE=221,cinder:SELECT=164,cinder:INSERT=61,cinder:DELETE=18 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:22:36 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=160,cinder:INSERT=54,cinder:UPDATE=217,cinder:DELETE=18 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:22:36 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-141217a4-da1a-4c0a-9d9e-0f4941ae2211 tempest-ProjectReaderTests-1865499017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-141217a4-da1a-4c0a-9d9e-0f4941ae2211 tempest-ProjectReaderTests-1865499017 None] Flow 'volume_create_manager' (36619a85-8cbc-43f3-a033-ba8078515b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-141217a4-da1a-4c0a-9d9e-0f4941ae2211 tempest-ProjectReaderTests-1865499017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d7bdff6-f4c5-4c08-be12-d858b86c9933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-141217a4-da1a-4c0a-9d9e-0f4941ae2211 tempest-ProjectReaderTests-1865499017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d7bdff6-f4c5-4c08-be12-d858b86c9933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1435579021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae37c0e-5bf5-4a62-ae2f-3198cc9f6080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53375cc017d94051807044360736c6bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:37Z,use_quota=True,user_id='62509f72568245c1ac77eca8ed973e35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-141217a4-da1a-4c0a-9d9e-0f4941ae2211 tempest-ProjectReaderTests-1865499017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7855ea70-aecb-4a31-b8e4-586787edcb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-141217a4-da1a-4c0a-9d9e-0f4941ae2211 tempest-ProjectReaderTests-1865499017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7855ea70-aecb-4a31-b8e4-586787edcb5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-141217a4-da1a-4c0a-9d9e-0f4941ae2211 tempest-ProjectReaderTests-1865499017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc9969f-2ab2-4e07-b22e-93441724922e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-141217a4-da1a-4c0a-9d9e-0f4941ae2211 tempest-ProjectReaderTests-1865499017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc9969f-2ab2-4e07-b22e-93441724922e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bae37c0e-5bf5-4a62-ae2f-3198cc9f6080', 'volume_name': 'volume-bae37c0e-5bf5-4a62-ae2f-3198cc9f6080', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-141217a4-da1a-4c0a-9d9e-0f4941ae2211 tempest-ProjectReaderTests-1865499017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4bb46c5-3bbf-4ebd-a1dd-fa8604f85b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-141217a4-da1a-4c0a-9d9e-0f4941ae2211 tempest-ProjectReaderTests-1865499017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4bb46c5-3bbf-4ebd-a1dd-fa8604f85b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:37 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-141217a4-da1a-4c0a-9d9e-0f4941ae2211 tempest-ProjectReaderTests-1865499017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fadabef-86a6-4d9f-8d40-74f92eab1de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:37 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-141217a4-da1a-4c0a-9d9e-0f4941ae2211 tempest-ProjectReaderTests-1865499017 None] Volume bae37c0e-5bf5-4a62-ae2f-3198cc9f6080: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bae37c0e-5bf5-4a62-ae2f-3198cc9f6080', 'volume_size': 1} Sep 28 17:22:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-141217a4-da1a-4c0a-9d9e-0f4941ae2211 tempest-ProjectReaderTests-1865499017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-141217a4-da1a-4c0a-9d9e-0f4941ae2211 tempest-ProjectReaderTests-1865499017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:37 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-141217a4-da1a-4c0a-9d9e-0f4941ae2211 tempest-ProjectReaderTests-1865499017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1435579021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae37c0e-5bf5-4a62-ae2f-3198cc9f6080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53375cc017d94051807044360736c6bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:37Z,use_quota=True,user_id='62509f72568245c1ac77eca8ed973e35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:37 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-141217a4-da1a-4c0a-9d9e-0f4941ae2211 tempest-ProjectReaderTests-1865499017 None] Creating volume bae37c0e-5bf5-4a62-ae2f-3198cc9f6080 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-141217a4-da1a-4c0a-9d9e-0f4941ae2211 tempest-ProjectReaderTests-1865499017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-141217a4-da1a-4c0a-9d9e-0f4941ae2211 tempest-ProjectReaderTests-1865499017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:37 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-141217a4-da1a-4c0a-9d9e-0f4941ae2211 tempest-ProjectReaderTests-1865499017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:37 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-141217a4-da1a-4c0a-9d9e-0f4941ae2211 tempest-ProjectReaderTests-1865499017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-141217a4-da1a-4c0a-9d9e-0f4941ae2211 tempest-ProjectReaderTests-1865499017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:37 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-141217a4-da1a-4c0a-9d9e-0f4941ae2211 tempest-ProjectReaderTests-1865499017 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:37 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-141217a4-da1a-4c0a-9d9e-0f4941ae2211 tempest-ProjectReaderTests-1865499017 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:22:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-141217a4-da1a-4c0a-9d9e-0f4941ae2211 tempest-ProjectReaderTests-1865499017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bae37c0e-5bf5-4a62-ae2f-3198cc9f6080 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:37 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bae37c0e-5bf5-4a62-ae2f-3198cc9f6080 1073741824 Sep 28 17:22:37 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:37 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-141217a4-da1a-4c0a-9d9e-0f4941ae2211 tempest-ProjectReaderTests-1865499017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bae37c0e-5bf5-4a62-ae2f-3198cc9f6080 1073741824" returned: 0 in 0.639s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-141217a4-da1a-4c0a-9d9e-0f4941ae2211 tempest-ProjectReaderTests-1865499017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bae37c0e-5bf5-4a62-ae2f-3198cc9f6080 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:37 devstack sudo[101489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bae37c0e-5bf5-4a62-ae2f-3198cc9f6080 Sep 28 17:22:37 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:38 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-141217a4-da1a-4c0a-9d9e-0f4941ae2211 tempest-ProjectReaderTests-1865499017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bae37c0e-5bf5-4a62-ae2f-3198cc9f6080" returned: 0 in 0.304s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:38 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-141217a4-da1a-4c0a-9d9e-0f4941ae2211 tempest-ProjectReaderTests-1865499017 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-141217a4-da1a-4c0a-9d9e-0f4941ae2211 tempest-ProjectReaderTests-1865499017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-141217a4-da1a-4c0a-9d9e-0f4941ae2211 tempest-ProjectReaderTests-1865499017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fadabef-86a6-4d9f-8d40-74f92eab1de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bae37c0e-5bf5-4a62-ae2f-3198cc9f6080', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-141217a4-da1a-4c0a-9d9e-0f4941ae2211 tempest-ProjectReaderTests-1865499017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed85bd4-967f-45ff-9954-ce442a6b955f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:38 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-141217a4-da1a-4c0a-9d9e-0f4941ae2211 tempest-ProjectReaderTests-1865499017 None] Volume volume-bae37c0e-5bf5-4a62-ae2f-3198cc9f6080 (bae37c0e-5bf5-4a62-ae2f-3198cc9f6080): created successfully Sep 28 17:22:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-141217a4-da1a-4c0a-9d9e-0f4941ae2211 tempest-ProjectReaderTests-1865499017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed85bd4-967f-45ff-9954-ce442a6b955f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-141217a4-da1a-4c0a-9d9e-0f4941ae2211 tempest-ProjectReaderTests-1865499017 None] Flow 'volume_create_manager' (36619a85-8cbc-43f3-a033-ba8078515b1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:38 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-141217a4-da1a-4c0a-9d9e-0f4941ae2211 tempest-ProjectReaderTests-1865499017 None] Created volume successfully. Sep 28 17:22:39 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-309bb168-2115-4f76-8b55-cf21d28a40e4 tempest-ProjectReaderTests-1865499017 None] Acquiring lock "cinder-bae37c0e-5bf5-4a62-ae2f-3198cc9f6080-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:39 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-309bb168-2115-4f76-8b55-cf21d28a40e4 tempest-ProjectReaderTests-1865499017 None] Lock "cinder-bae37c0e-5bf5-4a62-ae2f-3198cc9f6080-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:39 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-309bb168-2115-4f76-8b55-cf21d28a40e4 tempest-ProjectReaderTests-1865499017 None] Acquiring lock "cinder-quobyte-bae37c0e-5bf5-4a62-ae2f-3198cc9f6080" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:39 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-309bb168-2115-4f76-8b55-cf21d28a40e4 tempest-ProjectReaderTests-1865499017 None] Lock "cinder-quobyte-bae37c0e-5bf5-4a62-ae2f-3198cc9f6080" acquired by "delete_volume" :: waited 0.031s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:39 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e42be81-3e52-4f57-8c44-bb8633149450]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-309bb168-2115-4f76-8b55-cf21d28a40e4 tempest-ProjectReaderTests-1865499017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bae37c0e-5bf5-4a62-ae2f-3198cc9f6080 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:39 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bae37c0e-5bf5-4a62-ae2f-3198cc9f6080 Sep 28 17:22:39 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:40 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-309bb168-2115-4f76-8b55-cf21d28a40e4 tempest-ProjectReaderTests-1865499017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bae37c0e-5bf5-4a62-ae2f-3198cc9f6080" returned: 0 in 0.689s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-309bb168-2115-4f76-8b55-cf21d28a40e4 tempest-ProjectReaderTests-1865499017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bae37c0e-5bf5-4a62-ae2f-3198cc9f6080 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:40 devstack sudo[101498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bae37c0e-5bf5-4a62-ae2f-3198cc9f6080 Sep 28 17:22:40 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:40 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-309bb168-2115-4f76-8b55-cf21d28a40e4 tempest-ProjectReaderTests-1865499017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bae37c0e-5bf5-4a62-ae2f-3198cc9f6080" returned: 0 in 0.417s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:40 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-309bb168-2115-4f76-8b55-cf21d28a40e4 tempest-ProjectReaderTests-1865499017 None] Lock "cinder-quobyte-bae37c0e-5bf5-4a62-ae2f-3198cc9f6080" released by "delete_volume" :: held 1.198s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:40 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-309bb168-2115-4f76-8b55-cf21d28a40e4 tempest-ProjectReaderTests-1865499017 None] Created reservations ['3c63f11a-6cc9-402b-9aef-aaa5ffc20868', 'f74d7c3a-7cca-4c97-b594-25c23626731b', '0847a362-7fb7-42af-9014-d6be661ad8e5', '8cf4dd53-e4eb-4a6e-b445-7c2603a3abac'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-309bb168-2115-4f76-8b55-cf21d28a40e4 tempest-ProjectReaderTests-1865499017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-309bb168-2115-4f76-8b55-cf21d28a40e4 tempest-ProjectReaderTests-1865499017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:40 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-309bb168-2115-4f76-8b55-cf21d28a40e4 tempest-ProjectReaderTests-1865499017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:40 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-309bb168-2115-4f76-8b55-cf21d28a40e4 tempest-ProjectReaderTests-1865499017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-309bb168-2115-4f76-8b55-cf21d28a40e4 tempest-ProjectReaderTests-1865499017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-309bb168-2115-4f76-8b55-cf21d28a40e4 tempest-ProjectReaderTests-1865499017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:40 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:22:40 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:41 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-309bb168-2115-4f76-8b55-cf21d28a40e4 tempest-ProjectReaderTests-1865499017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.359s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:41 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-309bb168-2115-4f76-8b55-cf21d28a40e4 tempest-ProjectReaderTests-1865499017 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:41 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-309bb168-2115-4f76-8b55-cf21d28a40e4 tempest-ProjectReaderTests-1865499017 None] Deleted volume successfully. Sep 28 17:22:41 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-309bb168-2115-4f76-8b55-cf21d28a40e4 tempest-ProjectReaderTests-1865499017 None] Lock "cinder-bae37c0e-5bf5-4a62-ae2f-3198cc9f6080-delete_volume" released by "delete_volume" :: held 1.941s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:42 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-48dec129-8218-406b-8c54-f420cb23c92b tempest-ProjectReaderTests-1865499017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-48dec129-8218-406b-8c54-f420cb23c92b tempest-ProjectReaderTests-1865499017 None] Flow 'volume_create_manager' (513a1981-b81a-4674-8fc2-79d8591e5349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-48dec129-8218-406b-8c54-f420cb23c92b tempest-ProjectReaderTests-1865499017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a5f00e-6452-4092-b68e-e22d42e38cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-48dec129-8218-406b-8c54-f420cb23c92b tempest-ProjectReaderTests-1865499017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a5f00e-6452-4092-b68e-e22d42e38cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-710852193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2733c1f-9f49-48ab-af8c-2cfde0288721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53375cc017d94051807044360736c6bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:42Z,use_quota=True,user_id='62509f72568245c1ac77eca8ed973e35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-48dec129-8218-406b-8c54-f420cb23c92b tempest-ProjectReaderTests-1865499017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5820ba73-4588-45f1-a55d-00b7ec617503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-48dec129-8218-406b-8c54-f420cb23c92b tempest-ProjectReaderTests-1865499017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5820ba73-4588-45f1-a55d-00b7ec617503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-48dec129-8218-406b-8c54-f420cb23c92b tempest-ProjectReaderTests-1865499017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17a82d07-1b2c-4767-886a-be923737dcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-48dec129-8218-406b-8c54-f420cb23c92b tempest-ProjectReaderTests-1865499017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17a82d07-1b2c-4767-886a-be923737dcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2733c1f-9f49-48ab-af8c-2cfde0288721', 'volume_name': 'volume-d2733c1f-9f49-48ab-af8c-2cfde0288721', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-48dec129-8218-406b-8c54-f420cb23c92b tempest-ProjectReaderTests-1865499017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5070a31-6d94-4459-a67a-cdbd753e2652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-48dec129-8218-406b-8c54-f420cb23c92b tempest-ProjectReaderTests-1865499017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5070a31-6d94-4459-a67a-cdbd753e2652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-48dec129-8218-406b-8c54-f420cb23c92b tempest-ProjectReaderTests-1865499017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abcb4750-6384-492e-81ce-6f1696571fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:42 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-48dec129-8218-406b-8c54-f420cb23c92b tempest-ProjectReaderTests-1865499017 None] Volume d2733c1f-9f49-48ab-af8c-2cfde0288721: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2733c1f-9f49-48ab-af8c-2cfde0288721', 'volume_size': 1} Sep 28 17:22:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-48dec129-8218-406b-8c54-f420cb23c92b tempest-ProjectReaderTests-1865499017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-48dec129-8218-406b-8c54-f420cb23c92b tempest-ProjectReaderTests-1865499017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:42 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-48dec129-8218-406b-8c54-f420cb23c92b tempest-ProjectReaderTests-1865499017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-710852193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2733c1f-9f49-48ab-af8c-2cfde0288721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53375cc017d94051807044360736c6bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:42Z,use_quota=True,user_id='62509f72568245c1ac77eca8ed973e35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:42 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-48dec129-8218-406b-8c54-f420cb23c92b tempest-ProjectReaderTests-1865499017 None] Creating volume d2733c1f-9f49-48ab-af8c-2cfde0288721 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-48dec129-8218-406b-8c54-f420cb23c92b tempest-ProjectReaderTests-1865499017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-48dec129-8218-406b-8c54-f420cb23c92b tempest-ProjectReaderTests-1865499017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:42 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-48dec129-8218-406b-8c54-f420cb23c92b tempest-ProjectReaderTests-1865499017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:42 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-48dec129-8218-406b-8c54-f420cb23c92b tempest-ProjectReaderTests-1865499017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-48dec129-8218-406b-8c54-f420cb23c92b tempest-ProjectReaderTests-1865499017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:42 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-48dec129-8218-406b-8c54-f420cb23c92b tempest-ProjectReaderTests-1865499017 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:42 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-48dec129-8218-406b-8c54-f420cb23c92b tempest-ProjectReaderTests-1865499017 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:22:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-48dec129-8218-406b-8c54-f420cb23c92b tempest-ProjectReaderTests-1865499017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d2733c1f-9f49-48ab-af8c-2cfde0288721 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:42 devstack sudo[101505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d2733c1f-9f49-48ab-af8c-2cfde0288721 1073741824 Sep 28 17:22:42 devstack sudo[101505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:43 devstack sudo[101505]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-48dec129-8218-406b-8c54-f420cb23c92b tempest-ProjectReaderTests-1865499017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d2733c1f-9f49-48ab-af8c-2cfde0288721 1073741824" returned: 0 in 0.692s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-48dec129-8218-406b-8c54-f420cb23c92b tempest-ProjectReaderTests-1865499017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d2733c1f-9f49-48ab-af8c-2cfde0288721 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:43 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d2733c1f-9f49-48ab-af8c-2cfde0288721 Sep 28 17:22:43 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:43 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-48dec129-8218-406b-8c54-f420cb23c92b tempest-ProjectReaderTests-1865499017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d2733c1f-9f49-48ab-af8c-2cfde0288721" returned: 0 in 0.327s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:43 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-48dec129-8218-406b-8c54-f420cb23c92b tempest-ProjectReaderTests-1865499017 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-48dec129-8218-406b-8c54-f420cb23c92b tempest-ProjectReaderTests-1865499017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-48dec129-8218-406b-8c54-f420cb23c92b tempest-ProjectReaderTests-1865499017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abcb4750-6384-492e-81ce-6f1696571fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2733c1f-9f49-48ab-af8c-2cfde0288721', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-48dec129-8218-406b-8c54-f420cb23c92b tempest-ProjectReaderTests-1865499017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (478ec292-f621-4f72-acb0-73407aaaa011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:43 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-48dec129-8218-406b-8c54-f420cb23c92b tempest-ProjectReaderTests-1865499017 None] Volume volume-d2733c1f-9f49-48ab-af8c-2cfde0288721 (d2733c1f-9f49-48ab-af8c-2cfde0288721): created successfully Sep 28 17:22:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-48dec129-8218-406b-8c54-f420cb23c92b tempest-ProjectReaderTests-1865499017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (478ec292-f621-4f72-acb0-73407aaaa011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-48dec129-8218-406b-8c54-f420cb23c92b tempest-ProjectReaderTests-1865499017 None] Flow 'volume_create_manager' (513a1981-b81a-4674-8fc2-79d8591e5349) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:43 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-48dec129-8218-406b-8c54-f420cb23c92b tempest-ProjectReaderTests-1865499017 None] Created volume successfully. Sep 28 17:22:44 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-15b5549d-5139-4d77-8e66-d0614df1428d tempest-ProjectReaderTests-1865499017 None] Acquiring lock "cinder-d2733c1f-9f49-48ab-af8c-2cfde0288721-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:44 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-15b5549d-5139-4d77-8e66-d0614df1428d tempest-ProjectReaderTests-1865499017 None] Lock "cinder-d2733c1f-9f49-48ab-af8c-2cfde0288721-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:44 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-15b5549d-5139-4d77-8e66-d0614df1428d tempest-ProjectReaderTests-1865499017 None] Acquiring lock "cinder-quobyte-d2733c1f-9f49-48ab-af8c-2cfde0288721" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:44 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-15b5549d-5139-4d77-8e66-d0614df1428d tempest-ProjectReaderTests-1865499017 None] Lock "cinder-quobyte-d2733c1f-9f49-48ab-af8c-2cfde0288721" acquired by "delete_volume" :: waited 0.031s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:44 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b230c56a-e8cd-46d1-a885-4275ab4a6ceb]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-15b5549d-5139-4d77-8e66-d0614df1428d tempest-ProjectReaderTests-1865499017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d2733c1f-9f49-48ab-af8c-2cfde0288721 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:44 devstack sudo[101518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d2733c1f-9f49-48ab-af8c-2cfde0288721 Sep 28 17:22:44 devstack sudo[101518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:44 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e0df5c2-59df-4542-a331-cfc185a24a25 tempest-VolumesTestJSON-286268902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e0df5c2-59df-4542-a331-cfc185a24a25 tempest-VolumesTestJSON-286268902 None] Flow 'volume_create_manager' (70b042c8-c370-44bc-ac82-a23b197ab0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e0df5c2-59df-4542-a331-cfc185a24a25 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b0ab903-75cf-41d5-92ae-61b465c99a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e0df5c2-59df-4542-a331-cfc185a24a25 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b0ab903-75cf-41d5-92ae-61b465c99a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1058475577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=377e44d2-82dc-451e-a744-fec43b702d44,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='719e69ddd7fb4d5e93ea9750877c2484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:45Z,use_quota=True,user_id='f2c6458233344e1393d2e4417bd5bdab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e0df5c2-59df-4542-a331-cfc185a24a25 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f05c5d03-8b97-402f-8262-98fcca407364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e0df5c2-59df-4542-a331-cfc185a24a25 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f05c5d03-8b97-402f-8262-98fcca407364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e0df5c2-59df-4542-a331-cfc185a24a25 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64980c39-c754-4d8a-bef0-02be2d69a7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e0df5c2-59df-4542-a331-cfc185a24a25 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64980c39-c754-4d8a-bef0-02be2d69a7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '377e44d2-82dc-451e-a744-fec43b702d44', 'volume_name': 'volume-377e44d2-82dc-451e-a744-fec43b702d44', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e0df5c2-59df-4542-a331-cfc185a24a25 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (787bd4e2-5427-4886-8fe8-99612b3a11ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e0df5c2-59df-4542-a331-cfc185a24a25 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (787bd4e2-5427-4886-8fe8-99612b3a11ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e0df5c2-59df-4542-a331-cfc185a24a25 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c244ef-17a5-44e5-b2cb-0b637e96358d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:44 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-4e0df5c2-59df-4542-a331-cfc185a24a25 tempest-VolumesTestJSON-286268902 None] Volume 377e44d2-82dc-451e-a744-fec43b702d44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-377e44d2-82dc-451e-a744-fec43b702d44', 'volume_size': 1} Sep 28 17:22:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4e0df5c2-59df-4542-a331-cfc185a24a25 tempest-VolumesTestJSON-286268902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4e0df5c2-59df-4542-a331-cfc185a24a25 tempest-VolumesTestJSON-286268902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4e0df5c2-59df-4542-a331-cfc185a24a25 tempest-VolumesTestJSON-286268902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1058475577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=377e44d2-82dc-451e-a744-fec43b702d44,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='719e69ddd7fb4d5e93ea9750877c2484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:45Z,use_quota=True,user_id='f2c6458233344e1393d2e4417bd5bdab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-4e0df5c2-59df-4542-a331-cfc185a24a25 tempest-VolumesTestJSON-286268902 None] Creating volume 377e44d2-82dc-451e-a744-fec43b702d44 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4e0df5c2-59df-4542-a331-cfc185a24a25 tempest-VolumesTestJSON-286268902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4e0df5c2-59df-4542-a331-cfc185a24a25 tempest-VolumesTestJSON-286268902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4e0df5c2-59df-4542-a331-cfc185a24a25 tempest-VolumesTestJSON-286268902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4e0df5c2-59df-4542-a331-cfc185a24a25 tempest-VolumesTestJSON-286268902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4e0df5c2-59df-4542-a331-cfc185a24a25 tempest-VolumesTestJSON-286268902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4e0df5c2-59df-4542-a331-cfc185a24a25 tempest-VolumesTestJSON-286268902 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:45 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-4e0df5c2-59df-4542-a331-cfc185a24a25 tempest-VolumesTestJSON-286268902 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:22:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e0df5c2-59df-4542-a331-cfc185a24a25 tempest-VolumesTestJSON-286268902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-377e44d2-82dc-451e-a744-fec43b702d44 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:45 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-377e44d2-82dc-451e-a744-fec43b702d44 1073741824 Sep 28 17:22:45 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:45 devstack sudo[101518]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-15b5549d-5139-4d77-8e66-d0614df1428d tempest-ProjectReaderTests-1865499017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d2733c1f-9f49-48ab-af8c-2cfde0288721" returned: 0 in 0.504s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-15b5549d-5139-4d77-8e66-d0614df1428d tempest-ProjectReaderTests-1865499017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d2733c1f-9f49-48ab-af8c-2cfde0288721 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:45 devstack sudo[101525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d2733c1f-9f49-48ab-af8c-2cfde0288721 Sep 28 17:22:45 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:45 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-15b5549d-5139-4d77-8e66-d0614df1428d tempest-ProjectReaderTests-1865499017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d2733c1f-9f49-48ab-af8c-2cfde0288721" returned: 0 in 0.411s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:45 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-15b5549d-5139-4d77-8e66-d0614df1428d tempest-ProjectReaderTests-1865499017 None] Lock "cinder-quobyte-d2733c1f-9f49-48ab-af8c-2cfde0288721" released by "delete_volume" :: held 1.000s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:45 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:45 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-15b5549d-5139-4d77-8e66-d0614df1428d tempest-ProjectReaderTests-1865499017 None] Created reservations ['73caad0b-3285-4125-8ca5-0f8d1ef2355b', 'a405c738-dcda-4119-a5fb-a862037d4eba', '7a880764-0a72-43fe-988c-a586ed8a9bdd', '7447a16b-e09d-4d4c-9a4b-f0cdb41133ae'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e0df5c2-59df-4542-a331-cfc185a24a25 tempest-VolumesTestJSON-286268902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-377e44d2-82dc-451e-a744-fec43b702d44 1073741824" returned: 0 in 0.742s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e0df5c2-59df-4542-a331-cfc185a24a25 tempest-VolumesTestJSON-286268902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-377e44d2-82dc-451e-a744-fec43b702d44 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:45 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-377e44d2-82dc-451e-a744-fec43b702d44 Sep 28 17:22:45 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-15b5549d-5139-4d77-8e66-d0614df1428d tempest-ProjectReaderTests-1865499017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-15b5549d-5139-4d77-8e66-d0614df1428d tempest-ProjectReaderTests-1865499017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-15b5549d-5139-4d77-8e66-d0614df1428d tempest-ProjectReaderTests-1865499017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-15b5549d-5139-4d77-8e66-d0614df1428d tempest-ProjectReaderTests-1865499017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-15b5549d-5139-4d77-8e66-d0614df1428d tempest-ProjectReaderTests-1865499017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-15b5549d-5139-4d77-8e66-d0614df1428d tempest-ProjectReaderTests-1865499017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:45 devstack sudo[101536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:22:45 devstack sudo[101536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:46 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e0df5c2-59df-4542-a331-cfc185a24a25 tempest-VolumesTestJSON-286268902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-377e44d2-82dc-451e-a744-fec43b702d44" returned: 0 in 0.373s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:46 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4e0df5c2-59df-4542-a331-cfc185a24a25 tempest-VolumesTestJSON-286268902 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4e0df5c2-59df-4542-a331-cfc185a24a25 tempest-VolumesTestJSON-286268902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e0df5c2-59df-4542-a331-cfc185a24a25 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c244ef-17a5-44e5-b2cb-0b637e96358d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-377e44d2-82dc-451e-a744-fec43b702d44', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e0df5c2-59df-4542-a331-cfc185a24a25 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0efa9ecd-8450-4a21-8e34-60239ca6c218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:46 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-4e0df5c2-59df-4542-a331-cfc185a24a25 tempest-VolumesTestJSON-286268902 None] Volume volume-377e44d2-82dc-451e-a744-fec43b702d44 (377e44d2-82dc-451e-a744-fec43b702d44): created successfully Sep 28 17:22:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e0df5c2-59df-4542-a331-cfc185a24a25 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0efa9ecd-8450-4a21-8e34-60239ca6c218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:46 devstack sudo[101536]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e0df5c2-59df-4542-a331-cfc185a24a25 tempest-VolumesTestJSON-286268902 None] Flow 'volume_create_manager' (70b042c8-c370-44bc-ac82-a23b197ab0b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-15b5549d-5139-4d77-8e66-d0614df1428d tempest-ProjectReaderTests-1865499017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.397s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:46 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-15b5549d-5139-4d77-8e66-d0614df1428d tempest-ProjectReaderTests-1865499017 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:46 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-15b5549d-5139-4d77-8e66-d0614df1428d tempest-ProjectReaderTests-1865499017 None] Deleted volume successfully. Sep 28 17:22:46 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-4e0df5c2-59df-4542-a331-cfc185a24a25 tempest-VolumesTestJSON-286268902 None] Created volume successfully. Sep 28 17:22:46 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-15b5549d-5139-4d77-8e66-d0614df1428d tempest-ProjectReaderTests-1865499017 None] Lock "cinder-d2733c1f-9f49-48ab-af8c-2cfde0288721-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:47 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-76cca71c-316d-4f60-97d8-3dc706a31e37 tempest-VolumesTestJSON-286268902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:47 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-76cca71c-316d-4f60-97d8-3dc706a31e37 tempest-VolumesTestJSON-286268902 None] Flow 'volume_create_manager' (d54192dd-b3a5-4e98-9291-c697926d11fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:47 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-76cca71c-316d-4f60-97d8-3dc706a31e37 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (805e9fa5-ac79-4d68-b10a-ee0127112105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:47 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-76cca71c-316d-4f60-97d8-3dc706a31e37 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (805e9fa5-ac79-4d68-b10a-ee0127112105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1758207651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa810cef-5ba5-4386-ac1d-be6f555a0f6b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='719e69ddd7fb4d5e93ea9750877c2484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:48Z,use_quota=True,user_id='f2c6458233344e1393d2e4417bd5bdab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:47 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-76cca71c-316d-4f60-97d8-3dc706a31e37 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (191045cb-1918-46e7-ac7d-821021e00ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:47 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-76cca71c-316d-4f60-97d8-3dc706a31e37 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (191045cb-1918-46e7-ac7d-821021e00ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:47 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-76cca71c-316d-4f60-97d8-3dc706a31e37 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d32881-bf96-49a0-ac98-da44a16df4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:47 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-76cca71c-316d-4f60-97d8-3dc706a31e37 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d32881-bf96-49a0-ac98-da44a16df4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa810cef-5ba5-4386-ac1d-be6f555a0f6b', 'volume_name': 'volume-fa810cef-5ba5-4386-ac1d-be6f555a0f6b', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:47 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-76cca71c-316d-4f60-97d8-3dc706a31e37 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eb69a2b-aaf8-4274-b015-0ec6f717a38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:47 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-76cca71c-316d-4f60-97d8-3dc706a31e37 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eb69a2b-aaf8-4274-b015-0ec6f717a38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:47 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-76cca71c-316d-4f60-97d8-3dc706a31e37 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aedb20c8-f71b-461d-83cf-facaa66f9597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:47 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-76cca71c-316d-4f60-97d8-3dc706a31e37 tempest-VolumesTestJSON-286268902 None] Volume fa810cef-5ba5-4386-ac1d-be6f555a0f6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa810cef-5ba5-4386-ac1d-be6f555a0f6b', 'volume_size': 1} Sep 28 17:22:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-76cca71c-316d-4f60-97d8-3dc706a31e37 tempest-VolumesTestJSON-286268902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-76cca71c-316d-4f60-97d8-3dc706a31e37 tempest-VolumesTestJSON-286268902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:47 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-76cca71c-316d-4f60-97d8-3dc706a31e37 tempest-VolumesTestJSON-286268902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1758207651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa810cef-5ba5-4386-ac1d-be6f555a0f6b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='719e69ddd7fb4d5e93ea9750877c2484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:48Z,use_quota=True,user_id='f2c6458233344e1393d2e4417bd5bdab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:47 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-76cca71c-316d-4f60-97d8-3dc706a31e37 tempest-VolumesTestJSON-286268902 None] Creating volume fa810cef-5ba5-4386-ac1d-be6f555a0f6b {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-76cca71c-316d-4f60-97d8-3dc706a31e37 tempest-VolumesTestJSON-286268902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-76cca71c-316d-4f60-97d8-3dc706a31e37 tempest-VolumesTestJSON-286268902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:47 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-76cca71c-316d-4f60-97d8-3dc706a31e37 tempest-VolumesTestJSON-286268902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:47 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-76cca71c-316d-4f60-97d8-3dc706a31e37 tempest-VolumesTestJSON-286268902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-76cca71c-316d-4f60-97d8-3dc706a31e37 tempest-VolumesTestJSON-286268902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:47 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-76cca71c-316d-4f60-97d8-3dc706a31e37 tempest-VolumesTestJSON-286268902 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:47 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-76cca71c-316d-4f60-97d8-3dc706a31e37 tempest-VolumesTestJSON-286268902 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:22:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-76cca71c-316d-4f60-97d8-3dc706a31e37 tempest-VolumesTestJSON-286268902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fa810cef-5ba5-4386-ac1d-be6f555a0f6b 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:48 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fa810cef-5ba5-4386-ac1d-be6f555a0f6b 1073741824 Sep 28 17:22:48 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:48 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-76cca71c-316d-4f60-97d8-3dc706a31e37 tempest-VolumesTestJSON-286268902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fa810cef-5ba5-4386-ac1d-be6f555a0f6b 1073741824" returned: 0 in 0.685s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-76cca71c-316d-4f60-97d8-3dc706a31e37 tempest-VolumesTestJSON-286268902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fa810cef-5ba5-4386-ac1d-be6f555a0f6b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:48 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fa810cef-5ba5-4386-ac1d-be6f555a0f6b Sep 28 17:22:48 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:49 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-76cca71c-316d-4f60-97d8-3dc706a31e37 tempest-VolumesTestJSON-286268902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fa810cef-5ba5-4386-ac1d-be6f555a0f6b" returned: 0 in 0.389s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-76cca71c-316d-4f60-97d8-3dc706a31e37 tempest-VolumesTestJSON-286268902 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-76cca71c-316d-4f60-97d8-3dc706a31e37 tempest-VolumesTestJSON-286268902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-76cca71c-316d-4f60-97d8-3dc706a31e37 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aedb20c8-f71b-461d-83cf-facaa66f9597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa810cef-5ba5-4386-ac1d-be6f555a0f6b', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-76cca71c-316d-4f60-97d8-3dc706a31e37 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b8e174-fac4-4766-9a88-b0a936458aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:49 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-76cca71c-316d-4f60-97d8-3dc706a31e37 tempest-VolumesTestJSON-286268902 None] Volume volume-fa810cef-5ba5-4386-ac1d-be6f555a0f6b (fa810cef-5ba5-4386-ac1d-be6f555a0f6b): created successfully Sep 28 17:22:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-76cca71c-316d-4f60-97d8-3dc706a31e37 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b8e174-fac4-4766-9a88-b0a936458aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-76cca71c-316d-4f60-97d8-3dc706a31e37 tempest-VolumesTestJSON-286268902 None] Flow 'volume_create_manager' (d54192dd-b3a5-4e98-9291-c697926d11fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:49 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-76cca71c-316d-4f60-97d8-3dc706a31e37 tempest-VolumesTestJSON-286268902 None] Created volume successfully. Sep 28 17:22:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:22:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:49 devstack sudo[101549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:22:49 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:49 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.347s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:49 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager._thread_info {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:22:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread count: 28 {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:22:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread info: [<_MainThread(MainThread, started 132915553284224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:22:50 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c963ee2-bc04-4765-8cd8-dd80cfbbb411 tempest-VolumesTestJSON-286268902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3c963ee2-bc04-4765-8cd8-dd80cfbbb411 tempest-VolumesTestJSON-286268902 None] Flow 'volume_create_manager' (06859ccf-0112-437e-b89a-2842e00ef7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3c963ee2-bc04-4765-8cd8-dd80cfbbb411 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2393367-39c8-40d3-bb6f-0fe42fee2d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3c963ee2-bc04-4765-8cd8-dd80cfbbb411 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2393367-39c8-40d3-bb6f-0fe42fee2d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-580805726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9689a51f-b38c-4b24-bcc9-a4c8c1122002,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='719e69ddd7fb4d5e93ea9750877c2484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:51Z,use_quota=True,user_id='f2c6458233344e1393d2e4417bd5bdab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3c963ee2-bc04-4765-8cd8-dd80cfbbb411 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20772a71-b905-44f5-a982-91a04424e390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3c963ee2-bc04-4765-8cd8-dd80cfbbb411 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20772a71-b905-44f5-a982-91a04424e390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3c963ee2-bc04-4765-8cd8-dd80cfbbb411 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d2ce525-36d7-4dc6-9e96-f894685932e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3c963ee2-bc04-4765-8cd8-dd80cfbbb411 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d2ce525-36d7-4dc6-9e96-f894685932e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9689a51f-b38c-4b24-bcc9-a4c8c1122002', 'volume_name': 'volume-9689a51f-b38c-4b24-bcc9-a4c8c1122002', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3c963ee2-bc04-4765-8cd8-dd80cfbbb411 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0486131-4968-4130-b798-4700ac18a33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3c963ee2-bc04-4765-8cd8-dd80cfbbb411 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0486131-4968-4130-b798-4700ac18a33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3c963ee2-bc04-4765-8cd8-dd80cfbbb411 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cac607df-21e6-45f5-9eff-612fdcf10a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:51 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-3c963ee2-bc04-4765-8cd8-dd80cfbbb411 tempest-VolumesTestJSON-286268902 None] Volume 9689a51f-b38c-4b24-bcc9-a4c8c1122002: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9689a51f-b38c-4b24-bcc9-a4c8c1122002', 'volume_size': 1} Sep 28 17:22:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3c963ee2-bc04-4765-8cd8-dd80cfbbb411 tempest-VolumesTestJSON-286268902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3c963ee2-bc04-4765-8cd8-dd80cfbbb411 tempest-VolumesTestJSON-286268902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:51 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-3c963ee2-bc04-4765-8cd8-dd80cfbbb411 tempest-VolumesTestJSON-286268902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-580805726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9689a51f-b38c-4b24-bcc9-a4c8c1122002,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='719e69ddd7fb4d5e93ea9750877c2484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:51Z,use_quota=True,user_id='f2c6458233344e1393d2e4417bd5bdab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:51 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-3c963ee2-bc04-4765-8cd8-dd80cfbbb411 tempest-VolumesTestJSON-286268902 None] Creating volume 9689a51f-b38c-4b24-bcc9-a4c8c1122002 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3c963ee2-bc04-4765-8cd8-dd80cfbbb411 tempest-VolumesTestJSON-286268902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3c963ee2-bc04-4765-8cd8-dd80cfbbb411 tempest-VolumesTestJSON-286268902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:51 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-3c963ee2-bc04-4765-8cd8-dd80cfbbb411 tempest-VolumesTestJSON-286268902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:51 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-3c963ee2-bc04-4765-8cd8-dd80cfbbb411 tempest-VolumesTestJSON-286268902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3c963ee2-bc04-4765-8cd8-dd80cfbbb411 tempest-VolumesTestJSON-286268902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:51 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-3c963ee2-bc04-4765-8cd8-dd80cfbbb411 tempest-VolumesTestJSON-286268902 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:51 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-3c963ee2-bc04-4765-8cd8-dd80cfbbb411 tempest-VolumesTestJSON-286268902 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:22:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3c963ee2-bc04-4765-8cd8-dd80cfbbb411 tempest-VolumesTestJSON-286268902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-9689a51f-b38c-4b24-bcc9-a4c8c1122002 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:51 devstack sudo[101553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-9689a51f-b38c-4b24-bcc9-a4c8c1122002 1073741824 Sep 28 17:22:51 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:51 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3c963ee2-bc04-4765-8cd8-dd80cfbbb411 tempest-VolumesTestJSON-286268902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-9689a51f-b38c-4b24-bcc9-a4c8c1122002 1073741824" returned: 0 in 0.785s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3c963ee2-bc04-4765-8cd8-dd80cfbbb411 tempest-VolumesTestJSON-286268902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-9689a51f-b38c-4b24-bcc9-a4c8c1122002 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:51 devstack sudo[101559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-9689a51f-b38c-4b24-bcc9-a4c8c1122002 Sep 28 17:22:51 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:52 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3c963ee2-bc04-4765-8cd8-dd80cfbbb411 tempest-VolumesTestJSON-286268902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-9689a51f-b38c-4b24-bcc9-a4c8c1122002" returned: 0 in 0.355s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-3c963ee2-bc04-4765-8cd8-dd80cfbbb411 tempest-VolumesTestJSON-286268902 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3c963ee2-bc04-4765-8cd8-dd80cfbbb411 tempest-VolumesTestJSON-286268902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3c963ee2-bc04-4765-8cd8-dd80cfbbb411 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cac607df-21e6-45f5-9eff-612fdcf10a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9689a51f-b38c-4b24-bcc9-a4c8c1122002', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3c963ee2-bc04-4765-8cd8-dd80cfbbb411 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (990eafe7-f4c6-4e95-a1a7-410954d64658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:52 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-3c963ee2-bc04-4765-8cd8-dd80cfbbb411 tempest-VolumesTestJSON-286268902 None] Volume volume-9689a51f-b38c-4b24-bcc9-a4c8c1122002 (9689a51f-b38c-4b24-bcc9-a4c8c1122002): created successfully Sep 28 17:22:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3c963ee2-bc04-4765-8cd8-dd80cfbbb411 tempest-VolumesTestJSON-286268902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (990eafe7-f4c6-4e95-a1a7-410954d64658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3c963ee2-bc04-4765-8cd8-dd80cfbbb411 tempest-VolumesTestJSON-286268902 None] Flow 'volume_create_manager' (06859ccf-0112-437e-b89a-2842e00ef7bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:52 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-3c963ee2-bc04-4765-8cd8-dd80cfbbb411 tempest-VolumesTestJSON-286268902 None] Created volume successfully. Sep 28 17:22:52 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-34e26829-fd4f-4bef-aa1e-dc5bee44c585 tempest-TestServerVolumeAttachmentScenario-641932328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-34e26829-fd4f-4bef-aa1e-dc5bee44c585 tempest-TestServerVolumeAttachmentScenario-641932328 None] Flow 'volume_create_manager' (c4427621-b3f4-45e9-a7dd-67f337a778df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-34e26829-fd4f-4bef-aa1e-dc5bee44c585 tempest-TestServerVolumeAttachmentScenario-641932328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b249472-eccf-42ce-920c-dd9afffc4967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-34e26829-fd4f-4bef-aa1e-dc5bee44c585 tempest-TestServerVolumeAttachmentScenario-641932328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b249472-eccf-42ce-920c-dd9afffc4967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1124763997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9f915d0-1f4a-4e93-bf08-4d6b4858866f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b62fb3b4d6644a748992107f8d380cf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:53Z,use_quota=True,user_id='76b07793c91141b0a714c8c4189b9fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-34e26829-fd4f-4bef-aa1e-dc5bee44c585 tempest-TestServerVolumeAttachmentScenario-641932328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d36c124-ffac-4768-84bf-92e14246a8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-34e26829-fd4f-4bef-aa1e-dc5bee44c585 tempest-TestServerVolumeAttachmentScenario-641932328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d36c124-ffac-4768-84bf-92e14246a8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-34e26829-fd4f-4bef-aa1e-dc5bee44c585 tempest-TestServerVolumeAttachmentScenario-641932328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1b7f90-4d10-41bd-b248-e91c1260f26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-34e26829-fd4f-4bef-aa1e-dc5bee44c585 tempest-TestServerVolumeAttachmentScenario-641932328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1b7f90-4d10-41bd-b248-e91c1260f26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9f915d0-1f4a-4e93-bf08-4d6b4858866f', 'volume_name': 'volume-e9f915d0-1f4a-4e93-bf08-4d6b4858866f', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-34e26829-fd4f-4bef-aa1e-dc5bee44c585 tempest-TestServerVolumeAttachmentScenario-641932328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6d3b4f-b2f5-4028-bbf7-66cf2912403f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-34e26829-fd4f-4bef-aa1e-dc5bee44c585 tempest-TestServerVolumeAttachmentScenario-641932328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6d3b4f-b2f5-4028-bbf7-66cf2912403f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-34e26829-fd4f-4bef-aa1e-dc5bee44c585 tempest-TestServerVolumeAttachmentScenario-641932328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (851be8d1-c7fa-4991-b55e-aad163d12877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:53 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-34e26829-fd4f-4bef-aa1e-dc5bee44c585 tempest-TestServerVolumeAttachmentScenario-641932328 None] Volume e9f915d0-1f4a-4e93-bf08-4d6b4858866f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9f915d0-1f4a-4e93-bf08-4d6b4858866f', 'volume_size': 1} Sep 28 17:22:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-34e26829-fd4f-4bef-aa1e-dc5bee44c585 tempest-TestServerVolumeAttachmentScenario-641932328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-34e26829-fd4f-4bef-aa1e-dc5bee44c585 tempest-TestServerVolumeAttachmentScenario-641932328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:53 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-34e26829-fd4f-4bef-aa1e-dc5bee44c585 tempest-TestServerVolumeAttachmentScenario-641932328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1124763997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9f915d0-1f4a-4e93-bf08-4d6b4858866f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b62fb3b4d6644a748992107f8d380cf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:53Z,use_quota=True,user_id='76b07793c91141b0a714c8c4189b9fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:53 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-34e26829-fd4f-4bef-aa1e-dc5bee44c585 tempest-TestServerVolumeAttachmentScenario-641932328 None] Creating volume e9f915d0-1f4a-4e93-bf08-4d6b4858866f {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-34e26829-fd4f-4bef-aa1e-dc5bee44c585 tempest-TestServerVolumeAttachmentScenario-641932328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-34e26829-fd4f-4bef-aa1e-dc5bee44c585 tempest-TestServerVolumeAttachmentScenario-641932328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:53 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-34e26829-fd4f-4bef-aa1e-dc5bee44c585 tempest-TestServerVolumeAttachmentScenario-641932328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:53 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-34e26829-fd4f-4bef-aa1e-dc5bee44c585 tempest-TestServerVolumeAttachmentScenario-641932328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-34e26829-fd4f-4bef-aa1e-dc5bee44c585 tempest-TestServerVolumeAttachmentScenario-641932328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:53 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-34e26829-fd4f-4bef-aa1e-dc5bee44c585 tempest-TestServerVolumeAttachmentScenario-641932328 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:53 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-34e26829-fd4f-4bef-aa1e-dc5bee44c585 tempest-TestServerVolumeAttachmentScenario-641932328 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:22:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-34e26829-fd4f-4bef-aa1e-dc5bee44c585 tempest-TestServerVolumeAttachmentScenario-641932328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9f915d0-1f4a-4e93-bf08-4d6b4858866f 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:53 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9f915d0-1f4a-4e93-bf08-4d6b4858866f 1073741824 Sep 28 17:22:53 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:53 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-d42b91b3-e3ea-4e4d-ab5e-56f8d56ca032 tempest-TestServerVolumeAttachmentScenario-641932328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d42b91b3-e3ea-4e4d-ab5e-56f8d56ca032 tempest-TestServerVolumeAttachmentScenario-641932328 None] Flow 'volume_create_manager' (da21e0a5-cb88-40ae-9866-755b1f93712b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d42b91b3-e3ea-4e4d-ab5e-56f8d56ca032 tempest-TestServerVolumeAttachmentScenario-641932328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfb2205-b212-496d-a021-f2504b08ab8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d42b91b3-e3ea-4e4d-ab5e-56f8d56ca032 tempest-TestServerVolumeAttachmentScenario-641932328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfb2205-b212-496d-a021-f2504b08ab8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-357564957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7394b23-a0c2-44bb-8076-2ff464b55d3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b62fb3b4d6644a748992107f8d380cf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:54Z,use_quota=True,user_id='76b07793c91141b0a714c8c4189b9fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d42b91b3-e3ea-4e4d-ab5e-56f8d56ca032 tempest-TestServerVolumeAttachmentScenario-641932328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7250141-a66f-48e1-8742-7a0c61643c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d42b91b3-e3ea-4e4d-ab5e-56f8d56ca032 tempest-TestServerVolumeAttachmentScenario-641932328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7250141-a66f-48e1-8742-7a0c61643c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d42b91b3-e3ea-4e4d-ab5e-56f8d56ca032 tempest-TestServerVolumeAttachmentScenario-641932328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbf20b9e-9f36-4edf-846c-e85ae3084424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d42b91b3-e3ea-4e4d-ab5e-56f8d56ca032 tempest-TestServerVolumeAttachmentScenario-641932328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbf20b9e-9f36-4edf-846c-e85ae3084424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7394b23-a0c2-44bb-8076-2ff464b55d3d', 'volume_name': 'volume-f7394b23-a0c2-44bb-8076-2ff464b55d3d', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d42b91b3-e3ea-4e4d-ab5e-56f8d56ca032 tempest-TestServerVolumeAttachmentScenario-641932328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0b7fef-81a6-4d1e-bb92-20e13350c521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d42b91b3-e3ea-4e4d-ab5e-56f8d56ca032 tempest-TestServerVolumeAttachmentScenario-641932328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0b7fef-81a6-4d1e-bb92-20e13350c521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:53 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d42b91b3-e3ea-4e4d-ab5e-56f8d56ca032 tempest-TestServerVolumeAttachmentScenario-641932328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (914b6910-2178-47b4-a1f6-4eb7e077356d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:53 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-d42b91b3-e3ea-4e4d-ab5e-56f8d56ca032 tempest-TestServerVolumeAttachmentScenario-641932328 None] Volume f7394b23-a0c2-44bb-8076-2ff464b55d3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7394b23-a0c2-44bb-8076-2ff464b55d3d', 'volume_size': 1} Sep 28 17:22:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d42b91b3-e3ea-4e4d-ab5e-56f8d56ca032 tempest-TestServerVolumeAttachmentScenario-641932328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:54 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-34e26829-fd4f-4bef-aa1e-dc5bee44c585 tempest-TestServerVolumeAttachmentScenario-641932328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9f915d0-1f4a-4e93-bf08-4d6b4858866f 1073741824" returned: 0 in 0.920s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-34e26829-fd4f-4bef-aa1e-dc5bee44c585 tempest-TestServerVolumeAttachmentScenario-641932328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9f915d0-1f4a-4e93-bf08-4d6b4858866f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:54 devstack sudo[101568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9f915d0-1f4a-4e93-bf08-4d6b4858866f Sep 28 17:22:54 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:54 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-34e26829-fd4f-4bef-aa1e-dc5bee44c585 tempest-TestServerVolumeAttachmentScenario-641932328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9f915d0-1f4a-4e93-bf08-4d6b4858866f" returned: 0 in 0.456s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:54 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-34e26829-fd4f-4bef-aa1e-dc5bee44c585 tempest-TestServerVolumeAttachmentScenario-641932328 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-34e26829-fd4f-4bef-aa1e-dc5bee44c585 tempest-TestServerVolumeAttachmentScenario-641932328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d42b91b3-e3ea-4e4d-ab5e-56f8d56ca032 tempest-TestServerVolumeAttachmentScenario-641932328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.717s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:54 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d42b91b3-e3ea-4e4d-ab5e-56f8d56ca032 tempest-TestServerVolumeAttachmentScenario-641932328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-357564957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7394b23-a0c2-44bb-8076-2ff464b55d3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b62fb3b4d6644a748992107f8d380cf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:54Z,use_quota=True,user_id='76b07793c91141b0a714c8c4189b9fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:54 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-d42b91b3-e3ea-4e4d-ab5e-56f8d56ca032 tempest-TestServerVolumeAttachmentScenario-641932328 None] Creating volume f7394b23-a0c2-44bb-8076-2ff464b55d3d {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d42b91b3-e3ea-4e4d-ab5e-56f8d56ca032 tempest-TestServerVolumeAttachmentScenario-641932328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d42b91b3-e3ea-4e4d-ab5e-56f8d56ca032 tempest-TestServerVolumeAttachmentScenario-641932328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:54 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d42b91b3-e3ea-4e4d-ab5e-56f8d56ca032 tempest-TestServerVolumeAttachmentScenario-641932328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:54 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d42b91b3-e3ea-4e4d-ab5e-56f8d56ca032 tempest-TestServerVolumeAttachmentScenario-641932328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d42b91b3-e3ea-4e4d-ab5e-56f8d56ca032 tempest-TestServerVolumeAttachmentScenario-641932328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:54 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d42b91b3-e3ea-4e4d-ab5e-56f8d56ca032 tempest-TestServerVolumeAttachmentScenario-641932328 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:54 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-d42b91b3-e3ea-4e4d-ab5e-56f8d56ca032 tempest-TestServerVolumeAttachmentScenario-641932328 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:22:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d42b91b3-e3ea-4e4d-ab5e-56f8d56ca032 tempest-TestServerVolumeAttachmentScenario-641932328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f7394b23-a0c2-44bb-8076-2ff464b55d3d 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:54 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-34e26829-fd4f-4bef-aa1e-dc5bee44c585 tempest-TestServerVolumeAttachmentScenario-641932328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (851be8d1-c7fa-4991-b55e-aad163d12877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9f915d0-1f4a-4e93-bf08-4d6b4858866f', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:54 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f7394b23-a0c2-44bb-8076-2ff464b55d3d 1073741824 Sep 28 17:22:54 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-34e26829-fd4f-4bef-aa1e-dc5bee44c585 tempest-TestServerVolumeAttachmentScenario-641932328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfbe9e75-4c9f-48bb-b096-bdc282c38c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:54 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:54 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-34e26829-fd4f-4bef-aa1e-dc5bee44c585 tempest-TestServerVolumeAttachmentScenario-641932328 None] Volume volume-e9f915d0-1f4a-4e93-bf08-4d6b4858866f (e9f915d0-1f4a-4e93-bf08-4d6b4858866f): created successfully Sep 28 17:22:54 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-34e26829-fd4f-4bef-aa1e-dc5bee44c585 tempest-TestServerVolumeAttachmentScenario-641932328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfbe9e75-4c9f-48bb-b096-bdc282c38c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:54 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-34e26829-fd4f-4bef-aa1e-dc5bee44c585 tempest-TestServerVolumeAttachmentScenario-641932328 None] Flow 'volume_create_manager' (c4427621-b3f4-45e9-a7dd-67f337a778df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:54 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-34e26829-fd4f-4bef-aa1e-dc5bee44c585 tempest-TestServerVolumeAttachmentScenario-641932328 None] Created volume successfully. Sep 28 17:22:54 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e23cdc11-44e3-415e-b836-edb11faf0b9f tempest-VolumesTestJSON-286268902 None] Acquiring lock "cinder-9689a51f-b38c-4b24-bcc9-a4c8c1122002-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:54 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e23cdc11-44e3-415e-b836-edb11faf0b9f tempest-VolumesTestJSON-286268902 None] Lock "cinder-9689a51f-b38c-4b24-bcc9-a4c8c1122002-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:54 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e23cdc11-44e3-415e-b836-edb11faf0b9f tempest-VolumesTestJSON-286268902 None] Acquiring lock "cinder-quobyte-9689a51f-b38c-4b24-bcc9-a4c8c1122002" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:55 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e23cdc11-44e3-415e-b836-edb11faf0b9f tempest-VolumesTestJSON-286268902 None] Lock "cinder-quobyte-9689a51f-b38c-4b24-bcc9-a4c8c1122002" acquired by "delete_volume" :: waited 0.024s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:55 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[341f8a02-60f4-48db-9815-526191c1ea99]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e23cdc11-44e3-415e-b836-edb11faf0b9f tempest-VolumesTestJSON-286268902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-9689a51f-b38c-4b24-bcc9-a4c8c1122002 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:55 devstack sudo[101575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-9689a51f-b38c-4b24-bcc9-a4c8c1122002 Sep 28 17:22:55 devstack sudo[101575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:55 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d42b91b3-e3ea-4e4d-ab5e-56f8d56ca032 tempest-TestServerVolumeAttachmentScenario-641932328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f7394b23-a0c2-44bb-8076-2ff464b55d3d 1073741824" returned: 0 in 0.891s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d42b91b3-e3ea-4e4d-ab5e-56f8d56ca032 tempest-TestServerVolumeAttachmentScenario-641932328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f7394b23-a0c2-44bb-8076-2ff464b55d3d {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:55 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f7394b23-a0c2-44bb-8076-2ff464b55d3d Sep 28 17:22:55 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:55 devstack sudo[101575]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e23cdc11-44e3-415e-b836-edb11faf0b9f tempest-VolumesTestJSON-286268902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-9689a51f-b38c-4b24-bcc9-a4c8c1122002" returned: 0 in 0.687s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e23cdc11-44e3-415e-b836-edb11faf0b9f tempest-VolumesTestJSON-286268902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-9689a51f-b38c-4b24-bcc9-a4c8c1122002 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:55 devstack sudo[101584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-9689a51f-b38c-4b24-bcc9-a4c8c1122002 Sep 28 17:22:55 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:56 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d42b91b3-e3ea-4e4d-ab5e-56f8d56ca032 tempest-TestServerVolumeAttachmentScenario-641932328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f7394b23-a0c2-44bb-8076-2ff464b55d3d" returned: 0 in 0.430s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:56 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d42b91b3-e3ea-4e4d-ab5e-56f8d56ca032 tempest-TestServerVolumeAttachmentScenario-641932328 None] <== create_volume: return (1431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d42b91b3-e3ea-4e4d-ab5e-56f8d56ca032 tempest-TestServerVolumeAttachmentScenario-641932328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:56 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d42b91b3-e3ea-4e4d-ab5e-56f8d56ca032 tempest-TestServerVolumeAttachmentScenario-641932328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (914b6910-2178-47b4-a1f6-4eb7e077356d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7394b23-a0c2-44bb-8076-2ff464b55d3d', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:56 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d42b91b3-e3ea-4e4d-ab5e-56f8d56ca032 tempest-TestServerVolumeAttachmentScenario-641932328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18e6aebc-cf5c-4f78-b309-4c7b1732db1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:56 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-d42b91b3-e3ea-4e4d-ab5e-56f8d56ca032 tempest-TestServerVolumeAttachmentScenario-641932328 None] Volume volume-f7394b23-a0c2-44bb-8076-2ff464b55d3d (f7394b23-a0c2-44bb-8076-2ff464b55d3d): created successfully Sep 28 17:22:56 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d42b91b3-e3ea-4e4d-ab5e-56f8d56ca032 tempest-TestServerVolumeAttachmentScenario-641932328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18e6aebc-cf5c-4f78-b309-4c7b1732db1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:56 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:56 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d42b91b3-e3ea-4e4d-ab5e-56f8d56ca032 tempest-TestServerVolumeAttachmentScenario-641932328 None] Flow 'volume_create_manager' (da21e0a5-cb88-40ae-9866-755b1f93712b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e23cdc11-44e3-415e-b836-edb11faf0b9f tempest-VolumesTestJSON-286268902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-9689a51f-b38c-4b24-bcc9-a4c8c1122002" returned: 0 in 0.412s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:56 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e23cdc11-44e3-415e-b836-edb11faf0b9f tempest-VolumesTestJSON-286268902 None] Lock "cinder-quobyte-9689a51f-b38c-4b24-bcc9-a4c8c1122002" released by "delete_volume" :: held 1.185s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:56 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-d42b91b3-e3ea-4e4d-ab5e-56f8d56ca032 tempest-TestServerVolumeAttachmentScenario-641932328 None] Created volume successfully. Sep 28 17:22:56 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-e23cdc11-44e3-415e-b836-edb11faf0b9f tempest-VolumesTestJSON-286268902 None] Created reservations ['fc3e1af3-4420-476a-8045-193ac1f530ac', '23c26c51-9404-4282-9f0c-fa78d9ea3eae', 'e74f920f-a015-48fb-b633-780d69cd5731', '00e52bee-5be4-4b45-b8ba-5cfcd3a5cde6'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e23cdc11-44e3-415e-b836-edb11faf0b9f tempest-VolumesTestJSON-286268902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e23cdc11-44e3-415e-b836-edb11faf0b9f tempest-VolumesTestJSON-286268902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:56 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-e23cdc11-44e3-415e-b836-edb11faf0b9f tempest-VolumesTestJSON-286268902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:56 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-e23cdc11-44e3-415e-b836-edb11faf0b9f tempest-VolumesTestJSON-286268902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e23cdc11-44e3-415e-b836-edb11faf0b9f tempest-VolumesTestJSON-286268902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e23cdc11-44e3-415e-b836-edb11faf0b9f tempest-VolumesTestJSON-286268902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:56 devstack sudo[101588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:22:56 devstack sudo[101588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:56 devstack sudo[101588]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e23cdc11-44e3-415e-b836-edb11faf0b9f tempest-VolumesTestJSON-286268902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.393s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:56 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-e23cdc11-44e3-415e-b836-edb11faf0b9f tempest-VolumesTestJSON-286268902 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:56 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-e23cdc11-44e3-415e-b836-edb11faf0b9f tempest-VolumesTestJSON-286268902 None] Deleted volume successfully. Sep 28 17:22:56 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e23cdc11-44e3-415e-b836-edb11faf0b9f tempest-VolumesTestJSON-286268902 None] Lock "cinder-9689a51f-b38c-4b24-bcc9-a4c8c1122002-delete_volume" released by "delete_volume" :: held 2.013s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:57 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-382a5929-e7f9-4654-8e7c-9cf9c4adf956 tempest-VolumesTestJSON-286268902 None] Acquiring lock "cinder-fa810cef-5ba5-4386-ac1d-be6f555a0f6b-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:57 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-382a5929-e7f9-4654-8e7c-9cf9c4adf956 tempest-VolumesTestJSON-286268902 None] Lock "cinder-fa810cef-5ba5-4386-ac1d-be6f555a0f6b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:57 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-382a5929-e7f9-4654-8e7c-9cf9c4adf956 tempest-VolumesTestJSON-286268902 None] Acquiring lock "cinder-quobyte-fa810cef-5ba5-4386-ac1d-be6f555a0f6b" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:57 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-382a5929-e7f9-4654-8e7c-9cf9c4adf956 tempest-VolumesTestJSON-286268902 None] Lock "cinder-quobyte-fa810cef-5ba5-4386-ac1d-be6f555a0f6b" acquired by "delete_volume" :: waited 0.037s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:57 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c98a8c-96ef-431e-a2e9-9b552261909e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-382a5929-e7f9-4654-8e7c-9cf9c4adf956 tempest-VolumesTestJSON-286268902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fa810cef-5ba5-4386-ac1d-be6f555a0f6b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:57 devstack sudo[101591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fa810cef-5ba5-4386-ac1d-be6f555a0f6b Sep 28 17:22:57 devstack sudo[101591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:57 devstack sudo[101591]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-382a5929-e7f9-4654-8e7c-9cf9c4adf956 tempest-VolumesTestJSON-286268902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fa810cef-5ba5-4386-ac1d-be6f555a0f6b" returned: 0 in 0.536s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-382a5929-e7f9-4654-8e7c-9cf9c4adf956 tempest-VolumesTestJSON-286268902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fa810cef-5ba5-4386-ac1d-be6f555a0f6b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:57 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fa810cef-5ba5-4386-ac1d-be6f555a0f6b Sep 28 17:22:57 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:58 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-382a5929-e7f9-4654-8e7c-9cf9c4adf956 tempest-VolumesTestJSON-286268902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fa810cef-5ba5-4386-ac1d-be6f555a0f6b" returned: 0 in 0.349s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:58 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-382a5929-e7f9-4654-8e7c-9cf9c4adf956 tempest-VolumesTestJSON-286268902 None] Lock "cinder-quobyte-fa810cef-5ba5-4386-ac1d-be6f555a0f6b" released by "delete_volume" :: held 0.964s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:58 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-382a5929-e7f9-4654-8e7c-9cf9c4adf956 tempest-VolumesTestJSON-286268902 None] Created reservations ['c9e2b66c-d34d-405a-81c9-07259fdc3fbb', '041e1fa8-afbb-4f66-8683-d99e7d7f4681', '7351b7d3-0fab-4fb0-aee1-f4c0b14bf9d6', '28c87dd3-cd30-4f8e-b0c6-ff8f6b49e730'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-382a5929-e7f9-4654-8e7c-9cf9c4adf956 tempest-VolumesTestJSON-286268902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-382a5929-e7f9-4654-8e7c-9cf9c4adf956 tempest-VolumesTestJSON-286268902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:58 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-382a5929-e7f9-4654-8e7c-9cf9c4adf956 tempest-VolumesTestJSON-286268902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:58 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-382a5929-e7f9-4654-8e7c-9cf9c4adf956 tempest-VolumesTestJSON-286268902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-382a5929-e7f9-4654-8e7c-9cf9c4adf956 tempest-VolumesTestJSON-286268902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-382a5929-e7f9-4654-8e7c-9cf9c4adf956 tempest-VolumesTestJSON-286268902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:58 devstack sudo[101602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:22:58 devstack sudo[101602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:58 devstack sudo[101602]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-382a5929-e7f9-4654-8e7c-9cf9c4adf956 tempest-VolumesTestJSON-286268902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.334s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:58 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-382a5929-e7f9-4654-8e7c-9cf9c4adf956 tempest-VolumesTestJSON-286268902 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:58 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-382a5929-e7f9-4654-8e7c-9cf9c4adf956 tempest-VolumesTestJSON-286268902 None] Deleted volume successfully. Sep 28 17:22:58 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-382a5929-e7f9-4654-8e7c-9cf9c4adf956 tempest-VolumesTestJSON-286268902 None] Lock "cinder-fa810cef-5ba5-4386-ac1d-be6f555a0f6b-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:59 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ae96d6ee-385b-4e6a-a66a-14d011d0cb3d tempest-VolumesTestJSON-286268902 None] Acquiring lock "cinder-377e44d2-82dc-451e-a744-fec43b702d44-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:59 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ae96d6ee-385b-4e6a-a66a-14d011d0cb3d tempest-VolumesTestJSON-286268902 None] Lock "cinder-377e44d2-82dc-451e-a744-fec43b702d44-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:59 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ae96d6ee-385b-4e6a-a66a-14d011d0cb3d tempest-VolumesTestJSON-286268902 None] Acquiring lock "cinder-quobyte-377e44d2-82dc-451e-a744-fec43b702d44" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:59 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ae96d6ee-385b-4e6a-a66a-14d011d0cb3d tempest-VolumesTestJSON-286268902 None] Lock "cinder-quobyte-377e44d2-82dc-451e-a744-fec43b702d44" acquired by "delete_volume" :: waited 0.033s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:59 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[708ea537-ee3a-40c7-891b-3e06f1a50baa]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ae96d6ee-385b-4e6a-a66a-14d011d0cb3d tempest-VolumesTestJSON-286268902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-377e44d2-82dc-451e-a744-fec43b702d44 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:00 devstack sudo[101605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-377e44d2-82dc-451e-a744-fec43b702d44 Sep 28 17:23:00 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:00 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ae96d6ee-385b-4e6a-a66a-14d011d0cb3d tempest-VolumesTestJSON-286268902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-377e44d2-82dc-451e-a744-fec43b702d44" returned: 0 in 0.627s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ae96d6ee-385b-4e6a-a66a-14d011d0cb3d tempest-VolumesTestJSON-286268902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-377e44d2-82dc-451e-a744-fec43b702d44 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:00 devstack sudo[101621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-377e44d2-82dc-451e-a744-fec43b702d44 Sep 28 17:23:00 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:00 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ae96d6ee-385b-4e6a-a66a-14d011d0cb3d tempest-VolumesTestJSON-286268902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-377e44d2-82dc-451e-a744-fec43b702d44" returned: 0 in 0.425s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:01 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ae96d6ee-385b-4e6a-a66a-14d011d0cb3d tempest-VolumesTestJSON-286268902 None] Lock "cinder-quobyte-377e44d2-82dc-451e-a744-fec43b702d44" released by "delete_volume" :: held 1.130s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:01 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-ae96d6ee-385b-4e6a-a66a-14d011d0cb3d tempest-VolumesTestJSON-286268902 None] Created reservations ['17cde6b5-4744-4eeb-8fb9-ca460c2ff242', 'a5d8a2db-1059-4801-9a2a-1554eba18cc2', 'a4848562-ee0a-4074-b84c-cffcc466a994', '74cf7215-00ac-400f-ad17-7e40e7e6dda5'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ae96d6ee-385b-4e6a-a66a-14d011d0cb3d tempest-VolumesTestJSON-286268902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ae96d6ee-385b-4e6a-a66a-14d011d0cb3d tempest-VolumesTestJSON-286268902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:01 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ae96d6ee-385b-4e6a-a66a-14d011d0cb3d tempest-VolumesTestJSON-286268902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:01 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ae96d6ee-385b-4e6a-a66a-14d011d0cb3d tempest-VolumesTestJSON-286268902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ae96d6ee-385b-4e6a-a66a-14d011d0cb3d tempest-VolumesTestJSON-286268902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ae96d6ee-385b-4e6a-a66a-14d011d0cb3d tempest-VolumesTestJSON-286268902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:01 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:23:01 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:01 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ae96d6ee-385b-4e6a-a66a-14d011d0cb3d tempest-VolumesTestJSON-286268902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.373s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:01 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-ae96d6ee-385b-4e6a-a66a-14d011d0cb3d tempest-VolumesTestJSON-286268902 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:01 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-ae96d6ee-385b-4e6a-a66a-14d011d0cb3d tempest-VolumesTestJSON-286268902 None] Deleted volume successfully. Sep 28 17:23:01 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ae96d6ee-385b-4e6a-a66a-14d011d0cb3d tempest-VolumesTestJSON-286268902 None] Lock "cinder-377e44d2-82dc-451e-a744-fec43b702d44-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:10 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-20ae312e-515d-4041-b25d-a15a3f6d5f04 tempest-GroupSnapshotsTest-671637742 None] Group tempest-GroupSnapshotsTest-Group-534319458: creating Sep 28 17:23:10 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-20ae312e-515d-4041-b25d-a15a3f6d5f04 tempest-GroupSnapshotsTest-671637742 None] Group tempest-GroupSnapshotsTest-Group-534319458: created successfully Sep 28 17:23:10 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-20ae312e-515d-4041-b25d-a15a3f6d5f04 tempest-GroupSnapshotsTest-671637742 None] Create group completed successfully. Sep 28 17:23:12 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8cc27f9-d2f5-45ee-b6dd-73a9927f5050 tempest-GroupSnapshotsTest-671637742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a8cc27f9-d2f5-45ee-b6dd-73a9927f5050 tempest-GroupSnapshotsTest-671637742 None] Flow 'volume_create_manager' (5e29c29c-ee25-4edf-afa6-2cf4e319b1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a8cc27f9-d2f5-45ee-b6dd-73a9927f5050 tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5faa2c1d-8b4c-4d18-a4cf-fd2f85eb11d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a8cc27f9-d2f5-45ee-b6dd-73a9927f5050 tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5faa2c1d-8b4c-4d18-a4cf-fd2f85eb11d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1820168896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=12b535e7-7be0-4f08-8cad-12991b672d11,host='devstack@QuobyteHD#QuobyteHD',id=48065788-92e9-4253-852d-f5ca6b82004e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ba7cf50f4184c46851f2a0510f15455',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:12Z,use_quota=True,user_id='bb7762a6fc5747639e5b15739f8009aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4efc5b27-d62e-41a6-868b-7dd89a1ca48e),volume_type_id=4efc5b27-d62e-41a6-868b-7dd89a1ca48e)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a8cc27f9-d2f5-45ee-b6dd-73a9927f5050 tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbff9973-8a5d-44a1-bd99-039107a8a0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a8cc27f9-d2f5-45ee-b6dd-73a9927f5050 tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbff9973-8a5d-44a1-bd99-039107a8a0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a8cc27f9-d2f5-45ee-b6dd-73a9927f5050 tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84254e87-2752-40e4-bcfa-cc065ef86e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a8cc27f9-d2f5-45ee-b6dd-73a9927f5050 tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84254e87-2752-40e4-bcfa-cc065ef86e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48065788-92e9-4253-852d-f5ca6b82004e', 'volume_name': 'volume-48065788-92e9-4253-852d-f5ca6b82004e', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a8cc27f9-d2f5-45ee-b6dd-73a9927f5050 tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e6b229-9f6e-463c-826a-d999a4ebda8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a8cc27f9-d2f5-45ee-b6dd-73a9927f5050 tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e6b229-9f6e-463c-826a-d999a4ebda8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a8cc27f9-d2f5-45ee-b6dd-73a9927f5050 tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc9f80c-cf88-4ed0-b46e-5a85b0cc3915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:12 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-a8cc27f9-d2f5-45ee-b6dd-73a9927f5050 tempest-GroupSnapshotsTest-671637742 None] Volume 48065788-92e9-4253-852d-f5ca6b82004e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48065788-92e9-4253-852d-f5ca6b82004e', 'volume_size': 1} Sep 28 17:23:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a8cc27f9-d2f5-45ee-b6dd-73a9927f5050 tempest-GroupSnapshotsTest-671637742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a8cc27f9-d2f5-45ee-b6dd-73a9927f5050 tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:12 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a8cc27f9-d2f5-45ee-b6dd-73a9927f5050 tempest-GroupSnapshotsTest-671637742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=12b535e7-7be0-4f08-8cad-12991b672d11,created_at=2026-09-28T15:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1820168896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=12b535e7-7be0-4f08-8cad-12991b672d11,host='devstack@QuobyteHD#QuobyteHD',id=48065788-92e9-4253-852d-f5ca6b82004e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ba7cf50f4184c46851f2a0510f15455',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:12Z,use_quota=True,user_id='bb7762a6fc5747639e5b15739f8009aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4efc5b27-d62e-41a6-868b-7dd89a1ca48e),volume_type_id=4efc5b27-d62e-41a6-868b-7dd89a1ca48e)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:12 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-a8cc27f9-d2f5-45ee-b6dd-73a9927f5050 tempest-GroupSnapshotsTest-671637742 None] Creating volume 48065788-92e9-4253-852d-f5ca6b82004e {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a8cc27f9-d2f5-45ee-b6dd-73a9927f5050 tempest-GroupSnapshotsTest-671637742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a8cc27f9-d2f5-45ee-b6dd-73a9927f5050 tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:12 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a8cc27f9-d2f5-45ee-b6dd-73a9927f5050 tempest-GroupSnapshotsTest-671637742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:12 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a8cc27f9-d2f5-45ee-b6dd-73a9927f5050 tempest-GroupSnapshotsTest-671637742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a8cc27f9-d2f5-45ee-b6dd-73a9927f5050 tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:12 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a8cc27f9-d2f5-45ee-b6dd-73a9927f5050 tempest-GroupSnapshotsTest-671637742 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:12 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-a8cc27f9-d2f5-45ee-b6dd-73a9927f5050 tempest-GroupSnapshotsTest-671637742 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:23:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a8cc27f9-d2f5-45ee-b6dd-73a9927f5050 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:12 devstack sudo[101720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e 1073741824 Sep 28 17:23:12 devstack sudo[101720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:13 devstack sudo[101720]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a8cc27f9-d2f5-45ee-b6dd-73a9927f5050 tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e 1073741824" returned: 0 in 0.904s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a8cc27f9-d2f5-45ee-b6dd-73a9927f5050 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:13 devstack sudo[101734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e Sep 28 17:23:13 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:14 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a8cc27f9-d2f5-45ee-b6dd-73a9927f5050 tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e" returned: 0 in 0.564s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:14 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a8cc27f9-d2f5-45ee-b6dd-73a9927f5050 tempest-GroupSnapshotsTest-671637742 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a8cc27f9-d2f5-45ee-b6dd-73a9927f5050 tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a8cc27f9-d2f5-45ee-b6dd-73a9927f5050 tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc9f80c-cf88-4ed0-b46e-5a85b0cc3915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48065788-92e9-4253-852d-f5ca6b82004e', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a8cc27f9-d2f5-45ee-b6dd-73a9927f5050 tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef08b462-8ada-41ab-85b1-10699f16ef42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:14 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-a8cc27f9-d2f5-45ee-b6dd-73a9927f5050 tempest-GroupSnapshotsTest-671637742 None] Volume volume-48065788-92e9-4253-852d-f5ca6b82004e (48065788-92e9-4253-852d-f5ca6b82004e): created successfully Sep 28 17:23:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a8cc27f9-d2f5-45ee-b6dd-73a9927f5050 tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef08b462-8ada-41ab-85b1-10699f16ef42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a8cc27f9-d2f5-45ee-b6dd-73a9927f5050 tempest-GroupSnapshotsTest-671637742 None] Flow 'volume_create_manager' (5e29c29c-ee25-4edf-afa6-2cf4e319b1a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:14 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-a8cc27f9-d2f5-45ee-b6dd-73a9927f5050 tempest-GroupSnapshotsTest-671637742 None] Created volume successfully. Sep 28 17:23:15 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-18cc5331-c81b-4570-8049-8801363a253b tempest-GroupSnapshotsTest-671637742 None] GroupSnapshot 68a66332-1f17-4c46-b349-4457d237a432: creating. Sep 28 17:23:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-18cc5331-c81b-4570-8049-8801363a253b tempest-GroupSnapshotsTest-671637742 None] Group snapshot 68a66332-1f17-4c46-b349-4457d237a432: creating. {{(pid=86917) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 17:23:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-18cc5331-c81b-4570-8049-8801363a253b tempest-GroupSnapshotsTest-671637742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-18cc5331-c81b-4570-8049-8801363a253b tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:15 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-18cc5331-c81b-4570-8049-8801363a253b tempest-GroupSnapshotsTest-671637742 None] Creating offline snapshot b77f8e10-63b0-4556-b668-287d180fb086 of volume 48065788-92e9-4253-852d-f5ca6b82004e {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:23:15 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e6e469-57e6-45ee-bcfa-ab1e03d7f8a1]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-18cc5331-c81b-4570-8049-8801363a253b tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:15 devstack sudo[101739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e Sep 28 17:23:15 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:16 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-18cc5331-c81b-4570-8049-8801363a253b tempest-GroupSnapshotsTest-671637742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e" returned: 0 in 0.536s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-18cc5331-c81b-4570-8049-8801363a253b tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e.b77f8e10-63b0-4556-b668-287d180fb086 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:16 devstack sudo[101745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e.b77f8e10-63b0-4556-b668-287d180fb086 1G Sep 28 17:23:16 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:17 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-18cc5331-c81b-4570-8049-8801363a253b tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e.b77f8e10-63b0-4556-b668-287d180fb086 1G" returned: 0 in 0.631s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-18cc5331-c81b-4570-8049-8801363a253b tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48065788-92e9-4253-852d-f5ca6b82004e -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e.b77f8e10-63b0-4556-b668-287d180fb086 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:17 devstack sudo[101751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48065788-92e9-4253-852d-f5ca6b82004e -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e.b77f8e10-63b0-4556-b668-287d180fb086 Sep 28 17:23:17 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:17 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-18cc5331-c81b-4570-8049-8801363a253b tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48065788-92e9-4253-852d-f5ca6b82004e -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e.b77f8e10-63b0-4556-b668-287d180fb086" returned: 0 in 0.458s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:17 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-18cc5331-c81b-4570-8049-8801363a253b tempest-GroupSnapshotsTest-671637742 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e.b77f8e10-63b0-4556-b668-287d180fb086 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:23:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-18cc5331-c81b-4570-8049-8801363a253b tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e.b77f8e10-63b0-4556-b668-287d180fb086 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:17 devstack sudo[101756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e.b77f8e10-63b0-4556-b668-287d180fb086 Sep 28 17:23:17 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:17 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-830cf12c-b006-46d6-9301-80a6bece7c7a tempest-ProjectReaderTests-714037572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-830cf12c-b006-46d6-9301-80a6bece7c7a tempest-ProjectReaderTests-714037572 None] Flow 'volume_create_manager' (9ac4b2d9-76d5-4da0-9ab6-8c25be26bb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-830cf12c-b006-46d6-9301-80a6bece7c7a tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21182a6e-04a0-4cfe-aefd-03232e46af25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-830cf12c-b006-46d6-9301-80a6bece7c7a tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21182a6e-04a0-4cfe-aefd-03232e46af25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-19705217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38329c96-39d8-46e1-8f0b-3ba438dc9c8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4728f9cf415d4560a4a6c63fd1b417a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:18Z,use_quota=True,user_id='f53150d404b5416dace1839f7e476bbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-830cf12c-b006-46d6-9301-80a6bece7c7a tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a744812b-ec59-496f-a2db-badfc4ff61eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-830cf12c-b006-46d6-9301-80a6bece7c7a tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a744812b-ec59-496f-a2db-badfc4ff61eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-830cf12c-b006-46d6-9301-80a6bece7c7a tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (415a1628-0f6d-4043-9858-10daa1b18c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-830cf12c-b006-46d6-9301-80a6bece7c7a tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (415a1628-0f6d-4043-9858-10daa1b18c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38329c96-39d8-46e1-8f0b-3ba438dc9c8e', 'volume_name': 'volume-38329c96-39d8-46e1-8f0b-3ba438dc9c8e', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-830cf12c-b006-46d6-9301-80a6bece7c7a tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bda9fd5a-6225-4d61-80f8-f6e15c08aeea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-830cf12c-b006-46d6-9301-80a6bece7c7a tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bda9fd5a-6225-4d61-80f8-f6e15c08aeea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-830cf12c-b006-46d6-9301-80a6bece7c7a tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6bbf05-6405-4807-98aa-f0b65a09e1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:17 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-830cf12c-b006-46d6-9301-80a6bece7c7a tempest-ProjectReaderTests-714037572 None] Volume 38329c96-39d8-46e1-8f0b-3ba438dc9c8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38329c96-39d8-46e1-8f0b-3ba438dc9c8e', 'volume_size': 1} Sep 28 17:23:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-830cf12c-b006-46d6-9301-80a6bece7c7a tempest-ProjectReaderTests-714037572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:17 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-18cc5331-c81b-4570-8049-8801363a253b tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e.b77f8e10-63b0-4556-b668-287d180fb086" returned: 0 in 0.339s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-18cc5331-c81b-4570-8049-8801363a253b tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:17 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e.info Sep 28 17:23:17 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:18 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-18cc5331-c81b-4570-8049-8801363a253b tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e.info" returned: 0 in 0.274s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:18 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-18cc5331-c81b-4570-8049-8801363a253b tempest-GroupSnapshotsTest-671637742 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:23:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-18cc5331-c81b-4570-8049-8801363a253b tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:18 devstack sudo[101762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e.info Sep 28 17:23:18 devstack sudo[101762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:18 devstack sudo[101762]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-18cc5331-c81b-4570-8049-8801363a253b tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e.info" returned: 0 in 0.258s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-18cc5331-c81b-4570-8049-8801363a253b tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.616s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-830cf12c-b006-46d6-9301-80a6bece7c7a tempest-ProjectReaderTests-714037572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.701s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-830cf12c-b006-46d6-9301-80a6bece7c7a tempest-ProjectReaderTests-714037572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-19705217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38329c96-39d8-46e1-8f0b-3ba438dc9c8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4728f9cf415d4560a4a6c63fd1b417a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:18Z,use_quota=True,user_id='f53150d404b5416dace1839f7e476bbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-830cf12c-b006-46d6-9301-80a6bece7c7a tempest-ProjectReaderTests-714037572 None] Creating volume 38329c96-39d8-46e1-8f0b-3ba438dc9c8e {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-830cf12c-b006-46d6-9301-80a6bece7c7a tempest-ProjectReaderTests-714037572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-830cf12c-b006-46d6-9301-80a6bece7c7a tempest-ProjectReaderTests-714037572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-830cf12c-b006-46d6-9301-80a6bece7c7a tempest-ProjectReaderTests-714037572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-830cf12c-b006-46d6-9301-80a6bece7c7a tempest-ProjectReaderTests-714037572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-830cf12c-b006-46d6-9301-80a6bece7c7a tempest-ProjectReaderTests-714037572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-830cf12c-b006-46d6-9301-80a6bece7c7a tempest-ProjectReaderTests-714037572 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:18 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-830cf12c-b006-46d6-9301-80a6bece7c7a tempest-ProjectReaderTests-714037572 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:23:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-830cf12c-b006-46d6-9301-80a6bece7c7a tempest-ProjectReaderTests-714037572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-38329c96-39d8-46e1-8f0b-3ba438dc9c8e 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:18 devstack sudo[101771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-38329c96-39d8-46e1-8f0b-3ba438dc9c8e 1073741824 Sep 28 17:23:18 devstack sudo[101771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:18 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-18cc5331-c81b-4570-8049-8801363a253b tempest-GroupSnapshotsTest-671637742 None] group_snapshot 68a66332-1f17-4c46-b349-4457d237a432: created successfully Sep 28 17:23:18 devstack sudo[101771]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-830cf12c-b006-46d6-9301-80a6bece7c7a tempest-ProjectReaderTests-714037572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-38329c96-39d8-46e1-8f0b-3ba438dc9c8e 1073741824" returned: 0 in 0.464s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-830cf12c-b006-46d6-9301-80a6bece7c7a tempest-ProjectReaderTests-714037572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-38329c96-39d8-46e1-8f0b-3ba438dc9c8e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:18 devstack sudo[101777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-38329c96-39d8-46e1-8f0b-3ba438dc9c8e Sep 28 17:23:18 devstack sudo[101777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:19 devstack sudo[101777]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-830cf12c-b006-46d6-9301-80a6bece7c7a tempest-ProjectReaderTests-714037572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-38329c96-39d8-46e1-8f0b-3ba438dc9c8e" returned: 0 in 0.376s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-830cf12c-b006-46d6-9301-80a6bece7c7a tempest-ProjectReaderTests-714037572 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-830cf12c-b006-46d6-9301-80a6bece7c7a tempest-ProjectReaderTests-714037572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-830cf12c-b006-46d6-9301-80a6bece7c7a tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6bbf05-6405-4807-98aa-f0b65a09e1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38329c96-39d8-46e1-8f0b-3ba438dc9c8e', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-830cf12c-b006-46d6-9301-80a6bece7c7a tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45847536-d4f0-4dc4-9c18-d567b54e153b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:19 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-830cf12c-b006-46d6-9301-80a6bece7c7a tempest-ProjectReaderTests-714037572 None] Volume volume-38329c96-39d8-46e1-8f0b-3ba438dc9c8e (38329c96-39d8-46e1-8f0b-3ba438dc9c8e): created successfully Sep 28 17:23:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-830cf12c-b006-46d6-9301-80a6bece7c7a tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45847536-d4f0-4dc4-9c18-d567b54e153b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-830cf12c-b006-46d6-9301-80a6bece7c7a tempest-ProjectReaderTests-714037572 None] Flow 'volume_create_manager' (9ac4b2d9-76d5-4da0-9ab6-8c25be26bb57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:19 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-830cf12c-b006-46d6-9301-80a6bece7c7a tempest-ProjectReaderTests-714037572 None] Created volume successfully. Sep 28 17:23:19 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-601165c0-3641-4a40-a452-3a03fef800b7 tempest-ProjectReaderTests-714037572 None] Acquiring lock "cinder-38329c96-39d8-46e1-8f0b-3ba438dc9c8e-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:19 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] Acquiring lock "cinder-quobyte-b77f8e10-63b0-4556-b668-287d180fb086-3cdc481e-0556-4391-9bb8-a8eaf23b39e3" by "_create_volume_from_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:19 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-601165c0-3641-4a40-a452-3a03fef800b7 tempest-ProjectReaderTests-714037572 None] Lock "cinder-38329c96-39d8-46e1-8f0b-3ba438dc9c8e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:20 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] Lock "cinder-quobyte-b77f8e10-63b0-4556-b668-287d180fb086-3cdc481e-0556-4391-9bb8-a8eaf23b39e3" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] Creating volume 3cdc481e-0556-4391-9bb8-a8eaf23b39e3 from snapshot b77f8e10-63b0-4556-b668-287d180fb086 {{(pid=86917) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:23:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:20 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] Acquiring lock "cinder-quobyte-3cdc481e-0556-4391-9bb8-a8eaf23b39e3" by "_copy_volume_from_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:20 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] Lock "cinder-quobyte-3cdc481e-0556-4391-9bb8-a8eaf23b39e3" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] snapshot: b77f8e10-63b0-4556-b668-287d180fb086, volume: 3cdc481e-0556-4391-9bb8-a8eaf23b39e3, {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:23:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:20 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-601165c0-3641-4a40-a452-3a03fef800b7 tempest-ProjectReaderTests-714037572 None] Acquiring lock "cinder-quobyte-38329c96-39d8-46e1-8f0b-3ba438dc9c8e" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:20 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[871514fe-572e-4393-bdef-d47f75c0ec20]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e.b77f8e10-63b0-4556-b668-287d180fb086 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:20 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-601165c0-3641-4a40-a452-3a03fef800b7 tempest-ProjectReaderTests-714037572 None] Lock "cinder-quobyte-38329c96-39d8-46e1-8f0b-3ba438dc9c8e" acquired by "delete_volume" :: waited 0.040s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:20 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b6180c-37e2-4cf9-b909-9e571e99bd1b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-601165c0-3641-4a40-a452-3a03fef800b7 tempest-ProjectReaderTests-714037572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-38329c96-39d8-46e1-8f0b-3ba438dc9c8e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:20 devstack sudo[101780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e.b77f8e10-63b0-4556-b668-287d180fb086 Sep 28 17:23:20 devstack sudo[101780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:20 devstack sudo[101781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-38329c96-39d8-46e1-8f0b-3ba438dc9c8e Sep 28 17:23:20 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:20 devstack sudo[101780]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e.b77f8e10-63b0-4556-b668-287d180fb086" returned: 0 in 0.565s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48065788-92e9-4253-852d-f5ca6b82004e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:23:20 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-601165c0-3641-4a40-a452-3a03fef800b7 tempest-ProjectReaderTests-714037572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-38329c96-39d8-46e1-8f0b-3ba438dc9c8e" returned: 0 in 0.490s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-601165c0-3641-4a40-a452-3a03fef800b7 tempest-ProjectReaderTests-714037572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-38329c96-39d8-46e1-8f0b-3ba438dc9c8e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:20 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa4e844-544f-4eb6-9261-416f30c9ec8a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:20 devstack sudo[101790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-38329c96-39d8-46e1-8f0b-3ba438dc9c8e Sep 28 17:23:20 devstack sudo[101790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:20 devstack sudo[101791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e Sep 28 17:23:20 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:21 devstack sudo[101790]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-601165c0-3641-4a40-a452-3a03fef800b7 tempest-ProjectReaderTests-714037572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-38329c96-39d8-46e1-8f0b-3ba438dc9c8e" returned: 0 in 0.301s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:21 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-601165c0-3641-4a40-a452-3a03fef800b7 tempest-ProjectReaderTests-714037572 None] Lock "cinder-quobyte-38329c96-39d8-46e1-8f0b-3ba438dc9c8e" released by "delete_volume" :: held 0.877s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:21 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-601165c0-3641-4a40-a452-3a03fef800b7 tempest-ProjectReaderTests-714037572 None] Created reservations ['aabfaeb5-e606-48b4-b409-74ff63cae302', '46351640-28f9-4b28-969c-d936fd573b83', 'd55ad321-40cb-4418-a1ec-70c09873a0e1', '8de223d6-fa7b-4662-8d5f-acc15d93be03'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:21 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e" returned: 0 in 0.493s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:21 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:23:21 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] Creating direct copy from snapshot {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:23:21 devstack cinder-volume[86917]: DEBUG cinder.utils [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] Path /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3cdc481e-0556-4391-9bb8-a8eaf23b39e3 not found in is_blk_device check {{(pid=86917) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:23:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3cdc481e-0556-4391-9bb8-a8eaf23b39e3 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-601165c0-3641-4a40-a452-3a03fef800b7 tempest-ProjectReaderTests-714037572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-601165c0-3641-4a40-a452-3a03fef800b7 tempest-ProjectReaderTests-714037572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:21 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-601165c0-3641-4a40-a452-3a03fef800b7 tempest-ProjectReaderTests-714037572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:21 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-601165c0-3641-4a40-a452-3a03fef800b7 tempest-ProjectReaderTests-714037572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-601165c0-3641-4a40-a452-3a03fef800b7 tempest-ProjectReaderTests-714037572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-601165c0-3641-4a40-a452-3a03fef800b7 tempest-ProjectReaderTests-714037572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:21 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3cdc481e-0556-4391-9bb8-a8eaf23b39e3 Sep 28 17:23:21 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:21 devstack sudo[101801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:23:21 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:21 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-601165c0-3641-4a40-a452-3a03fef800b7 tempest-ProjectReaderTests-714037572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.549s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:21 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-601165c0-3641-4a40-a452-3a03fef800b7 tempest-ProjectReaderTests-714037572 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:21 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-601165c0-3641-4a40-a452-3a03fef800b7 tempest-ProjectReaderTests-714037572 None] Deleted volume successfully. Sep 28 17:23:21 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-601165c0-3641-4a40-a452-3a03fef800b7 tempest-ProjectReaderTests-714037572 None] Lock "cinder-38329c96-39d8-46e1-8f0b-3ba438dc9c8e-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:23 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dca5dc3-57d8-4b23-862e-12347294dbdf tempest-ProjectReaderTests-714037572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5dca5dc3-57d8-4b23-862e-12347294dbdf tempest-ProjectReaderTests-714037572 None] Flow 'volume_create_manager' (2e0d5225-9d7c-41f7-a239-ff84ed1a14ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5dca5dc3-57d8-4b23-862e-12347294dbdf tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26ea8f10-c094-4ded-8a22-4f33003901c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5dca5dc3-57d8-4b23-862e-12347294dbdf tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26ea8f10-c094-4ded-8a22-4f33003901c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1591687209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9a1610c-4f5e-4927-b18b-e3d5783b6719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4728f9cf415d4560a4a6c63fd1b417a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:24Z,use_quota=True,user_id='f53150d404b5416dace1839f7e476bbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5dca5dc3-57d8-4b23-862e-12347294dbdf tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c8832a7-0088-415d-ae07-cdac19c32b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5dca5dc3-57d8-4b23-862e-12347294dbdf tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c8832a7-0088-415d-ae07-cdac19c32b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5dca5dc3-57d8-4b23-862e-12347294dbdf tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01da0ab7-a659-4560-995e-bcdd42f943ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5dca5dc3-57d8-4b23-862e-12347294dbdf tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01da0ab7-a659-4560-995e-bcdd42f943ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9a1610c-4f5e-4927-b18b-e3d5783b6719', 'volume_name': 'volume-e9a1610c-4f5e-4927-b18b-e3d5783b6719', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5dca5dc3-57d8-4b23-862e-12347294dbdf tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddf9db12-d85b-4c03-b0ee-7ce108257c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5dca5dc3-57d8-4b23-862e-12347294dbdf tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddf9db12-d85b-4c03-b0ee-7ce108257c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5dca5dc3-57d8-4b23-862e-12347294dbdf tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f787c381-7d05-470d-bd86-f129a1734940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:23 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-5dca5dc3-57d8-4b23-862e-12347294dbdf tempest-ProjectReaderTests-714037572 None] Volume e9a1610c-4f5e-4927-b18b-e3d5783b6719: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9a1610c-4f5e-4927-b18b-e3d5783b6719', 'volume_size': 1} Sep 28 17:23:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5dca5dc3-57d8-4b23-862e-12347294dbdf tempest-ProjectReaderTests-714037572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:28 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3cdc481e-0556-4391-9bb8-a8eaf23b39e3" returned: 0 in 7.400s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:28 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] Image conversion details: src /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e, size 1024.00 MB, duration 7.40 sec, destination /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3cdc481e-0556-4391-9bb8-a8eaf23b39e3 {{(pid=86917) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:23:28 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] Converted 1024.00 MB image at 138.35 MB/s Sep 28 17:23:28 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3cdc481e-0556-4391-9bb8-a8eaf23b39e3 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:23:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3cdc481e-0556-4391-9bb8-a8eaf23b39e3 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:28 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3cdc481e-0556-4391-9bb8-a8eaf23b39e3 Sep 28 17:23:28 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:28 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3cdc481e-0556-4391-9bb8-a8eaf23b39e3" returned: 0 in 0.283s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:28 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] Lock "cinder-quobyte-3cdc481e-0556-4391-9bb8-a8eaf23b39e3" released by "_copy_volume_from_snapshot" :: held 8.877s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:28 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] Lock "cinder-quobyte-b77f8e10-63b0-4556-b668-287d180fb086-3cdc481e-0556-4391-9bb8-a8eaf23b39e3" released by "_create_volume_from_snapshot" :: held 8.973s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.014s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5dca5dc3-57d8-4b23-862e-12347294dbdf tempest-ProjectReaderTests-714037572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.013s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:28 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-5dca5dc3-57d8-4b23-862e-12347294dbdf tempest-ProjectReaderTests-714037572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1591687209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9a1610c-4f5e-4927-b18b-e3d5783b6719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4728f9cf415d4560a4a6c63fd1b417a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:24Z,use_quota=True,user_id='f53150d404b5416dace1839f7e476bbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:28 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-5dca5dc3-57d8-4b23-862e-12347294dbdf tempest-ProjectReaderTests-714037572 None] Creating volume e9a1610c-4f5e-4927-b18b-e3d5783b6719 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5dca5dc3-57d8-4b23-862e-12347294dbdf tempest-ProjectReaderTests-714037572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5dca5dc3-57d8-4b23-862e-12347294dbdf tempest-ProjectReaderTests-714037572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:28 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-5dca5dc3-57d8-4b23-862e-12347294dbdf tempest-ProjectReaderTests-714037572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:28 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-5dca5dc3-57d8-4b23-862e-12347294dbdf tempest-ProjectReaderTests-714037572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5dca5dc3-57d8-4b23-862e-12347294dbdf tempest-ProjectReaderTests-714037572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:28 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-5dca5dc3-57d8-4b23-862e-12347294dbdf tempest-ProjectReaderTests-714037572 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:28 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-5dca5dc3-57d8-4b23-862e-12347294dbdf tempest-ProjectReaderTests-714037572 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:23:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5dca5dc3-57d8-4b23-862e-12347294dbdf tempest-ProjectReaderTests-714037572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9a1610c-4f5e-4927-b18b-e3d5783b6719 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:29 devstack sudo[101878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9a1610c-4f5e-4927-b18b-e3d5783b6719 1073741824 Sep 28 17:23:29 devstack sudo[101878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:29 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-f4565d93-4aed-4226-be7b-be827783a298 tempest-GroupSnapshotsTest-671637742 None] Create group from source-snapshot-68a66332-1f17-4c46-b349-4457d237a432 completed successfully. Sep 28 17:23:29 devstack sudo[101878]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5dca5dc3-57d8-4b23-862e-12347294dbdf tempest-ProjectReaderTests-714037572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9a1610c-4f5e-4927-b18b-e3d5783b6719 1073741824" returned: 0 in 0.495s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5dca5dc3-57d8-4b23-862e-12347294dbdf tempest-ProjectReaderTests-714037572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9a1610c-4f5e-4927-b18b-e3d5783b6719 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:29 devstack sudo[101884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9a1610c-4f5e-4927-b18b-e3d5783b6719 Sep 28 17:23:29 devstack sudo[101884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:29 devstack sudo[101884]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5dca5dc3-57d8-4b23-862e-12347294dbdf tempest-ProjectReaderTests-714037572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9a1610c-4f5e-4927-b18b-e3d5783b6719" returned: 0 in 0.277s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-5dca5dc3-57d8-4b23-862e-12347294dbdf tempest-ProjectReaderTests-714037572 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5dca5dc3-57d8-4b23-862e-12347294dbdf tempest-ProjectReaderTests-714037572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5dca5dc3-57d8-4b23-862e-12347294dbdf tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f787c381-7d05-470d-bd86-f129a1734940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9a1610c-4f5e-4927-b18b-e3d5783b6719', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5dca5dc3-57d8-4b23-862e-12347294dbdf tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fa0a7a3-de1b-41ce-ae69-47e8778b5396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:29 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-5dca5dc3-57d8-4b23-862e-12347294dbdf tempest-ProjectReaderTests-714037572 None] Volume volume-e9a1610c-4f5e-4927-b18b-e3d5783b6719 (e9a1610c-4f5e-4927-b18b-e3d5783b6719): created successfully Sep 28 17:23:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5dca5dc3-57d8-4b23-862e-12347294dbdf tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fa0a7a3-de1b-41ce-ae69-47e8778b5396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5dca5dc3-57d8-4b23-862e-12347294dbdf tempest-ProjectReaderTests-714037572 None] Flow 'volume_create_manager' (2e0d5225-9d7c-41f7-a239-ff84ed1a14ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:29 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-5dca5dc3-57d8-4b23-862e-12347294dbdf tempest-ProjectReaderTests-714037572 None] Created volume successfully. Sep 28 17:23:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-01f8012d-f690-4cb2-9eb2-aa45ba91d7a7 tempest-GroupSnapshotsTest-671637742 None] Acquiring lock "cinder-quobyte-3cdc481e-0556-4391-9bb8-a8eaf23b39e3" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-01f8012d-f690-4cb2-9eb2-aa45ba91d7a7 tempest-GroupSnapshotsTest-671637742 None] Lock "cinder-quobyte-3cdc481e-0556-4391-9bb8-a8eaf23b39e3" acquired by "delete_volume" :: waited 0.025s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:30 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb54fe3-5e13-4454-9b82-a3bdf5f55dd4]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-01f8012d-f690-4cb2-9eb2-aa45ba91d7a7 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3cdc481e-0556-4391-9bb8-a8eaf23b39e3 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:30 devstack sudo[101887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3cdc481e-0556-4391-9bb8-a8eaf23b39e3 Sep 28 17:23:30 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0e1edbbd-8340-4ff8-8994-d6d3e910548d tempest-ProjectReaderTests-714037572 None] Acquiring lock "cinder-e9a1610c-4f5e-4927-b18b-e3d5783b6719-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0e1edbbd-8340-4ff8-8994-d6d3e910548d tempest-ProjectReaderTests-714037572 None] Lock "cinder-e9a1610c-4f5e-4927-b18b-e3d5783b6719-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0e1edbbd-8340-4ff8-8994-d6d3e910548d tempest-ProjectReaderTests-714037572 None] Acquiring lock "cinder-quobyte-e9a1610c-4f5e-4927-b18b-e3d5783b6719" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0e1edbbd-8340-4ff8-8994-d6d3e910548d tempest-ProjectReaderTests-714037572 None] Lock "cinder-quobyte-e9a1610c-4f5e-4927-b18b-e3d5783b6719" acquired by "delete_volume" :: waited 0.022s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:30 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda788fd-4360-4283-939d-c9c3084ed73c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0e1edbbd-8340-4ff8-8994-d6d3e910548d tempest-ProjectReaderTests-714037572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9a1610c-4f5e-4927-b18b-e3d5783b6719 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:30 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-01f8012d-f690-4cb2-9eb2-aa45ba91d7a7 tempest-GroupSnapshotsTest-671637742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3cdc481e-0556-4391-9bb8-a8eaf23b39e3" returned: 0 in 0.463s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-01f8012d-f690-4cb2-9eb2-aa45ba91d7a7 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3cdc481e-0556-4391-9bb8-a8eaf23b39e3 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:30 devstack sudo[101889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9a1610c-4f5e-4927-b18b-e3d5783b6719 Sep 28 17:23:30 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:30 devstack sudo[101894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3cdc481e-0556-4391-9bb8-a8eaf23b39e3 Sep 28 17:23:30 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:30 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-01f8012d-f690-4cb2-9eb2-aa45ba91d7a7 tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3cdc481e-0556-4391-9bb8-a8eaf23b39e3" returned: 0 in 0.283s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-01f8012d-f690-4cb2-9eb2-aa45ba91d7a7 tempest-GroupSnapshotsTest-671637742 None] Lock "cinder-quobyte-3cdc481e-0556-4391-9bb8-a8eaf23b39e3" released by "delete_volume" :: held 0.830s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:31 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0e1edbbd-8340-4ff8-8994-d6d3e910548d tempest-ProjectReaderTests-714037572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9a1610c-4f5e-4927-b18b-e3d5783b6719" returned: 0 in 0.445s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0e1edbbd-8340-4ff8-8994-d6d3e910548d tempest-ProjectReaderTests-714037572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9a1610c-4f5e-4927-b18b-e3d5783b6719 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:31 devstack sudo[101901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9a1610c-4f5e-4927-b18b-e3d5783b6719 Sep 28 17:23:31 devstack sudo[101901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:31 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-01f8012d-f690-4cb2-9eb2-aa45ba91d7a7 tempest-GroupSnapshotsTest-671637742 None] Created reservations ['a2a872d6-5c04-435c-b0d0-6f81374b6526'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:31 devstack cinder-volume[86917]: WARNING cinder.quota [None req-01f8012d-f690-4cb2-9eb2-aa45ba91d7a7 tempest-GroupSnapshotsTest-671637742 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-359569417 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-359569417, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:23:31 devstack cinder-volume[86917]: WARNING cinder.quota [None req-01f8012d-f690-4cb2-9eb2-aa45ba91d7a7 tempest-GroupSnapshotsTest-671637742 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-359569417 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-359569417, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:23:31 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-01f8012d-f690-4cb2-9eb2-aa45ba91d7a7 tempest-GroupSnapshotsTest-671637742 None] Created reservations ['a4c2b8e7-fb68-4249-a0eb-c6ced8f0ca93', '98fdb8dc-5775-4981-9daa-1e2abc989c0e', 'cc123acb-fc32-4eba-96c3-379504bb11bb', '09e6609f-098d-4a32-9b79-b9d902ea67df'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:31 devstack sudo[101901]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0e1edbbd-8340-4ff8-8994-d6d3e910548d tempest-ProjectReaderTests-714037572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9a1610c-4f5e-4927-b18b-e3d5783b6719" returned: 0 in 0.285s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:31 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0e1edbbd-8340-4ff8-8994-d6d3e910548d tempest-ProjectReaderTests-714037572 None] Lock "cinder-quobyte-e9a1610c-4f5e-4927-b18b-e3d5783b6719" released by "delete_volume" :: held 0.802s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-01f8012d-f690-4cb2-9eb2-aa45ba91d7a7 tempest-GroupSnapshotsTest-671637742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-01f8012d-f690-4cb2-9eb2-aa45ba91d7a7 tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-01f8012d-f690-4cb2-9eb2-aa45ba91d7a7 tempest-GroupSnapshotsTest-671637742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-01f8012d-f690-4cb2-9eb2-aa45ba91d7a7 tempest-GroupSnapshotsTest-671637742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-01f8012d-f690-4cb2-9eb2-aa45ba91d7a7 tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-01f8012d-f690-4cb2-9eb2-aa45ba91d7a7 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:31 devstack sudo[101904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:23:31 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-0e1edbbd-8340-4ff8-8994-d6d3e910548d tempest-ProjectReaderTests-714037572 None] Created reservations ['b6287058-8e66-4c71-b23c-32dcf0bca3f8', 'a481a6a2-f373-47a2-a261-9d24f56cceb9', '1e12fb0b-ac6d-45d2-a1af-ba4e47c7a9ea', 'a0e9664b-636d-4534-b257-82318f3195c7'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:31 devstack sudo[101904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:31 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-dfe5e582-0b31-4d35-ac81-b7109a90f2ef tempest-GroupSnapshotsTest-671637742 None] group_snapshot 68a66332-1f17-4c46-b349-4457d237a432: deleting Sep 28 17:23:31 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-dfe5e582-0b31-4d35-ac81-b7109a90f2ef tempest-GroupSnapshotsTest-671637742 None] group_snapshot 68a66332-1f17-4c46-b349-4457d237a432: deleting {{(pid=86917) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 17:23:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0e1edbbd-8340-4ff8-8994-d6d3e910548d tempest-ProjectReaderTests-714037572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0e1edbbd-8340-4ff8-8994-d6d3e910548d tempest-ProjectReaderTests-714037572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0e1edbbd-8340-4ff8-8994-d6d3e910548d tempest-ProjectReaderTests-714037572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0e1edbbd-8340-4ff8-8994-d6d3e910548d tempest-ProjectReaderTests-714037572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0e1edbbd-8340-4ff8-8994-d6d3e910548d tempest-ProjectReaderTests-714037572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0e1edbbd-8340-4ff8-8994-d6d3e910548d tempest-ProjectReaderTests-714037572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:31 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-dfe5e582-0b31-4d35-ac81-b7109a90f2ef tempest-GroupSnapshotsTest-671637742 None] Acquiring lock "cinder-quobyte-48065788-92e9-4253-852d-f5ca6b82004e" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:31 devstack sudo[101906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:23:31 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:31 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-dfe5e582-0b31-4d35-ac81-b7109a90f2ef tempest-GroupSnapshotsTest-671637742 None] Lock "cinder-quobyte-48065788-92e9-4253-852d-f5ca6b82004e" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:31 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-dfe5e582-0b31-4d35-ac81-b7109a90f2ef tempest-GroupSnapshotsTest-671637742 None] Acquiring lock "cinder-quobyte-b77f8e10-63b0-4556-b668-287d180fb086" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:31 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-dfe5e582-0b31-4d35-ac81-b7109a90f2ef tempest-GroupSnapshotsTest-671637742 None] Lock "cinder-quobyte-b77f8e10-63b0-4556-b668-287d180fb086" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-dfe5e582-0b31-4d35-ac81-b7109a90f2ef tempest-GroupSnapshotsTest-671637742 None] Deleting offline snapshot b77f8e10-63b0-4556-b668-287d180fb086 of volume 48065788-92e9-4253-852d-f5ca6b82004e {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:23:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-dfe5e582-0b31-4d35-ac81-b7109a90f2ef tempest-GroupSnapshotsTest-671637742 None] snapshot_file for this snap is: volume-48065788-92e9-4253-852d-f5ca6b82004e.b77f8e10-63b0-4556-b668-287d180fb086 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:23:31 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d054267d-ea97-40de-b765-beef88f012e7]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-dfe5e582-0b31-4d35-ac81-b7109a90f2ef tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e.b77f8e10-63b0-4556-b668-287d180fb086 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:31 devstack sudo[101904]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-01f8012d-f690-4cb2-9eb2-aa45ba91d7a7 tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.422s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:31 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-01f8012d-f690-4cb2-9eb2-aa45ba91d7a7 tempest-GroupSnapshotsTest-671637742 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:31 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-01f8012d-f690-4cb2-9eb2-aa45ba91d7a7 tempest-GroupSnapshotsTest-671637742 None] Delete group completed successfully. Sep 28 17:23:32 devstack sudo[101909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e.b77f8e10-63b0-4556-b668-287d180fb086 Sep 28 17:23:32 devstack sudo[101909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:32 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0e1edbbd-8340-4ff8-8994-d6d3e910548d tempest-ProjectReaderTests-714037572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.411s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:32 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-0e1edbbd-8340-4ff8-8994-d6d3e910548d tempest-ProjectReaderTests-714037572 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:32 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-0e1edbbd-8340-4ff8-8994-d6d3e910548d tempest-ProjectReaderTests-714037572 None] Deleted volume successfully. Sep 28 17:23:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0e1edbbd-8340-4ff8-8994-d6d3e910548d tempest-ProjectReaderTests-714037572 None] Lock "cinder-e9a1610c-4f5e-4927-b18b-e3d5783b6719-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:32 devstack sudo[101909]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-dfe5e582-0b31-4d35-ac81-b7109a90f2ef tempest-GroupSnapshotsTest-671637742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e.b77f8e10-63b0-4556-b668-287d180fb086" returned: 0 in 0.723s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-dfe5e582-0b31-4d35-ac81-b7109a90f2ef tempest-GroupSnapshotsTest-671637742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48065788-92e9-4253-852d-f5ca6b82004e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:23:32 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[079bb0b2-dada-4e66-8e5c-64f5b3fb2b08]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-dfe5e582-0b31-4d35-ac81-b7109a90f2ef tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:32 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-70b01409-19bf-4258-9160-2681b4e4bde0 tempest-ProjectReaderTests-714037572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-70b01409-19bf-4258-9160-2681b4e4bde0 tempest-ProjectReaderTests-714037572 None] Flow 'volume_create_manager' (b0df9bd2-e891-49ea-ba4b-4e39d1afee7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-70b01409-19bf-4258-9160-2681b4e4bde0 tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06befe5b-9701-4e99-9644-81b4143298d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-70b01409-19bf-4258-9160-2681b4e4bde0 tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06befe5b-9701-4e99-9644-81b4143298d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1337566857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9df582d-7245-4206-988e-855b15150f76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4728f9cf415d4560a4a6c63fd1b417a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:33Z,use_quota=True,user_id='f53150d404b5416dace1839f7e476bbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-70b01409-19bf-4258-9160-2681b4e4bde0 tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bfd6d74-09b8-4082-af26-6d2c8ced22d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-70b01409-19bf-4258-9160-2681b4e4bde0 tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bfd6d74-09b8-4082-af26-6d2c8ced22d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-70b01409-19bf-4258-9160-2681b4e4bde0 tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (187b9811-b271-4f47-9267-005111d837e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-70b01409-19bf-4258-9160-2681b4e4bde0 tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (187b9811-b271-4f47-9267-005111d837e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9df582d-7245-4206-988e-855b15150f76', 'volume_name': 'volume-e9df582d-7245-4206-988e-855b15150f76', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-70b01409-19bf-4258-9160-2681b4e4bde0 tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bafd5c3-61b4-4eff-84ef-8233e188570e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-70b01409-19bf-4258-9160-2681b4e4bde0 tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bafd5c3-61b4-4eff-84ef-8233e188570e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-70b01409-19bf-4258-9160-2681b4e4bde0 tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96413c8d-4a71-49e6-9375-611990ea9aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:32 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-70b01409-19bf-4258-9160-2681b4e4bde0 tempest-ProjectReaderTests-714037572 None] Volume e9df582d-7245-4206-988e-855b15150f76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9df582d-7245-4206-988e-855b15150f76', 'volume_size': 1} Sep 28 17:23:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-70b01409-19bf-4258-9160-2681b4e4bde0 tempest-ProjectReaderTests-714037572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-70b01409-19bf-4258-9160-2681b4e4bde0 tempest-ProjectReaderTests-714037572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-70b01409-19bf-4258-9160-2681b4e4bde0 tempest-ProjectReaderTests-714037572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1337566857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9df582d-7245-4206-988e-855b15150f76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4728f9cf415d4560a4a6c63fd1b417a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:33Z,use_quota=True,user_id='f53150d404b5416dace1839f7e476bbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-70b01409-19bf-4258-9160-2681b4e4bde0 tempest-ProjectReaderTests-714037572 None] Creating volume e9df582d-7245-4206-988e-855b15150f76 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-70b01409-19bf-4258-9160-2681b4e4bde0 tempest-ProjectReaderTests-714037572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-70b01409-19bf-4258-9160-2681b4e4bde0 tempest-ProjectReaderTests-714037572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-70b01409-19bf-4258-9160-2681b4e4bde0 tempest-ProjectReaderTests-714037572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-70b01409-19bf-4258-9160-2681b4e4bde0 tempest-ProjectReaderTests-714037572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-70b01409-19bf-4258-9160-2681b4e4bde0 tempest-ProjectReaderTests-714037572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-70b01409-19bf-4258-9160-2681b4e4bde0 tempest-ProjectReaderTests-714037572 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:32 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-70b01409-19bf-4258-9160-2681b4e4bde0 tempest-ProjectReaderTests-714037572 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:23:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-70b01409-19bf-4258-9160-2681b4e4bde0 tempest-ProjectReaderTests-714037572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9df582d-7245-4206-988e-855b15150f76 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:32 devstack sudo[101917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e Sep 28 17:23:32 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:32 devstack sudo[101918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9df582d-7245-4206-988e-855b15150f76 1073741824 Sep 28 17:23:32 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:33 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-dfe5e582-0b31-4d35-ac81-b7109a90f2ef tempest-GroupSnapshotsTest-671637742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e" returned: 0 in 0.664s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-dfe5e582-0b31-4d35-ac81-b7109a90f2ef tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e.b77f8e10-63b0-4556-b668-287d180fb086 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:33 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-70b01409-19bf-4258-9160-2681b4e4bde0 tempest-ProjectReaderTests-714037572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9df582d-7245-4206-988e-855b15150f76 1073741824" returned: 0 in 0.557s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:33 devstack sudo[101931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e.b77f8e10-63b0-4556-b668-287d180fb086 Sep 28 17:23:33 devstack sudo[101931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-70b01409-19bf-4258-9160-2681b4e4bde0 tempest-ProjectReaderTests-714037572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9df582d-7245-4206-988e-855b15150f76 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:33 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9df582d-7245-4206-988e-855b15150f76 Sep 28 17:23:33 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:33 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-70b01409-19bf-4258-9160-2681b4e4bde0 tempest-ProjectReaderTests-714037572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9df582d-7245-4206-988e-855b15150f76" returned: 0 in 0.371s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:33 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-70b01409-19bf-4258-9160-2681b4e4bde0 tempest-ProjectReaderTests-714037572 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-70b01409-19bf-4258-9160-2681b4e4bde0 tempest-ProjectReaderTests-714037572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:33 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-70b01409-19bf-4258-9160-2681b4e4bde0 tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96413c8d-4a71-49e6-9375-611990ea9aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9df582d-7245-4206-988e-855b15150f76', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:33 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-70b01409-19bf-4258-9160-2681b4e4bde0 tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e4d7ec0-6505-4cb3-bdc6-8efea7a43edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:33 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-70b01409-19bf-4258-9160-2681b4e4bde0 tempest-ProjectReaderTests-714037572 None] Volume volume-e9df582d-7245-4206-988e-855b15150f76 (e9df582d-7245-4206-988e-855b15150f76): created successfully Sep 28 17:23:33 devstack sudo[101931]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:33 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-70b01409-19bf-4258-9160-2681b4e4bde0 tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e4d7ec0-6505-4cb3-bdc6-8efea7a43edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:33 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-70b01409-19bf-4258-9160-2681b4e4bde0 tempest-ProjectReaderTests-714037572 None] Flow 'volume_create_manager' (b0df9bd2-e891-49ea-ba4b-4e39d1afee7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-dfe5e582-0b31-4d35-ac81-b7109a90f2ef tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e.b77f8e10-63b0-4556-b668-287d180fb086" returned: 0 in 0.518s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-dfe5e582-0b31-4d35-ac81-b7109a90f2ef tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e.b77f8e10-63b0-4556-b668-287d180fb086 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:33 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-70b01409-19bf-4258-9160-2681b4e4bde0 tempest-ProjectReaderTests-714037572 None] Created volume successfully. Sep 28 17:23:33 devstack sudo[101947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e.b77f8e10-63b0-4556-b668-287d180fb086 Sep 28 17:23:33 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-775e0d59-9f68-418f-b3e9-b68dcb68a977 req-66b6c8fb-fb85-462f-90f6-300ebf3b69d9 tempest-TestServerVolumeAttachmentScenario-641932328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-775e0d59-9f68-418f-b3e9-b68dcb68a977 req-66b6c8fb-fb85-462f-90f6-300ebf3b69d9 tempest-TestServerVolumeAttachmentScenario-641932328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-775e0d59-9f68-418f-b3e9-b68dcb68a977 req-66b6c8fb-fb85-462f-90f6-300ebf3b69d9 tempest-TestServerVolumeAttachmentScenario-641932328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:33 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-775e0d59-9f68-418f-b3e9-b68dcb68a977 req-66b6c8fb-fb85-462f-90f6-300ebf3b69d9 tempest-TestServerVolumeAttachmentScenario-641932328 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069', 'name': 'volume-e9f915d0-1f4a-4e93-bf08-4d6b4858866f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5d23aaad-a549-428c-928f-9fb494bf1390', 'enforce_multipath': True} {{(pid=86917) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:23:34 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-775e0d59-9f68-418f-b3e9-b68dcb68a977 req-66b6c8fb-fb85-462f-90f6-300ebf3b69d9 tempest-TestServerVolumeAttachmentScenario-641932328 None] attachment_update completed successfully. Sep 28 17:23:34 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-dfe5e582-0b31-4d35-ac81-b7109a90f2ef tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e.b77f8e10-63b0-4556-b668-287d180fb086" returned: 0 in 0.301s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:34 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-dfe5e582-0b31-4d35-ac81-b7109a90f2ef tempest-GroupSnapshotsTest-671637742 None] Lock "cinder-quobyte-b77f8e10-63b0-4556-b668-287d180fb086" released by "_delete_snapshot" :: held 2.402s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:34 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-dfe5e582-0b31-4d35-ac81-b7109a90f2ef tempest-GroupSnapshotsTest-671637742 None] Lock "cinder-quobyte-48065788-92e9-4253-852d-f5ca6b82004e" released by "delete_snapshot" :: held 2.436s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:34 devstack cinder-volume[86917]: WARNING cinder.quota [None req-dfe5e582-0b31-4d35-ac81-b7109a90f2ef tempest-GroupSnapshotsTest-671637742 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-359569417 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-359569417, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:23:34 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-dfe5e582-0b31-4d35-ac81-b7109a90f2ef tempest-GroupSnapshotsTest-671637742 None] Created reservations ['744740c6-2323-4c8b-934a-44eb91ad37c1', '02bc92a6-29d3-4cef-895f-bc6ac5415a60', '18ca2b95-2b81-4f91-a1f3-9ec40abdf137', 'fd751a71-8c03-4546-8342-b7a0998ad9ce'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:34 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-dfe5e582-0b31-4d35-ac81-b7109a90f2ef tempest-GroupSnapshotsTest-671637742 None] group_snapshot 68a66332-1f17-4c46-b349-4457d237a432: deleted successfully Sep 28 17:23:34 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2dcbf880-c134-4c3f-ace5-b29bb93fd3d0 tempest-ProjectReaderTests-714037572 None] Acquiring lock "cinder-e9df582d-7245-4206-988e-855b15150f76-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:34 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2dcbf880-c134-4c3f-ace5-b29bb93fd3d0 tempest-ProjectReaderTests-714037572 None] Lock "cinder-e9df582d-7245-4206-988e-855b15150f76-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:34 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2dcbf880-c134-4c3f-ace5-b29bb93fd3d0 tempest-ProjectReaderTests-714037572 None] Acquiring lock "cinder-quobyte-e9df582d-7245-4206-988e-855b15150f76" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:34 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2dcbf880-c134-4c3f-ace5-b29bb93fd3d0 tempest-ProjectReaderTests-714037572 None] Lock "cinder-quobyte-e9df582d-7245-4206-988e-855b15150f76" acquired by "delete_volume" :: waited 0.020s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:34 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd51436e-f661-4ae8-9402-ccedcc8f266a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2dcbf880-c134-4c3f-ace5-b29bb93fd3d0 tempest-ProjectReaderTests-714037572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9df582d-7245-4206-988e-855b15150f76 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:35 devstack sudo[102369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9df582d-7245-4206-988e-855b15150f76 Sep 28 17:23:35 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:35 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2dcbf880-c134-4c3f-ace5-b29bb93fd3d0 tempest-ProjectReaderTests-714037572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9df582d-7245-4206-988e-855b15150f76" returned: 0 in 0.480s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2dcbf880-c134-4c3f-ace5-b29bb93fd3d0 tempest-ProjectReaderTests-714037572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9df582d-7245-4206-988e-855b15150f76 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:35 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6b31c765-c6e1-4ec3-9b5b-5545d0e0bb6d tempest-GroupSnapshotsTest-671637742 None] Acquiring lock "cinder-quobyte-48065788-92e9-4253-852d-f5ca6b82004e" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:35 devstack sudo[102375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9df582d-7245-4206-988e-855b15150f76 Sep 28 17:23:35 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:35 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6b31c765-c6e1-4ec3-9b5b-5545d0e0bb6d tempest-GroupSnapshotsTest-671637742 None] Lock "cinder-quobyte-48065788-92e9-4253-852d-f5ca6b82004e" acquired by "delete_volume" :: waited 0.029s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:35 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbae330b-8df8-4ccf-941c-a7961ce44bd6]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b31c765-c6e1-4ec3-9b5b-5545d0e0bb6d tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:35 devstack sudo[102377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e Sep 28 17:23:35 devstack sudo[102377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:35 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2dcbf880-c134-4c3f-ace5-b29bb93fd3d0 tempest-ProjectReaderTests-714037572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9df582d-7245-4206-988e-855b15150f76" returned: 0 in 0.274s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:35 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2dcbf880-c134-4c3f-ace5-b29bb93fd3d0 tempest-ProjectReaderTests-714037572 None] Lock "cinder-quobyte-e9df582d-7245-4206-988e-855b15150f76" released by "delete_volume" :: held 0.822s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:35 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-2dcbf880-c134-4c3f-ace5-b29bb93fd3d0 tempest-ProjectReaderTests-714037572 None] Created reservations ['cc018c45-e8cc-4937-bf0a-5d8edcbab7bb', '1b282494-476d-4e19-9806-b6ccff2251c5', '5a4ea00b-8f3f-4d96-a1c7-b40f2819303e', '2dd38555-75d3-48df-9078-6968514686c7'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2dcbf880-c134-4c3f-ace5-b29bb93fd3d0 tempest-ProjectReaderTests-714037572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2dcbf880-c134-4c3f-ace5-b29bb93fd3d0 tempest-ProjectReaderTests-714037572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:35 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-2dcbf880-c134-4c3f-ace5-b29bb93fd3d0 tempest-ProjectReaderTests-714037572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:35 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-2dcbf880-c134-4c3f-ace5-b29bb93fd3d0 tempest-ProjectReaderTests-714037572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2dcbf880-c134-4c3f-ace5-b29bb93fd3d0 tempest-ProjectReaderTests-714037572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2dcbf880-c134-4c3f-ace5-b29bb93fd3d0 tempest-ProjectReaderTests-714037572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:35 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:23:35 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:36 devstack sudo[102377]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b31c765-c6e1-4ec3-9b5b-5545d0e0bb6d tempest-GroupSnapshotsTest-671637742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e" returned: 0 in 0.501s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b31c765-c6e1-4ec3-9b5b-5545d0e0bb6d tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:36 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e Sep 28 17:23:36 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:36 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2dcbf880-c134-4c3f-ace5-b29bb93fd3d0 tempest-ProjectReaderTests-714037572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.362s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:36 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-2dcbf880-c134-4c3f-ace5-b29bb93fd3d0 tempest-ProjectReaderTests-714037572 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:36 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-2dcbf880-c134-4c3f-ace5-b29bb93fd3d0 tempest-ProjectReaderTests-714037572 None] Deleted volume successfully. Sep 28 17:23:36 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2dcbf880-c134-4c3f-ace5-b29bb93fd3d0 tempest-ProjectReaderTests-714037572 None] Lock "cinder-e9df582d-7245-4206-988e-855b15150f76-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:36 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b31c765-c6e1-4ec3-9b5b-5545d0e0bb6d tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-48065788-92e9-4253-852d-f5ca6b82004e" returned: 0 in 0.413s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:36 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6b31c765-c6e1-4ec3-9b5b-5545d0e0bb6d tempest-GroupSnapshotsTest-671637742 None] Lock "cinder-quobyte-48065788-92e9-4253-852d-f5ca6b82004e" released by "delete_volume" :: held 1.023s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:36 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-6b31c765-c6e1-4ec3-9b5b-5545d0e0bb6d tempest-GroupSnapshotsTest-671637742 None] Created reservations ['1bf9d5a3-68b1-4c07-8a3c-9f4acee956f7'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:36 devstack cinder-volume[86917]: WARNING cinder.db.api [None req-6b31c765-c6e1-4ec3-9b5b-5545d0e0bb6d tempest-GroupSnapshotsTest-671637742 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-359569417'] Sep 28 17:23:36 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-6b31c765-c6e1-4ec3-9b5b-5545d0e0bb6d tempest-GroupSnapshotsTest-671637742 None] Created reservations ['7536ec2c-11a9-4224-a2fc-1b886ca758a2', 'ef32f788-818b-4b0b-88dc-8c1c319eab6d', 'a61fb09a-d148-4b24-afc0-02d436ee78b2', '6cb9fc42-1a88-45a9-a020-ec9a485b850f'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:36 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-53b86093-bad4-4353-a7c0-ad5eae4d7d29 tempest-ProjectReaderTests-714037572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-53b86093-bad4-4353-a7c0-ad5eae4d7d29 tempest-ProjectReaderTests-714037572 None] Flow 'volume_create_manager' (62a5bbc1-19be-4679-b49e-fe6bfbfd60cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-53b86093-bad4-4353-a7c0-ad5eae4d7d29 tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad10d412-f627-44cf-bc03-8d0f6741cf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-53b86093-bad4-4353-a7c0-ad5eae4d7d29 tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad10d412-f627-44cf-bc03-8d0f6741cf69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1664189963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=625d1fe7-c6d5-4a7f-abc7-1b40051eee04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4728f9cf415d4560a4a6c63fd1b417a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:37Z,use_quota=True,user_id='f53150d404b5416dace1839f7e476bbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-53b86093-bad4-4353-a7c0-ad5eae4d7d29 tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aff686f-506f-4b72-a8f3-765707f2d145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-53b86093-bad4-4353-a7c0-ad5eae4d7d29 tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aff686f-506f-4b72-a8f3-765707f2d145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-53b86093-bad4-4353-a7c0-ad5eae4d7d29 tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecc5a065-216b-494a-b7e3-e0306de5b07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-53b86093-bad4-4353-a7c0-ad5eae4d7d29 tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecc5a065-216b-494a-b7e3-e0306de5b07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '625d1fe7-c6d5-4a7f-abc7-1b40051eee04', 'volume_name': 'volume-625d1fe7-c6d5-4a7f-abc7-1b40051eee04', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-53b86093-bad4-4353-a7c0-ad5eae4d7d29 tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6cb82a8-1bc0-486d-8e53-aa77f10c90cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-53b86093-bad4-4353-a7c0-ad5eae4d7d29 tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6cb82a8-1bc0-486d-8e53-aa77f10c90cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-53b86093-bad4-4353-a7c0-ad5eae4d7d29 tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff589a4e-5898-41f5-ad5f-481fdeb30cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:36 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-53b86093-bad4-4353-a7c0-ad5eae4d7d29 tempest-ProjectReaderTests-714037572 None] Volume 625d1fe7-c6d5-4a7f-abc7-1b40051eee04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-625d1fe7-c6d5-4a7f-abc7-1b40051eee04', 'volume_size': 1} Sep 28 17:23:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-53b86093-bad4-4353-a7c0-ad5eae4d7d29 tempest-ProjectReaderTests-714037572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-53b86093-bad4-4353-a7c0-ad5eae4d7d29 tempest-ProjectReaderTests-714037572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:36 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-53b86093-bad4-4353-a7c0-ad5eae4d7d29 tempest-ProjectReaderTests-714037572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1664189963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=625d1fe7-c6d5-4a7f-abc7-1b40051eee04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4728f9cf415d4560a4a6c63fd1b417a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:37Z,use_quota=True,user_id='f53150d404b5416dace1839f7e476bbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:36 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-53b86093-bad4-4353-a7c0-ad5eae4d7d29 tempest-ProjectReaderTests-714037572 None] Creating volume 625d1fe7-c6d5-4a7f-abc7-1b40051eee04 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-53b86093-bad4-4353-a7c0-ad5eae4d7d29 tempest-ProjectReaderTests-714037572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-53b86093-bad4-4353-a7c0-ad5eae4d7d29 tempest-ProjectReaderTests-714037572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:36 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-53b86093-bad4-4353-a7c0-ad5eae4d7d29 tempest-ProjectReaderTests-714037572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:36 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-53b86093-bad4-4353-a7c0-ad5eae4d7d29 tempest-ProjectReaderTests-714037572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-53b86093-bad4-4353-a7c0-ad5eae4d7d29 tempest-ProjectReaderTests-714037572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:36 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-53b86093-bad4-4353-a7c0-ad5eae4d7d29 tempest-ProjectReaderTests-714037572 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:36 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-53b86093-bad4-4353-a7c0-ad5eae4d7d29 tempest-ProjectReaderTests-714037572 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:23:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-53b86093-bad4-4353-a7c0-ad5eae4d7d29 tempest-ProjectReaderTests-714037572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-625d1fe7-c6d5-4a7f-abc7-1b40051eee04 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:36 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-625d1fe7-c6d5-4a7f-abc7-1b40051eee04 1073741824 Sep 28 17:23:36 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6b31c765-c6e1-4ec3-9b5b-5545d0e0bb6d tempest-GroupSnapshotsTest-671637742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6b31c765-c6e1-4ec3-9b5b-5545d0e0bb6d tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:37 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6b31c765-c6e1-4ec3-9b5b-5545d0e0bb6d tempest-GroupSnapshotsTest-671637742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:37 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6b31c765-c6e1-4ec3-9b5b-5545d0e0bb6d tempest-GroupSnapshotsTest-671637742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6b31c765-c6e1-4ec3-9b5b-5545d0e0bb6d tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b31c765-c6e1-4ec3-9b5b-5545d0e0bb6d tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:37 devstack sudo[102391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:23:37 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:37 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b31c765-c6e1-4ec3-9b5b-5545d0e0bb6d tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.398s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:37 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-6b31c765-c6e1-4ec3-9b5b-5545d0e0bb6d tempest-GroupSnapshotsTest-671637742 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:37 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-6b31c765-c6e1-4ec3-9b5b-5545d0e0bb6d tempest-GroupSnapshotsTest-671637742 None] Delete group completed successfully. Sep 28 17:23:37 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-53b86093-bad4-4353-a7c0-ad5eae4d7d29 tempest-ProjectReaderTests-714037572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-625d1fe7-c6d5-4a7f-abc7-1b40051eee04 1073741824" returned: 0 in 0.629s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:37 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=110,cinder:INSERT=29,cinder:UPDATE=128,cinder:DELETE=8 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:23:37 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=102,cinder:UPDATE=135,cinder:DELETE=11,cinder:INSERT=30 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:23:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-53b86093-bad4-4353-a7c0-ad5eae4d7d29 tempest-ProjectReaderTests-714037572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-625d1fe7-c6d5-4a7f-abc7-1b40051eee04 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:37 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-625d1fe7-c6d5-4a7f-abc7-1b40051eee04 Sep 28 17:23:37 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:37 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-53b86093-bad4-4353-a7c0-ad5eae4d7d29 tempest-ProjectReaderTests-714037572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-625d1fe7-c6d5-4a7f-abc7-1b40051eee04" returned: 0 in 0.346s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:37 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-53b86093-bad4-4353-a7c0-ad5eae4d7d29 tempest-ProjectReaderTests-714037572 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-53b86093-bad4-4353-a7c0-ad5eae4d7d29 tempest-ProjectReaderTests-714037572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:37 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-53b86093-bad4-4353-a7c0-ad5eae4d7d29 tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff589a4e-5898-41f5-ad5f-481fdeb30cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-625d1fe7-c6d5-4a7f-abc7-1b40051eee04', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:37 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-53b86093-bad4-4353-a7c0-ad5eae4d7d29 tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6284b2c-c7bd-4a72-b9cb-7488474a581e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:37 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-53b86093-bad4-4353-a7c0-ad5eae4d7d29 tempest-ProjectReaderTests-714037572 None] Volume volume-625d1fe7-c6d5-4a7f-abc7-1b40051eee04 (625d1fe7-c6d5-4a7f-abc7-1b40051eee04): created successfully Sep 28 17:23:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-53b86093-bad4-4353-a7c0-ad5eae4d7d29 tempest-ProjectReaderTests-714037572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6284b2c-c7bd-4a72-b9cb-7488474a581e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-53b86093-bad4-4353-a7c0-ad5eae4d7d29 tempest-ProjectReaderTests-714037572 None] Flow 'volume_create_manager' (62a5bbc1-19be-4679-b49e-fe6bfbfd60cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:38 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-53b86093-bad4-4353-a7c0-ad5eae4d7d29 tempest-ProjectReaderTests-714037572 None] Created volume successfully. Sep 28 17:23:38 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-bfaf4655-0b63-44b4-92da-d60ca0899f0c tempest-GroupSnapshotsTest-671637742 None] Group tempest-GroupSnapshotsTest-Group-1380174826: creating Sep 28 17:23:38 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-bfaf4655-0b63-44b4-92da-d60ca0899f0c tempest-GroupSnapshotsTest-671637742 None] Group tempest-GroupSnapshotsTest-Group-1380174826: created successfully Sep 28 17:23:38 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-bfaf4655-0b63-44b4-92da-d60ca0899f0c tempest-GroupSnapshotsTest-671637742 None] Create group completed successfully. Sep 28 17:23:38 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6a88cb90-7b1f-47da-b10e-0104c6b0126b tempest-ProjectReaderTests-714037572 None] Acquiring lock "cinder-625d1fe7-c6d5-4a7f-abc7-1b40051eee04-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:38 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6a88cb90-7b1f-47da-b10e-0104c6b0126b tempest-ProjectReaderTests-714037572 None] Lock "cinder-625d1fe7-c6d5-4a7f-abc7-1b40051eee04-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:38 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6a88cb90-7b1f-47da-b10e-0104c6b0126b tempest-ProjectReaderTests-714037572 None] Acquiring lock "cinder-quobyte-625d1fe7-c6d5-4a7f-abc7-1b40051eee04" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:39 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6a88cb90-7b1f-47da-b10e-0104c6b0126b tempest-ProjectReaderTests-714037572 None] Lock "cinder-quobyte-625d1fe7-c6d5-4a7f-abc7-1b40051eee04" acquired by "delete_volume" :: waited 0.018s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:39 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[48721bf6-744b-4f7c-bde7-38c0dc480abb]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6a88cb90-7b1f-47da-b10e-0104c6b0126b tempest-ProjectReaderTests-714037572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-625d1fe7-c6d5-4a7f-abc7-1b40051eee04 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:39 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-625d1fe7-c6d5-4a7f-abc7-1b40051eee04 Sep 28 17:23:39 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:39 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6a88cb90-7b1f-47da-b10e-0104c6b0126b tempest-ProjectReaderTests-714037572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-625d1fe7-c6d5-4a7f-abc7-1b40051eee04" returned: 0 in 0.447s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6a88cb90-7b1f-47da-b10e-0104c6b0126b tempest-ProjectReaderTests-714037572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-625d1fe7-c6d5-4a7f-abc7-1b40051eee04 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:39 devstack sudo[102408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-625d1fe7-c6d5-4a7f-abc7-1b40051eee04 Sep 28 17:23:39 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:39 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6a88cb90-7b1f-47da-b10e-0104c6b0126b tempest-ProjectReaderTests-714037572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-625d1fe7-c6d5-4a7f-abc7-1b40051eee04" returned: 0 in 0.318s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:39 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6a88cb90-7b1f-47da-b10e-0104c6b0126b tempest-ProjectReaderTests-714037572 None] Lock "cinder-quobyte-625d1fe7-c6d5-4a7f-abc7-1b40051eee04" released by "delete_volume" :: held 0.817s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:39 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-6a88cb90-7b1f-47da-b10e-0104c6b0126b tempest-ProjectReaderTests-714037572 None] Created reservations ['8b631456-0ac2-4399-858f-0c024052ac46', 'e35f1e88-2900-4510-8fd7-eff068b54623', '35a7bd37-4ecb-4a23-ba6a-8a942a17c8ea', 'a0740d09-472b-4405-90a5-04473214d93d'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-4a4d7d1a-4ad1-472a-b8ea-43810f801024 req-0401cc4f-38f7-4f65-ba01-aeee3d1f9c62 tempest-TestServerVolumeAttachmentScenario-641932328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-4a4d7d1a-4ad1-472a-b8ea-43810f801024 req-0401cc4f-38f7-4f65-ba01-aeee3d1f9c62 tempest-TestServerVolumeAttachmentScenario-641932328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-4a4d7d1a-4ad1-472a-b8ea-43810f801024 req-0401cc4f-38f7-4f65-ba01-aeee3d1f9c62 tempest-TestServerVolumeAttachmentScenario-641932328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6a88cb90-7b1f-47da-b10e-0104c6b0126b tempest-ProjectReaderTests-714037572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6a88cb90-7b1f-47da-b10e-0104c6b0126b tempest-ProjectReaderTests-714037572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:40 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6a88cb90-7b1f-47da-b10e-0104c6b0126b tempest-ProjectReaderTests-714037572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:40 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6a88cb90-7b1f-47da-b10e-0104c6b0126b tempest-ProjectReaderTests-714037572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6a88cb90-7b1f-47da-b10e-0104c6b0126b tempest-ProjectReaderTests-714037572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6a88cb90-7b1f-47da-b10e-0104c6b0126b tempest-ProjectReaderTests-714037572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:40 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:23:40 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-4a4d7d1a-4ad1-472a-b8ea-43810f801024 req-0401cc4f-38f7-4f65-ba01-aeee3d1f9c62 tempest-TestServerVolumeAttachmentScenario-641932328 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069', 'name': 'volume-f7394b23-a0c2-44bb-8076-2ff464b55d3d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c613eee9-ed64-45d8-b675-fbbd10291376', 'enforce_multipath': True} {{(pid=86917) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:23:40 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-4a4d7d1a-4ad1-472a-b8ea-43810f801024 req-0401cc4f-38f7-4f65-ba01-aeee3d1f9c62 tempest-TestServerVolumeAttachmentScenario-641932328 None] attachment_update completed successfully. Sep 28 17:23:40 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-73d9bf74-c3c3-494d-bc92-09fd78760841 tempest-GroupSnapshotsTest-671637742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:40 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-73d9bf74-c3c3-494d-bc92-09fd78760841 tempest-GroupSnapshotsTest-671637742 None] Flow 'volume_create_manager' (8866b3cb-19b2-4a22-afc0-fec0a20b75ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-73d9bf74-c3c3-494d-bc92-09fd78760841 tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7275fbac-6abd-4b64-b7bc-3a12c9ee704e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-73d9bf74-c3c3-494d-bc92-09fd78760841 tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7275fbac-6abd-4b64-b7bc-3a12c9ee704e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1262298647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b05ddcb4-ef98-4a29-96b2-f885571f848a,host='devstack@QuobyteHD#QuobyteHD',id=05df6ea2-4f25-4543-b339-03328090fc88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ba7cf50f4184c46851f2a0510f15455',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:40Z,use_quota=True,user_id='bb7762a6fc5747639e5b15739f8009aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e318e80-a08f-4ac7-b717-91343eb8ca90),volume_type_id=3e318e80-a08f-4ac7-b717-91343eb8ca90)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-73d9bf74-c3c3-494d-bc92-09fd78760841 tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe3de512-3dfa-4ff2-8576-e7059d098922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-73d9bf74-c3c3-494d-bc92-09fd78760841 tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe3de512-3dfa-4ff2-8576-e7059d098922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-73d9bf74-c3c3-494d-bc92-09fd78760841 tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (195a0636-00e1-40bf-b3b2-14fd3dfb4b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-73d9bf74-c3c3-494d-bc92-09fd78760841 tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (195a0636-00e1-40bf-b3b2-14fd3dfb4b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05df6ea2-4f25-4543-b339-03328090fc88', 'volume_name': 'volume-05df6ea2-4f25-4543-b339-03328090fc88', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-73d9bf74-c3c3-494d-bc92-09fd78760841 tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4640eb3-765e-4049-8518-dcce4a4c17dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-73d9bf74-c3c3-494d-bc92-09fd78760841 tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4640eb3-765e-4049-8518-dcce4a4c17dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-73d9bf74-c3c3-494d-bc92-09fd78760841 tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cd7987f-cf81-4010-9436-ec539d8abf1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:40 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-73d9bf74-c3c3-494d-bc92-09fd78760841 tempest-GroupSnapshotsTest-671637742 None] Volume 05df6ea2-4f25-4543-b339-03328090fc88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05df6ea2-4f25-4543-b339-03328090fc88', 'volume_size': 1} Sep 28 17:23:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-73d9bf74-c3c3-494d-bc92-09fd78760841 tempest-GroupSnapshotsTest-671637742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-73d9bf74-c3c3-494d-bc92-09fd78760841 tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:40 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-73d9bf74-c3c3-494d-bc92-09fd78760841 tempest-GroupSnapshotsTest-671637742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b05ddcb4-ef98-4a29-96b2-f885571f848a,created_at=2026-09-28T15:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1262298647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b05ddcb4-ef98-4a29-96b2-f885571f848a,host='devstack@QuobyteHD#QuobyteHD',id=05df6ea2-4f25-4543-b339-03328090fc88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ba7cf50f4184c46851f2a0510f15455',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:40Z,use_quota=True,user_id='bb7762a6fc5747639e5b15739f8009aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e318e80-a08f-4ac7-b717-91343eb8ca90),volume_type_id=3e318e80-a08f-4ac7-b717-91343eb8ca90)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:40 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-73d9bf74-c3c3-494d-bc92-09fd78760841 tempest-GroupSnapshotsTest-671637742 None] Creating volume 05df6ea2-4f25-4543-b339-03328090fc88 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-73d9bf74-c3c3-494d-bc92-09fd78760841 tempest-GroupSnapshotsTest-671637742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-73d9bf74-c3c3-494d-bc92-09fd78760841 tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:40 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-73d9bf74-c3c3-494d-bc92-09fd78760841 tempest-GroupSnapshotsTest-671637742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:40 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-73d9bf74-c3c3-494d-bc92-09fd78760841 tempest-GroupSnapshotsTest-671637742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-73d9bf74-c3c3-494d-bc92-09fd78760841 tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:40 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-73d9bf74-c3c3-494d-bc92-09fd78760841 tempest-GroupSnapshotsTest-671637742 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:40 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-73d9bf74-c3c3-494d-bc92-09fd78760841 tempest-GroupSnapshotsTest-671637742 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:23:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-73d9bf74-c3c3-494d-bc92-09fd78760841 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6a88cb90-7b1f-47da-b10e-0104c6b0126b tempest-ProjectReaderTests-714037572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.571s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:40 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-6a88cb90-7b1f-47da-b10e-0104c6b0126b tempest-ProjectReaderTests-714037572 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:40 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-6a88cb90-7b1f-47da-b10e-0104c6b0126b tempest-ProjectReaderTests-714037572 None] Deleted volume successfully. Sep 28 17:23:40 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88 1073741824 Sep 28 17:23:40 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:40 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6a88cb90-7b1f-47da-b10e-0104c6b0126b tempest-ProjectReaderTests-714037572 None] Lock "cinder-625d1fe7-c6d5-4a7f-abc7-1b40051eee04-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:41 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-73d9bf74-c3c3-494d-bc92-09fd78760841 tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88 1073741824" returned: 0 in 0.638s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-73d9bf74-c3c3-494d-bc92-09fd78760841 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:41 devstack sudo[102436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88 Sep 28 17:23:41 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:41 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-73d9bf74-c3c3-494d-bc92-09fd78760841 tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88" returned: 0 in 0.286s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:41 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-73d9bf74-c3c3-494d-bc92-09fd78760841 tempest-GroupSnapshotsTest-671637742 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-73d9bf74-c3c3-494d-bc92-09fd78760841 tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:41 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-73d9bf74-c3c3-494d-bc92-09fd78760841 tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cd7987f-cf81-4010-9436-ec539d8abf1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05df6ea2-4f25-4543-b339-03328090fc88', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:41 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-73d9bf74-c3c3-494d-bc92-09fd78760841 tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff65f9ef-035a-4894-9b91-d93934b0967b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:41 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-73d9bf74-c3c3-494d-bc92-09fd78760841 tempest-GroupSnapshotsTest-671637742 None] Volume volume-05df6ea2-4f25-4543-b339-03328090fc88 (05df6ea2-4f25-4543-b339-03328090fc88): created successfully Sep 28 17:23:41 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-73d9bf74-c3c3-494d-bc92-09fd78760841 tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff65f9ef-035a-4894-9b91-d93934b0967b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:41 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-73d9bf74-c3c3-494d-bc92-09fd78760841 tempest-GroupSnapshotsTest-671637742 None] Flow 'volume_create_manager' (8866b3cb-19b2-4a22-afc0-fec0a20b75ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:41 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-73d9bf74-c3c3-494d-bc92-09fd78760841 tempest-GroupSnapshotsTest-671637742 None] Created volume successfully. Sep 28 17:23:42 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a3a63c9-478a-41d5-bf72-f97fa5b92c2d tempest-GroupSnapshotsTest-671637742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0a3a63c9-478a-41d5-bf72-f97fa5b92c2d tempest-GroupSnapshotsTest-671637742 None] Flow 'volume_create_manager' (f1667f7b-363a-46a1-a484-0456e1a58cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0a3a63c9-478a-41d5-bf72-f97fa5b92c2d tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16b0b39d-4a45-4b84-baaf-f46f569292c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0a3a63c9-478a-41d5-bf72-f97fa5b92c2d tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16b0b39d-4a45-4b84-baaf-f46f569292c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-673933038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b05ddcb4-ef98-4a29-96b2-f885571f848a,host='devstack@QuobyteHD#QuobyteHD',id=ebb04727-3cf5-43b3-8eb8-3df3128b1440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ba7cf50f4184c46851f2a0510f15455',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:43Z,use_quota=True,user_id='bb7762a6fc5747639e5b15739f8009aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e318e80-a08f-4ac7-b717-91343eb8ca90),volume_type_id=3e318e80-a08f-4ac7-b717-91343eb8ca90)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0a3a63c9-478a-41d5-bf72-f97fa5b92c2d tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adb06c80-559b-4493-a739-b41b0985e811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0a3a63c9-478a-41d5-bf72-f97fa5b92c2d tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adb06c80-559b-4493-a739-b41b0985e811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0a3a63c9-478a-41d5-bf72-f97fa5b92c2d tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (628a7369-0aec-414c-bbc0-907e440a355b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0a3a63c9-478a-41d5-bf72-f97fa5b92c2d tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (628a7369-0aec-414c-bbc0-907e440a355b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebb04727-3cf5-43b3-8eb8-3df3128b1440', 'volume_name': 'volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0a3a63c9-478a-41d5-bf72-f97fa5b92c2d tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afcc1a73-a609-462a-8ffb-fd9d3cc73dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0a3a63c9-478a-41d5-bf72-f97fa5b92c2d tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afcc1a73-a609-462a-8ffb-fd9d3cc73dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0a3a63c9-478a-41d5-bf72-f97fa5b92c2d tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2f0e548-8792-4168-aadf-1c189058c0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:42 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-0a3a63c9-478a-41d5-bf72-f97fa5b92c2d tempest-GroupSnapshotsTest-671637742 None] Volume ebb04727-3cf5-43b3-8eb8-3df3128b1440: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440', 'volume_size': 1} Sep 28 17:23:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0a3a63c9-478a-41d5-bf72-f97fa5b92c2d tempest-GroupSnapshotsTest-671637742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0a3a63c9-478a-41d5-bf72-f97fa5b92c2d tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:42 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0a3a63c9-478a-41d5-bf72-f97fa5b92c2d tempest-GroupSnapshotsTest-671637742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b05ddcb4-ef98-4a29-96b2-f885571f848a,created_at=2026-09-28T15:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-673933038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b05ddcb4-ef98-4a29-96b2-f885571f848a,host='devstack@QuobyteHD#QuobyteHD',id=ebb04727-3cf5-43b3-8eb8-3df3128b1440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ba7cf50f4184c46851f2a0510f15455',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:43Z,use_quota=True,user_id='bb7762a6fc5747639e5b15739f8009aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e318e80-a08f-4ac7-b717-91343eb8ca90),volume_type_id=3e318e80-a08f-4ac7-b717-91343eb8ca90)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:42 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-0a3a63c9-478a-41d5-bf72-f97fa5b92c2d tempest-GroupSnapshotsTest-671637742 None] Creating volume ebb04727-3cf5-43b3-8eb8-3df3128b1440 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0a3a63c9-478a-41d5-bf72-f97fa5b92c2d tempest-GroupSnapshotsTest-671637742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0a3a63c9-478a-41d5-bf72-f97fa5b92c2d tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:42 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0a3a63c9-478a-41d5-bf72-f97fa5b92c2d tempest-GroupSnapshotsTest-671637742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:42 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0a3a63c9-478a-41d5-bf72-f97fa5b92c2d tempest-GroupSnapshotsTest-671637742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0a3a63c9-478a-41d5-bf72-f97fa5b92c2d tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:42 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0a3a63c9-478a-41d5-bf72-f97fa5b92c2d tempest-GroupSnapshotsTest-671637742 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:42 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-0a3a63c9-478a-41d5-bf72-f97fa5b92c2d tempest-GroupSnapshotsTest-671637742 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:23:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0a3a63c9-478a-41d5-bf72-f97fa5b92c2d tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:42 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440 1073741824 Sep 28 17:23:42 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:43 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-8c396dcd-0e5d-4327-8c8b-6ce1f46eb660 req-b35461bd-5e06-4bce-819e-b81b20928d43 tempest-TestServerVolumeAttachmentScenario-641932328 None] Terminate volume connection completed successfully. Sep 28 17:23:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-8c396dcd-0e5d-4327-8c8b-6ce1f46eb660 req-b35461bd-5e06-4bce-819e-b81b20928d43 tempest-TestServerVolumeAttachmentScenario-641932328 None] Deleting attachment c613eee9-ed64-45d8-b675-fbbd10291376. {{(pid=86917) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:23:43 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0a3a63c9-478a-41d5-bf72-f97fa5b92c2d tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440 1073741824" returned: 0 in 0.630s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0a3a63c9-478a-41d5-bf72-f97fa5b92c2d tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:43 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440 Sep 28 17:23:43 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:43 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0a3a63c9-478a-41d5-bf72-f97fa5b92c2d tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440" returned: 0 in 0.324s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:43 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0a3a63c9-478a-41d5-bf72-f97fa5b92c2d tempest-GroupSnapshotsTest-671637742 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0a3a63c9-478a-41d5-bf72-f97fa5b92c2d tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0a3a63c9-478a-41d5-bf72-f97fa5b92c2d tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2f0e548-8792-4168-aadf-1c189058c0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0a3a63c9-478a-41d5-bf72-f97fa5b92c2d tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e3a84f9-36a8-4199-b159-fbc9f13be6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:43 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-0a3a63c9-478a-41d5-bf72-f97fa5b92c2d tempest-GroupSnapshotsTest-671637742 None] Volume volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440 (ebb04727-3cf5-43b3-8eb8-3df3128b1440): created successfully Sep 28 17:23:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0a3a63c9-478a-41d5-bf72-f97fa5b92c2d tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e3a84f9-36a8-4199-b159-fbc9f13be6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0a3a63c9-478a-41d5-bf72-f97fa5b92c2d tempest-GroupSnapshotsTest-671637742 None] Flow 'volume_create_manager' (f1667f7b-363a-46a1-a484-0456e1a58cf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:44 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-0a3a63c9-478a-41d5-bf72-f97fa5b92c2d tempest-GroupSnapshotsTest-671637742 None] Created volume successfully. Sep 28 17:23:44 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-25ea8d46-b448-4e22-a374-cd1fab8badb4 req-9d8fea5b-730d-4564-8736-ae1dfc1adaef tempest-TestServerVolumeAttachmentScenario-641932328 None] Terminate volume connection completed successfully. Sep 28 17:23:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-25ea8d46-b448-4e22-a374-cd1fab8badb4 req-9d8fea5b-730d-4564-8736-ae1dfc1adaef tempest-TestServerVolumeAttachmentScenario-641932328 None] Deleting attachment 5d23aaad-a549-428c-928f-9fb494bf1390. {{(pid=86917) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:23:45 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-6df73985-8691-4c69-84dd-ba1cdd572bf6 tempest-GroupSnapshotsTest-671637742 None] Update group completed successfully. Sep 28 17:23:46 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-81a5fff7-7b2b-42b8-aa10-c6b3875296a3 tempest-GroupSnapshotsTest-671637742 None] Update group completed successfully. Sep 28 17:23:48 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-b36e5ce6-5609-4bdc-965c-66d3947c2237 tempest-GroupSnapshotsTest-671637742 None] Update group completed successfully. Sep 28 17:23:49 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-fad3272d-7add-4184-ba63-7b4741215c0e tempest-GroupSnapshotsTest-671637742 None] Update group completed successfully. Sep 28 17:23:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:23:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:49 devstack sudo[102512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:23:49 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:49 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.391s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:49 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager._thread_info {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:23:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread count: 28 {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:23:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread info: [<_MainThread(MainThread, started 132915553284224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:23:50 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6b25aabb-6d6d-4279-b9b2-ebbd53c35fd2 tempest-TestServerVolumeAttachmentScenario-641932328 None] Acquiring lock "cinder-f7394b23-a0c2-44bb-8076-2ff464b55d3d-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:50 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6b25aabb-6d6d-4279-b9b2-ebbd53c35fd2 tempest-TestServerVolumeAttachmentScenario-641932328 None] Lock "cinder-f7394b23-a0c2-44bb-8076-2ff464b55d3d-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:50 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6b25aabb-6d6d-4279-b9b2-ebbd53c35fd2 tempest-TestServerVolumeAttachmentScenario-641932328 None] Acquiring lock "cinder-quobyte-f7394b23-a0c2-44bb-8076-2ff464b55d3d" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:51 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6b25aabb-6d6d-4279-b9b2-ebbd53c35fd2 tempest-TestServerVolumeAttachmentScenario-641932328 None] Lock "cinder-quobyte-f7394b23-a0c2-44bb-8076-2ff464b55d3d" acquired by "delete_volume" :: waited 0.038s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:51 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[784e7ae0-9856-4495-9aa9-6e14aeb2f497]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b25aabb-6d6d-4279-b9b2-ebbd53c35fd2 tempest-TestServerVolumeAttachmentScenario-641932328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f7394b23-a0c2-44bb-8076-2ff464b55d3d {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:51 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] GroupSnapshot 663cd065-79fc-403b-8081-45c7570d6366: creating. Sep 28 17:23:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] Group snapshot 663cd065-79fc-403b-8081-45c7570d6366: creating. {{(pid=86917) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 17:23:51 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f7394b23-a0c2-44bb-8076-2ff464b55d3d Sep 28 17:23:51 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:51 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] Creating offline snapshot c00bd84a-77b6-404d-aa03-f938721cb4a9 of volume ebb04727-3cf5-43b3-8eb8-3df3128b1440 {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:23:51 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[70624b40-f758-4d98-b7fb-bf536abea34a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:51 devstack sudo[102518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440 Sep 28 17:23:51 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:51 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b25aabb-6d6d-4279-b9b2-ebbd53c35fd2 tempest-TestServerVolumeAttachmentScenario-641932328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f7394b23-a0c2-44bb-8076-2ff464b55d3d" returned: 0 in 0.602s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b25aabb-6d6d-4279-b9b2-ebbd53c35fd2 tempest-TestServerVolumeAttachmentScenario-641932328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f7394b23-a0c2-44bb-8076-2ff464b55d3d {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:51 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f7394b23-a0c2-44bb-8076-2ff464b55d3d Sep 28 17:23:51 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:52 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440" returned: 0 in 0.710s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440.c00bd84a-77b6-404d-aa03-f938721cb4a9 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:52 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440.c00bd84a-77b6-404d-aa03-f938721cb4a9 1G Sep 28 17:23:52 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:52 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b25aabb-6d6d-4279-b9b2-ebbd53c35fd2 tempest-TestServerVolumeAttachmentScenario-641932328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f7394b23-a0c2-44bb-8076-2ff464b55d3d" returned: 0 in 0.467s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:52 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6b25aabb-6d6d-4279-b9b2-ebbd53c35fd2 tempest-TestServerVolumeAttachmentScenario-641932328 None] Lock "cinder-quobyte-f7394b23-a0c2-44bb-8076-2ff464b55d3d" released by "delete_volume" :: held 1.242s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:52 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-6b25aabb-6d6d-4279-b9b2-ebbd53c35fd2 tempest-TestServerVolumeAttachmentScenario-641932328 None] Created reservations ['e7c946d2-91e8-4581-9c7a-5170ad2a27b6', 'ebce661f-dd34-49de-bc4c-45c21ecc461a', 'ae540804-3190-4e24-ae07-ff83f9499d46', '9171ed20-859b-44d4-b5a8-cf8512be4033'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6b25aabb-6d6d-4279-b9b2-ebbd53c35fd2 tempest-TestServerVolumeAttachmentScenario-641932328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6b25aabb-6d6d-4279-b9b2-ebbd53c35fd2 tempest-TestServerVolumeAttachmentScenario-641932328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6b25aabb-6d6d-4279-b9b2-ebbd53c35fd2 tempest-TestServerVolumeAttachmentScenario-641932328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6b25aabb-6d6d-4279-b9b2-ebbd53c35fd2 tempest-TestServerVolumeAttachmentScenario-641932328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6b25aabb-6d6d-4279-b9b2-ebbd53c35fd2 tempest-TestServerVolumeAttachmentScenario-641932328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b25aabb-6d6d-4279-b9b2-ebbd53c35fd2 tempest-TestServerVolumeAttachmentScenario-641932328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:52 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:23:52 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:52 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440.c00bd84a-77b6-404d-aa03-f938721cb4a9 1G" returned: 0 in 0.703s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440.c00bd84a-77b6-404d-aa03-f938721cb4a9 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:52 devstack sudo[102537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440.c00bd84a-77b6-404d-aa03-f938721cb4a9 Sep 28 17:23:52 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:52 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b25aabb-6d6d-4279-b9b2-ebbd53c35fd2 tempest-TestServerVolumeAttachmentScenario-641932328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.398s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:52 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-6b25aabb-6d6d-4279-b9b2-ebbd53c35fd2 tempest-TestServerVolumeAttachmentScenario-641932328 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:52 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-6b25aabb-6d6d-4279-b9b2-ebbd53c35fd2 tempest-TestServerVolumeAttachmentScenario-641932328 None] Deleted volume successfully. Sep 28 17:23:52 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6b25aabb-6d6d-4279-b9b2-ebbd53c35fd2 tempest-TestServerVolumeAttachmentScenario-641932328 None] Lock "cinder-f7394b23-a0c2-44bb-8076-2ff464b55d3d-delete_volume" released by "delete_volume" :: held 2.109s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:53 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c0cd406f-ce72-4123-a994-bfa11383d784 tempest-TestServerVolumeAttachmentScenario-641932328 None] Acquiring lock "cinder-e9f915d0-1f4a-4e93-bf08-4d6b4858866f-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:53 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c0cd406f-ce72-4123-a994-bfa11383d784 tempest-TestServerVolumeAttachmentScenario-641932328 None] Lock "cinder-e9f915d0-1f4a-4e93-bf08-4d6b4858866f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:53 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440.c00bd84a-77b6-404d-aa03-f938721cb4a9" returned: 0 in 0.501s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:53 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440.c00bd84a-77b6-404d-aa03-f938721cb4a9 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:23:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440.c00bd84a-77b6-404d-aa03-f938721cb4a9 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:53 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c0cd406f-ce72-4123-a994-bfa11383d784 tempest-TestServerVolumeAttachmentScenario-641932328 None] Acquiring lock "cinder-quobyte-e9f915d0-1f4a-4e93-bf08-4d6b4858866f" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:53 devstack sudo[102543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440.c00bd84a-77b6-404d-aa03-f938721cb4a9 Sep 28 17:23:53 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:53 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c0cd406f-ce72-4123-a994-bfa11383d784 tempest-TestServerVolumeAttachmentScenario-641932328 None] Lock "cinder-quobyte-e9f915d0-1f4a-4e93-bf08-4d6b4858866f" acquired by "delete_volume" :: waited 0.025s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:53 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[76afa402-b663-4476-85e8-a995f6906664]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c0cd406f-ce72-4123-a994-bfa11383d784 tempest-TestServerVolumeAttachmentScenario-641932328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9f915d0-1f4a-4e93-bf08-4d6b4858866f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:53 devstack sudo[102545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9f915d0-1f4a-4e93-bf08-4d6b4858866f Sep 28 17:23:53 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:53 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440.c00bd84a-77b6-404d-aa03-f938721cb4a9" returned: 0 in 0.468s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:53 devstack sudo[102548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440.info Sep 28 17:23:53 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:54 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c0cd406f-ce72-4123-a994-bfa11383d784 tempest-TestServerVolumeAttachmentScenario-641932328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9f915d0-1f4a-4e93-bf08-4d6b4858866f" returned: 0 in 0.707s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c0cd406f-ce72-4123-a994-bfa11383d784 tempest-TestServerVolumeAttachmentScenario-641932328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9f915d0-1f4a-4e93-bf08-4d6b4858866f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:54 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9f915d0-1f4a-4e93-bf08-4d6b4858866f Sep 28 17:23:54 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:54 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440.info" returned: 0 in 0.478s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:54 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:23:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:54 devstack sudo[102556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440.info Sep 28 17:23:54 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:54 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440.info" returned: 0 in 0.336s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:54 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.338s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c0cd406f-ce72-4123-a994-bfa11383d784 tempest-TestServerVolumeAttachmentScenario-641932328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9f915d0-1f4a-4e93-bf08-4d6b4858866f" returned: 0 in 0.539s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:54 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] Creating offline snapshot f0598816-413a-4722-8674-2a0e36477231 of volume 05df6ea2-4f25-4543-b339-03328090fc88 {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:23:54 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c0cd406f-ce72-4123-a994-bfa11383d784 tempest-TestServerVolumeAttachmentScenario-641932328 None] Lock "cinder-quobyte-e9f915d0-1f4a-4e93-bf08-4d6b4858866f" released by "delete_volume" :: held 1.346s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:54 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbf215d-4158-46d8-90f8-7c18e0edf5c9]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:54 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-c0cd406f-ce72-4123-a994-bfa11383d784 tempest-TestServerVolumeAttachmentScenario-641932328 None] Created reservations ['141e6967-76b2-42b3-b844-123365fc9237', 'fddeaa24-6fcc-4ef0-8f9e-5db93826b70c', '236cc1ff-6234-4250-810d-eec7aa90a818', '3bc9957b-22f4-45eb-a342-59413ad6e5c3'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:54 devstack sudo[102560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88 Sep 28 17:23:54 devstack sudo[102560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c0cd406f-ce72-4123-a994-bfa11383d784 tempest-TestServerVolumeAttachmentScenario-641932328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c0cd406f-ce72-4123-a994-bfa11383d784 tempest-TestServerVolumeAttachmentScenario-641932328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:54 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c0cd406f-ce72-4123-a994-bfa11383d784 tempest-TestServerVolumeAttachmentScenario-641932328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:54 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c0cd406f-ce72-4123-a994-bfa11383d784 tempest-TestServerVolumeAttachmentScenario-641932328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c0cd406f-ce72-4123-a994-bfa11383d784 tempest-TestServerVolumeAttachmentScenario-641932328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c0cd406f-ce72-4123-a994-bfa11383d784 tempest-TestServerVolumeAttachmentScenario-641932328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:54 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:23:54 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:55 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c0cd406f-ce72-4123-a994-bfa11383d784 tempest-TestServerVolumeAttachmentScenario-641932328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.306s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:55 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-c0cd406f-ce72-4123-a994-bfa11383d784 tempest-TestServerVolumeAttachmentScenario-641932328 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:55 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-c0cd406f-ce72-4123-a994-bfa11383d784 tempest-TestServerVolumeAttachmentScenario-641932328 None] Deleted volume successfully. Sep 28 17:23:55 devstack sudo[102560]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88" returned: 0 in 0.554s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88.f0598816-413a-4722-8674-2a0e36477231 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:55 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c0cd406f-ce72-4123-a994-bfa11383d784 tempest-TestServerVolumeAttachmentScenario-641932328 None] Lock "cinder-e9f915d0-1f4a-4e93-bf08-4d6b4858866f-delete_volume" released by "delete_volume" :: held 2.056s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:55 devstack sudo[102568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88.f0598816-413a-4722-8674-2a0e36477231 1G Sep 28 17:23:55 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:55 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88.f0598816-413a-4722-8674-2a0e36477231 1G" returned: 0 in 0.600s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05df6ea2-4f25-4543-b339-03328090fc88 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88.f0598816-413a-4722-8674-2a0e36477231 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:55 devstack sudo[102573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05df6ea2-4f25-4543-b339-03328090fc88 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88.f0598816-413a-4722-8674-2a0e36477231 Sep 28 17:23:55 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:56 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05df6ea2-4f25-4543-b339-03328090fc88 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88.f0598816-413a-4722-8674-2a0e36477231" returned: 0 in 0.430s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:56 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88.f0598816-413a-4722-8674-2a0e36477231 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:23:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88.f0598816-413a-4722-8674-2a0e36477231 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:56 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88.f0598816-413a-4722-8674-2a0e36477231 Sep 28 17:23:56 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:56 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88.f0598816-413a-4722-8674-2a0e36477231" returned: 0 in 0.339s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:56 devstack sudo[102581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88.info Sep 28 17:23:56 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:57 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88.info" returned: 0 in 0.335s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:57 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:23:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:57 devstack sudo[102584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88.info Sep 28 17:23:57 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:57 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88.info" returned: 0 in 0.313s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.759s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:57 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-0c067238-7830-406e-a01d-89c51bc2b1b5 tempest-GroupSnapshotsTest-671637742 None] group_snapshot 663cd065-79fc-403b-8081-45c7570d6366: created successfully Sep 28 17:23:58 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] group_snapshot 663cd065-79fc-403b-8081-45c7570d6366: deleting Sep 28 17:23:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] group_snapshot 663cd065-79fc-403b-8081-45c7570d6366: deleting {{(pid=86917) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 17:23:58 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] Acquiring lock "cinder-quobyte-ebb04727-3cf5-43b3-8eb8-3df3128b1440" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:58 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] Lock "cinder-quobyte-ebb04727-3cf5-43b3-8eb8-3df3128b1440" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:58 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] Acquiring lock "cinder-quobyte-c00bd84a-77b6-404d-aa03-f938721cb4a9" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:58 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] Lock "cinder-quobyte-c00bd84a-77b6-404d-aa03-f938721cb4a9" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:58 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] Deleting offline snapshot c00bd84a-77b6-404d-aa03-f938721cb4a9 of volume ebb04727-3cf5-43b3-8eb8-3df3128b1440 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:23:58 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] snapshot_file for this snap is: volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440.c00bd84a-77b6-404d-aa03-f938721cb4a9 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:23:58 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0388f7f-fc78-4b58-a8c0-20199193d481]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440.c00bd84a-77b6-404d-aa03-f938721cb4a9 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:58 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440.c00bd84a-77b6-404d-aa03-f938721cb4a9 Sep 28 17:23:58 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:58 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440.c00bd84a-77b6-404d-aa03-f938721cb4a9" returned: 0 in 0.544s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:58 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:23:58 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f35a93d-6dd6-4dd5-8892-71f0e0aaf72f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:58 devstack sudo[102593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440 Sep 28 17:23:58 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:59 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440" returned: 0 in 0.505s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440.c00bd84a-77b6-404d-aa03-f938721cb4a9 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:59 devstack sudo[102599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440.c00bd84a-77b6-404d-aa03-f938721cb4a9 Sep 28 17:23:59 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:59 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440.c00bd84a-77b6-404d-aa03-f938721cb4a9" returned: 0 in 0.602s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440.c00bd84a-77b6-404d-aa03-f938721cb4a9 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:59 devstack sudo[102605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440.c00bd84a-77b6-404d-aa03-f938721cb4a9 Sep 28 17:24:00 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:00 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440.c00bd84a-77b6-404d-aa03-f938721cb4a9" returned: 0 in 0.365s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:00 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] Lock "cinder-quobyte-c00bd84a-77b6-404d-aa03-f938721cb4a9" released by "_delete_snapshot" :: held 2.176s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:00 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] Lock "cinder-quobyte-ebb04727-3cf5-43b3-8eb8-3df3128b1440" released by "delete_snapshot" :: held 2.222s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:00 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] Acquiring lock "cinder-quobyte-05df6ea2-4f25-4543-b339-03328090fc88" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:00 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] Lock "cinder-quobyte-05df6ea2-4f25-4543-b339-03328090fc88" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:00 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] Acquiring lock "cinder-quobyte-f0598816-413a-4722-8674-2a0e36477231" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:00 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] Lock "cinder-quobyte-f0598816-413a-4722-8674-2a0e36477231" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:00 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] Deleting offline snapshot f0598816-413a-4722-8674-2a0e36477231 of volume 05df6ea2-4f25-4543-b339-03328090fc88 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:24:00 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] snapshot_file for this snap is: volume-05df6ea2-4f25-4543-b339-03328090fc88.f0598816-413a-4722-8674-2a0e36477231 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:24:00 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5705aa4-8999-4018-b5e1-2e0422fc76cf]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88.f0598816-413a-4722-8674-2a0e36477231 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:00 devstack sudo[102608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88.f0598816-413a-4722-8674-2a0e36477231 Sep 28 17:24:00 devstack sudo[102608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:01 devstack sudo[102608]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88.f0598816-413a-4722-8674-2a0e36477231" returned: 0 in 0.698s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:01 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05df6ea2-4f25-4543-b339-03328090fc88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:24:01 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e29b2f-6e0f-43cf-8f5a-a7a1c8e3cb56]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:01 devstack sudo[102614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88 Sep 28 17:24:01 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:01 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88" returned: 0 in 0.541s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88.f0598816-413a-4722-8674-2a0e36477231 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:01 devstack sudo[102620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88.f0598816-413a-4722-8674-2a0e36477231 Sep 28 17:24:01 devstack sudo[102620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:02 devstack sudo[102620]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88.f0598816-413a-4722-8674-2a0e36477231" returned: 0 in 0.507s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88.f0598816-413a-4722-8674-2a0e36477231 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:02 devstack sudo[102626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88.f0598816-413a-4722-8674-2a0e36477231 Sep 28 17:24:02 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:02 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88.f0598816-413a-4722-8674-2a0e36477231" returned: 0 in 0.348s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:02 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] Lock "cinder-quobyte-f0598816-413a-4722-8674-2a0e36477231" released by "_delete_snapshot" :: held 2.283s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:02 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] Lock "cinder-quobyte-05df6ea2-4f25-4543-b339-03328090fc88" released by "delete_snapshot" :: held 2.323s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:02 devstack cinder-volume[86917]: WARNING cinder.quota [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-784253829 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-784253829, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:24:02 devstack cinder-volume[86917]: WARNING cinder.quota [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-784253829 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-784253829, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:24:02 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] Created reservations ['17b1278c-11de-4f12-8d2e-e31386b38159', '4ad28588-5c32-42a5-b74e-7ca44c6fb03d', '38588bc7-28c3-40ca-824a-9819a0cbeeb5', '9dbbce02-ee77-4973-a1fc-2393c7e24c18'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:03 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] Created reservations ['2c7f5a78-6876-415e-b37f-6a9e5baa2b4a', '705a612d-b579-46b3-89de-107aefcdaae8', 'a3dcb338-5694-4b90-a3b4-d0d8960f06ea', 'ad803da0-1d7d-4957-9bbe-42489ce870b3'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:03 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-01b8c41a-cbe4-48cc-a8d0-86086b545411 tempest-GroupSnapshotsTest-671637742 None] group_snapshot 663cd065-79fc-403b-8081-45c7570d6366: deleted successfully Sep 28 17:24:04 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e15cd953-3cce-4e31-a22e-4efefa36ea41 tempest-GroupSnapshotsTest-671637742 None] Acquiring lock "cinder-quobyte-05df6ea2-4f25-4543-b339-03328090fc88" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:04 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e15cd953-3cce-4e31-a22e-4efefa36ea41 tempest-GroupSnapshotsTest-671637742 None] Lock "cinder-quobyte-05df6ea2-4f25-4543-b339-03328090fc88" acquired by "delete_volume" :: waited 0.021s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:04 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4341db59-af99-4f52-9e5b-f771ae951907]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e15cd953-3cce-4e31-a22e-4efefa36ea41 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:04 devstack sudo[102630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88 Sep 28 17:24:04 devstack sudo[102630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:05 devstack sudo[102630]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e15cd953-3cce-4e31-a22e-4efefa36ea41 tempest-GroupSnapshotsTest-671637742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88" returned: 0 in 0.546s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e15cd953-3cce-4e31-a22e-4efefa36ea41 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:05 devstack sudo[102637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88 Sep 28 17:24:05 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:05 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e15cd953-3cce-4e31-a22e-4efefa36ea41 tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-05df6ea2-4f25-4543-b339-03328090fc88" returned: 0 in 0.313s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:05 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e15cd953-3cce-4e31-a22e-4efefa36ea41 tempest-GroupSnapshotsTest-671637742 None] Lock "cinder-quobyte-05df6ea2-4f25-4543-b339-03328090fc88" released by "delete_volume" :: held 1.002s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:05 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e15cd953-3cce-4e31-a22e-4efefa36ea41 tempest-GroupSnapshotsTest-671637742 None] Acquiring lock "cinder-quobyte-ebb04727-3cf5-43b3-8eb8-3df3128b1440" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:05 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e15cd953-3cce-4e31-a22e-4efefa36ea41 tempest-GroupSnapshotsTest-671637742 None] Lock "cinder-quobyte-ebb04727-3cf5-43b3-8eb8-3df3128b1440" acquired by "delete_volume" :: waited 0.017s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:05 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb4fa0c-ca7c-4e7f-ae70-60a8a2d9d3f6]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e15cd953-3cce-4e31-a22e-4efefa36ea41 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:05 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440 Sep 28 17:24:05 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:06 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e15cd953-3cce-4e31-a22e-4efefa36ea41 tempest-GroupSnapshotsTest-671637742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440" returned: 0 in 0.561s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e15cd953-3cce-4e31-a22e-4efefa36ea41 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:06 devstack sudo[102645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440 Sep 28 17:24:06 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:06 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e15cd953-3cce-4e31-a22e-4efefa36ea41 tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ebb04727-3cf5-43b3-8eb8-3df3128b1440" returned: 0 in 0.475s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:06 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e15cd953-3cce-4e31-a22e-4efefa36ea41 tempest-GroupSnapshotsTest-671637742 None] Lock "cinder-quobyte-ebb04727-3cf5-43b3-8eb8-3df3128b1440" released by "delete_volume" :: held 1.123s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:06 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-e15cd953-3cce-4e31-a22e-4efefa36ea41 tempest-GroupSnapshotsTest-671637742 None] Created reservations ['7912a7a6-2f39-42aa-93b7-162ace31695d'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:06 devstack cinder-volume[86917]: WARNING cinder.quota [None req-e15cd953-3cce-4e31-a22e-4efefa36ea41 tempest-GroupSnapshotsTest-671637742 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-784253829 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-784253829, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:24:06 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-e15cd953-3cce-4e31-a22e-4efefa36ea41 tempest-GroupSnapshotsTest-671637742 None] Created reservations ['5be4e62a-447c-4e6c-b978-4ac5fc1caeef', 'bf5484bb-a4d5-4dd0-a84d-1cdbcbbc5a14', '54fb970c-cf23-48e6-a98e-6a6215ff81d8', 'ba923619-6d8a-414f-ac72-39ef27098bf9'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:07 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-e15cd953-3cce-4e31-a22e-4efefa36ea41 tempest-GroupSnapshotsTest-671637742 None] Created reservations ['0e9cccce-734f-4b13-ae72-4f24f3b71645', '1b2b5495-8cc7-47d6-86e0-f267a53f6478', '8caa2669-00aa-47a9-b420-be106214d32b', '1b7e60af-e728-47c0-bb14-cf0b6370e58b'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e15cd953-3cce-4e31-a22e-4efefa36ea41 tempest-GroupSnapshotsTest-671637742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e15cd953-3cce-4e31-a22e-4efefa36ea41 tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:07 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-e15cd953-3cce-4e31-a22e-4efefa36ea41 tempest-GroupSnapshotsTest-671637742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:07 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-e15cd953-3cce-4e31-a22e-4efefa36ea41 tempest-GroupSnapshotsTest-671637742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e15cd953-3cce-4e31-a22e-4efefa36ea41 tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e15cd953-3cce-4e31-a22e-4efefa36ea41 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:07 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:24:07 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:07 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e15cd953-3cce-4e31-a22e-4efefa36ea41 tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.317s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:07 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-e15cd953-3cce-4e31-a22e-4efefa36ea41 tempest-GroupSnapshotsTest-671637742 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:24:07 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-e15cd953-3cce-4e31-a22e-4efefa36ea41 tempest-GroupSnapshotsTest-671637742 None] Delete group completed successfully. Sep 28 17:24:08 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-a941a400-4e3a-4b3c-aa2f-ffe74568a730 tempest-GroupSnapshotsTest-671637742 None] Group tempest-GroupSnapshotsTest-Group-1242123822: creating Sep 28 17:24:09 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-a941a400-4e3a-4b3c-aa2f-ffe74568a730 tempest-GroupSnapshotsTest-671637742 None] Group tempest-GroupSnapshotsTest-Group-1242123822: created successfully Sep 28 17:24:09 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-a941a400-4e3a-4b3c-aa2f-ffe74568a730 tempest-GroupSnapshotsTest-671637742 None] Create group completed successfully. Sep 28 17:24:11 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cd1bcba-34bf-4172-b260-0d23d41cb6dc tempest-GroupSnapshotsTest-671637742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:24:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3cd1bcba-34bf-4172-b260-0d23d41cb6dc tempest-GroupSnapshotsTest-671637742 None] Flow 'volume_create_manager' (6eddd1d8-80f3-4257-a9ee-d1524b3bba58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3cd1bcba-34bf-4172-b260-0d23d41cb6dc tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf3384c-2cda-43b3-ad96-716adf95fc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3cd1bcba-34bf-4172-b260-0d23d41cb6dc tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf3384c-2cda-43b3-ad96-716adf95fc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-228719188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7420d07-d5a2-45c4-acf7-e43837b257ea,host='devstack@QuobyteHD#QuobyteHD',id=2fa4b052-7b5f-4fc2-b398-892555cc2e7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ba7cf50f4184c46851f2a0510f15455',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:11Z,use_quota=True,user_id='bb7762a6fc5747639e5b15739f8009aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b11884b-f785-4739-93a0-06cfb17c49c6),volume_type_id=8b11884b-f785-4739-93a0-06cfb17c49c6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3cd1bcba-34bf-4172-b260-0d23d41cb6dc tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d960dd1c-e3e1-4af8-8f5c-8645e005a774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3cd1bcba-34bf-4172-b260-0d23d41cb6dc tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d960dd1c-e3e1-4af8-8f5c-8645e005a774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3cd1bcba-34bf-4172-b260-0d23d41cb6dc tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8968959-7995-4b92-a20c-41075a6ce761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3cd1bcba-34bf-4172-b260-0d23d41cb6dc tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8968959-7995-4b92-a20c-41075a6ce761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fa4b052-7b5f-4fc2-b398-892555cc2e7d', 'volume_name': 'volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3cd1bcba-34bf-4172-b260-0d23d41cb6dc tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34b6b7d-cd98-40ab-b766-83e15ae279d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3cd1bcba-34bf-4172-b260-0d23d41cb6dc tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34b6b7d-cd98-40ab-b766-83e15ae279d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3cd1bcba-34bf-4172-b260-0d23d41cb6dc tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7520f81-6b88-419e-b921-7b7fd3c989e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:11 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-3cd1bcba-34bf-4172-b260-0d23d41cb6dc tempest-GroupSnapshotsTest-671637742 None] Volume 2fa4b052-7b5f-4fc2-b398-892555cc2e7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d', 'volume_size': 1} Sep 28 17:24:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3cd1bcba-34bf-4172-b260-0d23d41cb6dc tempest-GroupSnapshotsTest-671637742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3cd1bcba-34bf-4172-b260-0d23d41cb6dc tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-3cd1bcba-34bf-4172-b260-0d23d41cb6dc tempest-GroupSnapshotsTest-671637742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f7420d07-d5a2-45c4-acf7-e43837b257ea,created_at=2026-09-28T15:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-228719188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7420d07-d5a2-45c4-acf7-e43837b257ea,host='devstack@QuobyteHD#QuobyteHD',id=2fa4b052-7b5f-4fc2-b398-892555cc2e7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ba7cf50f4184c46851f2a0510f15455',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:11Z,use_quota=True,user_id='bb7762a6fc5747639e5b15739f8009aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b11884b-f785-4739-93a0-06cfb17c49c6),volume_type_id=8b11884b-f785-4739-93a0-06cfb17c49c6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:24:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-3cd1bcba-34bf-4172-b260-0d23d41cb6dc tempest-GroupSnapshotsTest-671637742 None] Creating volume 2fa4b052-7b5f-4fc2-b398-892555cc2e7d {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:24:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3cd1bcba-34bf-4172-b260-0d23d41cb6dc tempest-GroupSnapshotsTest-671637742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3cd1bcba-34bf-4172-b260-0d23d41cb6dc tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-3cd1bcba-34bf-4172-b260-0d23d41cb6dc tempest-GroupSnapshotsTest-671637742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-3cd1bcba-34bf-4172-b260-0d23d41cb6dc tempest-GroupSnapshotsTest-671637742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3cd1bcba-34bf-4172-b260-0d23d41cb6dc tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-3cd1bcba-34bf-4172-b260-0d23d41cb6dc tempest-GroupSnapshotsTest-671637742 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:24:11 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-3cd1bcba-34bf-4172-b260-0d23d41cb6dc tempest-GroupSnapshotsTest-671637742 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:24:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3cd1bcba-34bf-4172-b260-0d23d41cb6dc tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:11 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d 1073741824 Sep 28 17:24:11 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:11 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3cd1bcba-34bf-4172-b260-0d23d41cb6dc tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d 1073741824" returned: 0 in 0.666s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3cd1bcba-34bf-4172-b260-0d23d41cb6dc tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:11 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d Sep 28 17:24:11 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:12 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3cd1bcba-34bf-4172-b260-0d23d41cb6dc tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d" returned: 0 in 0.372s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:12 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-3cd1bcba-34bf-4172-b260-0d23d41cb6dc tempest-GroupSnapshotsTest-671637742 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:24:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3cd1bcba-34bf-4172-b260-0d23d41cb6dc tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3cd1bcba-34bf-4172-b260-0d23d41cb6dc tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7520f81-6b88-419e-b921-7b7fd3c989e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3cd1bcba-34bf-4172-b260-0d23d41cb6dc tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a1910a-e000-4be8-a9b3-3c2f5cc75e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:12 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-3cd1bcba-34bf-4172-b260-0d23d41cb6dc tempest-GroupSnapshotsTest-671637742 None] Volume volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d (2fa4b052-7b5f-4fc2-b398-892555cc2e7d): created successfully Sep 28 17:24:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3cd1bcba-34bf-4172-b260-0d23d41cb6dc tempest-GroupSnapshotsTest-671637742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a1910a-e000-4be8-a9b3-3c2f5cc75e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3cd1bcba-34bf-4172-b260-0d23d41cb6dc tempest-GroupSnapshotsTest-671637742 None] Flow 'volume_create_manager' (6eddd1d8-80f3-4257-a9ee-d1524b3bba58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:12 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-3cd1bcba-34bf-4172-b260-0d23d41cb6dc tempest-GroupSnapshotsTest-671637742 None] Created volume successfully. Sep 28 17:24:14 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c39b3f9-04a5-4ea1-92a3-f5a6b5cf790f tempest-SnapshotDependencyTests-2113544921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:24:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5c39b3f9-04a5-4ea1-92a3-f5a6b5cf790f tempest-SnapshotDependencyTests-2113544921 None] Flow 'volume_create_manager' (e92cd0e7-e36f-4798-9275-27cc892c6250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5c39b3f9-04a5-4ea1-92a3-f5a6b5cf790f tempest-SnapshotDependencyTests-2113544921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c13cbc3-55c3-49e8-8534-41a6c2770045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5c39b3f9-04a5-4ea1-92a3-f5a6b5cf790f tempest-SnapshotDependencyTests-2113544921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c13cbc3-55c3-49e8-8534-41a6c2770045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1255793357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='395482fa3232466b8ca81c9f46818be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:14Z,use_quota=True,user_id='c91805312969431bbf673019de49f365',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5c39b3f9-04a5-4ea1-92a3-f5a6b5cf790f tempest-SnapshotDependencyTests-2113544921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (631774d6-8f5e-4187-812e-c598427d556f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5c39b3f9-04a5-4ea1-92a3-f5a6b5cf790f tempest-SnapshotDependencyTests-2113544921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (631774d6-8f5e-4187-812e-c598427d556f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5c39b3f9-04a5-4ea1-92a3-f5a6b5cf790f tempest-SnapshotDependencyTests-2113544921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e30535-bdf8-498d-9fb2-7aa44cac86e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5c39b3f9-04a5-4ea1-92a3-f5a6b5cf790f tempest-SnapshotDependencyTests-2113544921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e30535-bdf8-498d-9fb2-7aa44cac86e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c', 'volume_name': 'volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5c39b3f9-04a5-4ea1-92a3-f5a6b5cf790f tempest-SnapshotDependencyTests-2113544921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e21aefb-c56d-4682-a834-14cfbb792146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5c39b3f9-04a5-4ea1-92a3-f5a6b5cf790f tempest-SnapshotDependencyTests-2113544921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e21aefb-c56d-4682-a834-14cfbb792146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5c39b3f9-04a5-4ea1-92a3-f5a6b5cf790f tempest-SnapshotDependencyTests-2113544921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74562d1c-a375-473e-9fdf-71715f6e38b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:14 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-5c39b3f9-04a5-4ea1-92a3-f5a6b5cf790f tempest-SnapshotDependencyTests-2113544921 None] Volume fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c', 'volume_size': 1} Sep 28 17:24:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5c39b3f9-04a5-4ea1-92a3-f5a6b5cf790f tempest-SnapshotDependencyTests-2113544921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5c39b3f9-04a5-4ea1-92a3-f5a6b5cf790f tempest-SnapshotDependencyTests-2113544921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:14 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-5c39b3f9-04a5-4ea1-92a3-f5a6b5cf790f tempest-SnapshotDependencyTests-2113544921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1255793357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='395482fa3232466b8ca81c9f46818be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:14Z,use_quota=True,user_id='c91805312969431bbf673019de49f365',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:24:14 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-5c39b3f9-04a5-4ea1-92a3-f5a6b5cf790f tempest-SnapshotDependencyTests-2113544921 None] Creating volume fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:24:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5c39b3f9-04a5-4ea1-92a3-f5a6b5cf790f tempest-SnapshotDependencyTests-2113544921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5c39b3f9-04a5-4ea1-92a3-f5a6b5cf790f tempest-SnapshotDependencyTests-2113544921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:14 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-5c39b3f9-04a5-4ea1-92a3-f5a6b5cf790f tempest-SnapshotDependencyTests-2113544921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:14 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-5c39b3f9-04a5-4ea1-92a3-f5a6b5cf790f tempest-SnapshotDependencyTests-2113544921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5c39b3f9-04a5-4ea1-92a3-f5a6b5cf790f tempest-SnapshotDependencyTests-2113544921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:14 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-5c39b3f9-04a5-4ea1-92a3-f5a6b5cf790f tempest-SnapshotDependencyTests-2113544921 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:24:14 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-5c39b3f9-04a5-4ea1-92a3-f5a6b5cf790f tempest-SnapshotDependencyTests-2113544921 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:24:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5c39b3f9-04a5-4ea1-92a3-f5a6b5cf790f tempest-SnapshotDependencyTests-2113544921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:14 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-84036aec-a283-478f-b365-bdc5a1fa6526 tempest-GroupSnapshotsTest-671637742 None] GroupSnapshot 46871132-e2b1-42d6-a5fd-e8f89c7f2f2a: creating. Sep 28 17:24:14 devstack sudo[102665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c 1073741824 Sep 28 17:24:14 devstack sudo[102665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-84036aec-a283-478f-b365-bdc5a1fa6526 tempest-GroupSnapshotsTest-671637742 None] Group snapshot 46871132-e2b1-42d6-a5fd-e8f89c7f2f2a: creating. {{(pid=86917) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 17:24:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-84036aec-a283-478f-b365-bdc5a1fa6526 tempest-GroupSnapshotsTest-671637742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:14 devstack sudo[102665]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5c39b3f9-04a5-4ea1-92a3-f5a6b5cf790f tempest-SnapshotDependencyTests-2113544921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c 1073741824" returned: 0 in 0.682s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5c39b3f9-04a5-4ea1-92a3-f5a6b5cf790f tempest-SnapshotDependencyTests-2113544921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:15 devstack sudo[102671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c Sep 28 17:24:15 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:15 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5c39b3f9-04a5-4ea1-92a3-f5a6b5cf790f tempest-SnapshotDependencyTests-2113544921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c" returned: 0 in 0.285s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:15 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-5c39b3f9-04a5-4ea1-92a3-f5a6b5cf790f tempest-SnapshotDependencyTests-2113544921 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:24:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5c39b3f9-04a5-4ea1-92a3-f5a6b5cf790f tempest-SnapshotDependencyTests-2113544921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-84036aec-a283-478f-b365-bdc5a1fa6526 tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.884s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5c39b3f9-04a5-4ea1-92a3-f5a6b5cf790f tempest-SnapshotDependencyTests-2113544921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74562d1c-a375-473e-9fdf-71715f6e38b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5c39b3f9-04a5-4ea1-92a3-f5a6b5cf790f tempest-SnapshotDependencyTests-2113544921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a34c2c-8322-4667-97b2-7346f21f24fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:15 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-84036aec-a283-478f-b365-bdc5a1fa6526 tempest-GroupSnapshotsTest-671637742 None] Creating offline snapshot 181dcf89-7b5b-4901-8c8e-8556c45692bf of volume 2fa4b052-7b5f-4fc2-b398-892555cc2e7d {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:24:15 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-5c39b3f9-04a5-4ea1-92a3-f5a6b5cf790f tempest-SnapshotDependencyTests-2113544921 None] Volume volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c (fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c): created successfully Sep 28 17:24:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5c39b3f9-04a5-4ea1-92a3-f5a6b5cf790f tempest-SnapshotDependencyTests-2113544921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a34c2c-8322-4667-97b2-7346f21f24fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-5c39b3f9-04a5-4ea1-92a3-f5a6b5cf790f tempest-SnapshotDependencyTests-2113544921 None] Flow 'volume_create_manager' (e92cd0e7-e36f-4798-9275-27cc892c6250) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:15 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d0cd98-bc4d-4646-b742-a127be20bc19]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-84036aec-a283-478f-b365-bdc5a1fa6526 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:15 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-5c39b3f9-04a5-4ea1-92a3-f5a6b5cf790f tempest-SnapshotDependencyTests-2113544921 None] Created volume successfully. Sep 28 17:24:15 devstack sudo[102674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d Sep 28 17:24:15 devstack sudo[102674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:15 devstack sudo[102674]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-84036aec-a283-478f-b365-bdc5a1fa6526 tempest-GroupSnapshotsTest-671637742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d" returned: 0 in 0.523s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-84036aec-a283-478f-b365-bdc5a1fa6526 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d.181dcf89-7b5b-4901-8c8e-8556c45692bf 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:15 devstack sudo[102679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d.181dcf89-7b5b-4901-8c8e-8556c45692bf 1G Sep 28 17:24:15 devstack sudo[102679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6147c8ca-bf77-4304-8f16-afcb0e000a74 tempest-SnapshotDependencyTests-2113544921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:16 devstack sudo[102679]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-84036aec-a283-478f-b365-bdc5a1fa6526 tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d.181dcf89-7b5b-4901-8c8e-8556c45692bf 1G" returned: 0 in 0.608s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-84036aec-a283-478f-b365-bdc5a1fa6526 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d.181dcf89-7b5b-4901-8c8e-8556c45692bf {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:16 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d.181dcf89-7b5b-4901-8c8e-8556c45692bf Sep 28 17:24:16 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:16 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-84036aec-a283-478f-b365-bdc5a1fa6526 tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d.181dcf89-7b5b-4901-8c8e-8556c45692bf" returned: 0 in 0.384s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:16 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-84036aec-a283-478f-b365-bdc5a1fa6526 tempest-GroupSnapshotsTest-671637742 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d.181dcf89-7b5b-4901-8c8e-8556c45692bf is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:24:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-84036aec-a283-478f-b365-bdc5a1fa6526 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d.181dcf89-7b5b-4901-8c8e-8556c45692bf {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:16 devstack sudo[102691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d.181dcf89-7b5b-4901-8c8e-8556c45692bf Sep 28 17:24:16 devstack sudo[102691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:17 devstack sudo[102691]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-84036aec-a283-478f-b365-bdc5a1fa6526 tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d.181dcf89-7b5b-4901-8c8e-8556c45692bf" returned: 0 in 0.334s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-84036aec-a283-478f-b365-bdc5a1fa6526 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:17 devstack sudo[102694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d.info Sep 28 17:24:17 devstack sudo[102694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:17 devstack sudo[102694]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-84036aec-a283-478f-b365-bdc5a1fa6526 tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d.info" returned: 0 in 0.392s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:17 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-84036aec-a283-478f-b365-bdc5a1fa6526 tempest-GroupSnapshotsTest-671637742 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:24:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-84036aec-a283-478f-b365-bdc5a1fa6526 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:17 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d.info Sep 28 17:24:17 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:17 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-84036aec-a283-478f-b365-bdc5a1fa6526 tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d.info" returned: 0 in 0.313s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-84036aec-a283-478f-b365-bdc5a1fa6526 tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.696s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6147c8ca-bf77-4304-8f16-afcb0e000a74 tempest-SnapshotDependencyTests-2113544921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.601s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:17 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-6147c8ca-bf77-4304-8f16-afcb0e000a74 tempest-SnapshotDependencyTests-2113544921 None] Creating offline snapshot c745eb60-0c32-409c-adcb-312ccbec680b of volume fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:24:18 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5e6ad6-b5be-4143-873b-1d5af0dc0d18]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6147c8ca-bf77-4304-8f16-afcb0e000a74 tempest-SnapshotDependencyTests-2113544921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:18 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-84036aec-a283-478f-b365-bdc5a1fa6526 tempest-GroupSnapshotsTest-671637742 None] group_snapshot 46871132-e2b1-42d6-a5fd-e8f89c7f2f2a: created successfully Sep 28 17:24:18 devstack sudo[102700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c Sep 28 17:24:18 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:18 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6147c8ca-bf77-4304-8f16-afcb0e000a74 tempest-SnapshotDependencyTests-2113544921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c" returned: 0 in 0.494s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6147c8ca-bf77-4304-8f16-afcb0e000a74 tempest-SnapshotDependencyTests-2113544921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c.c745eb60-0c32-409c-adcb-312ccbec680b 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:18 devstack sudo[102711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c.c745eb60-0c32-409c-adcb-312ccbec680b 1G Sep 28 17:24:18 devstack sudo[102711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:18 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-63ef75a6-6da9-4564-a6f4-195729741ccb tempest-GroupSnapshotsTest-671637742 None] group_snapshot 46871132-e2b1-42d6-a5fd-e8f89c7f2f2a: deleting Sep 28 17:24:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-63ef75a6-6da9-4564-a6f4-195729741ccb tempest-GroupSnapshotsTest-671637742 None] group_snapshot 46871132-e2b1-42d6-a5fd-e8f89c7f2f2a: deleting {{(pid=86917) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 17:24:18 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-63ef75a6-6da9-4564-a6f4-195729741ccb tempest-GroupSnapshotsTest-671637742 None] Acquiring lock "cinder-quobyte-2fa4b052-7b5f-4fc2-b398-892555cc2e7d" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:18 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-63ef75a6-6da9-4564-a6f4-195729741ccb tempest-GroupSnapshotsTest-671637742 None] Lock "cinder-quobyte-2fa4b052-7b5f-4fc2-b398-892555cc2e7d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:18 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-63ef75a6-6da9-4564-a6f4-195729741ccb tempest-GroupSnapshotsTest-671637742 None] Acquiring lock "cinder-quobyte-181dcf89-7b5b-4901-8c8e-8556c45692bf" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:18 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-63ef75a6-6da9-4564-a6f4-195729741ccb tempest-GroupSnapshotsTest-671637742 None] Lock "cinder-quobyte-181dcf89-7b5b-4901-8c8e-8556c45692bf" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-63ef75a6-6da9-4564-a6f4-195729741ccb tempest-GroupSnapshotsTest-671637742 None] Deleting offline snapshot 181dcf89-7b5b-4901-8c8e-8556c45692bf of volume 2fa4b052-7b5f-4fc2-b398-892555cc2e7d {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:24:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-63ef75a6-6da9-4564-a6f4-195729741ccb tempest-GroupSnapshotsTest-671637742 None] snapshot_file for this snap is: volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d.181dcf89-7b5b-4901-8c8e-8556c45692bf {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:24:18 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc930481-a2e6-4c59-bdb4-1cbdae2c713b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-63ef75a6-6da9-4564-a6f4-195729741ccb tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d.181dcf89-7b5b-4901-8c8e-8556c45692bf {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:19 devstack sudo[102711]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6147c8ca-bf77-4304-8f16-afcb0e000a74 tempest-SnapshotDependencyTests-2113544921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c.c745eb60-0c32-409c-adcb-312ccbec680b 1G" returned: 0 in 0.634s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6147c8ca-bf77-4304-8f16-afcb0e000a74 tempest-SnapshotDependencyTests-2113544921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c.c745eb60-0c32-409c-adcb-312ccbec680b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:19 devstack sudo[102716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d.181dcf89-7b5b-4901-8c8e-8556c45692bf Sep 28 17:24:19 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:19 devstack sudo[102717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c.c745eb60-0c32-409c-adcb-312ccbec680b Sep 28 17:24:19 devstack sudo[102717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:19 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-63ef75a6-6da9-4564-a6f4-195729741ccb tempest-GroupSnapshotsTest-671637742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d.181dcf89-7b5b-4901-8c8e-8556c45692bf" returned: 0 in 0.493s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-63ef75a6-6da9-4564-a6f4-195729741ccb tempest-GroupSnapshotsTest-671637742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:24:19 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[357f133b-5bbd-4f54-8325-cd682e63618c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-63ef75a6-6da9-4564-a6f4-195729741ccb tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:19 devstack sudo[102717]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6147c8ca-bf77-4304-8f16-afcb0e000a74 tempest-SnapshotDependencyTests-2113544921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c.c745eb60-0c32-409c-adcb-312ccbec680b" returned: 0 in 0.429s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:19 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-6147c8ca-bf77-4304-8f16-afcb0e000a74 tempest-SnapshotDependencyTests-2113544921 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c.c745eb60-0c32-409c-adcb-312ccbec680b is being set with open permissions: ugo+rw Sep 28 17:24:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6147c8ca-bf77-4304-8f16-afcb0e000a74 tempest-SnapshotDependencyTests-2113544921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c.c745eb60-0c32-409c-adcb-312ccbec680b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:19 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c.c745eb60-0c32-409c-adcb-312ccbec680b Sep 28 17:24:19 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:19 devstack sudo[102728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d Sep 28 17:24:19 devstack sudo[102728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:19 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6147c8ca-bf77-4304-8f16-afcb0e000a74 tempest-SnapshotDependencyTests-2113544921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c.c745eb60-0c32-409c-adcb-312ccbec680b" returned: 0 in 0.331s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6147c8ca-bf77-4304-8f16-afcb0e000a74 tempest-SnapshotDependencyTests-2113544921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:19 devstack sudo[102736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c.info Sep 28 17:24:19 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:20 devstack sudo[102728]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-63ef75a6-6da9-4564-a6f4-195729741ccb tempest-GroupSnapshotsTest-671637742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d" returned: 0 in 0.509s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-63ef75a6-6da9-4564-a6f4-195729741ccb tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d.181dcf89-7b5b-4901-8c8e-8556c45692bf {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:20 devstack sudo[102738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d.181dcf89-7b5b-4901-8c8e-8556c45692bf Sep 28 17:24:20 devstack sudo[102738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:20 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6147c8ca-bf77-4304-8f16-afcb0e000a74 tempest-SnapshotDependencyTests-2113544921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c.info" returned: 0 in 0.343s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:20 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-6147c8ca-bf77-4304-8f16-afcb0e000a74 tempest-SnapshotDependencyTests-2113544921 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c.info is being set with open permissions: ugo+rw Sep 28 17:24:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6147c8ca-bf77-4304-8f16-afcb0e000a74 tempest-SnapshotDependencyTests-2113544921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:20 devstack sudo[102741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c.info Sep 28 17:24:20 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:20 devstack sudo[102738]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-63ef75a6-6da9-4564-a6f4-195729741ccb tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d.181dcf89-7b5b-4901-8c8e-8556c45692bf" returned: 0 in 0.473s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-63ef75a6-6da9-4564-a6f4-195729741ccb tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d.181dcf89-7b5b-4901-8c8e-8556c45692bf {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:20 devstack sudo[102746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d.181dcf89-7b5b-4901-8c8e-8556c45692bf Sep 28 17:24:20 devstack sudo[102746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:20 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6147c8ca-bf77-4304-8f16-afcb0e000a74 tempest-SnapshotDependencyTests-2113544921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c.info" returned: 0 in 0.385s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6147c8ca-bf77-4304-8f16-afcb0e000a74 tempest-SnapshotDependencyTests-2113544921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.754s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:20 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-6147c8ca-bf77-4304-8f16-afcb0e000a74 tempest-SnapshotDependencyTests-2113544921 None] Create snapshot completed successfully Sep 28 17:24:20 devstack sudo[102746]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-63ef75a6-6da9-4564-a6f4-195729741ccb tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d.181dcf89-7b5b-4901-8c8e-8556c45692bf" returned: 0 in 0.330s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:20 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-63ef75a6-6da9-4564-a6f4-195729741ccb tempest-GroupSnapshotsTest-671637742 None] Lock "cinder-quobyte-181dcf89-7b5b-4901-8c8e-8556c45692bf" released by "_delete_snapshot" :: held 1.958s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:20 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-63ef75a6-6da9-4564-a6f4-195729741ccb tempest-GroupSnapshotsTest-671637742 None] Lock "cinder-quobyte-2fa4b052-7b5f-4fc2-b398-892555cc2e7d" released by "delete_snapshot" :: held 1.994s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:20 devstack cinder-volume[86917]: WARNING cinder.quota [None req-63ef75a6-6da9-4564-a6f4-195729741ccb tempest-GroupSnapshotsTest-671637742 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-597725899 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-597725899, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:24:20 devstack cinder-volume[86917]: WARNING cinder.quota [None req-63ef75a6-6da9-4564-a6f4-195729741ccb tempest-GroupSnapshotsTest-671637742 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-597725899 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-597725899, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:24:21 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-63ef75a6-6da9-4564-a6f4-195729741ccb tempest-GroupSnapshotsTest-671637742 None] Created reservations ['9e774099-d9b9-406b-b8f5-883d672f6a95', 'efb93434-f63e-42d2-a5d7-22c5eeba8e13', '87908b6e-d866-41d0-8d0a-64d8e206701d', 'bf9f0995-8826-41ca-92f9-7148d87aba53'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:21 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-63ef75a6-6da9-4564-a6f4-195729741ccb tempest-GroupSnapshotsTest-671637742 None] group_snapshot 46871132-e2b1-42d6-a5fd-e8f89c7f2f2a: deleted successfully Sep 28 17:24:21 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-afedb47a-544c-46bc-8659-2c5c02405090 tempest-GroupSnapshotsTest-671637742 None] Acquiring lock "cinder-quobyte-2fa4b052-7b5f-4fc2-b398-892555cc2e7d" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:21 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-afedb47a-544c-46bc-8659-2c5c02405090 tempest-GroupSnapshotsTest-671637742 None] Lock "cinder-quobyte-2fa4b052-7b5f-4fc2-b398-892555cc2e7d" acquired by "delete_volume" :: waited 0.035s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:21 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f26b011-39a8-40f0-823c-f6719fbfd3a5]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-afedb47a-544c-46bc-8659-2c5c02405090 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:21 devstack sudo[102751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d Sep 28 17:24:21 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:21 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:24:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Flow 'volume_create_manager' (b950372c-86aa-4f64-8886-ac96b6d4bca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ca40db-d1c9-4c45-804a-7d9b80038a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ca40db-d1c9-4c45-804a-7d9b80038a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09266e44-b628-4efd-bc3d-48da63f080e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae24a6aeb4b246a99124858e171016e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:22Z,use_quota=True,user_id='2a7dc7387928472ba473e2876fbdcd37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc84cd59-8ad2-439a-93f3-b97854e31a2b),volume_type_id=cc84cd59-8ad2-439a-93f3-b97854e31a2b)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce260b50-20e0-479b-a7aa-e819376e996e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce260b50-20e0-479b-a7aa-e819376e996e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b0ef420-b14d-4243-854f-2c5053c816f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:21 devstack cinder-volume[86917]: DEBUG cinder.image.glance [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Creating Keystone auth plugin from conf {{(pid=86917) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:24:22 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-afedb47a-544c-46bc-8659-2c5c02405090 tempest-GroupSnapshotsTest-671637742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d" returned: 0 in 0.505s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-afedb47a-544c-46bc-8659-2c5c02405090 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b0ef420-b14d-4243-854f-2c5053c816f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '09266e44-b628-4efd-bc3d-48da63f080e4', 'volume_name': 'volume-09266e44-b628-4efd-bc3d-48da63f080e4', 'volume_size': 1, 'image_id': 'c4c72e4a-67d2-4523-84c3-367f382992e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c4c72e4a-67d2-4523-84c3-367f382992e0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e68feaa483bfcaa7e36da45e480a4b75', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ae24a6aeb4b246a99124858e171016e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5eecf220868b75cd4567214bcd8bdb1f96f20f9974e8a65a5d42d23faa08d7f3b7ac4b175e2c0974ae8ce31b1a0bec5fbdd52783dc777f7b686db9bc05cc8a00', 'id': 'c4c72e4a-67d2-4523-84c3-367f382992e0', 'created_at': datetime.datetime(2026, 9, 28, 15, 24, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 24, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c4c72e4a-67d2-4523-84c3-367f382992e0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab56373-f71b-4747-a452-0be6c4693df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:22 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d Sep 28 17:24:22 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab56373-f71b-4747-a452-0be6c4693df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d988592-9cee-4f0d-97df-870cf6a8b0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:22 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Volume 09266e44-b628-4efd-bc3d-48da63f080e4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-09266e44-b628-4efd-bc3d-48da63f080e4', 'volume_size': 1, 'image_id': 'c4c72e4a-67d2-4523-84c3-367f382992e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c4c72e4a-67d2-4523-84c3-367f382992e0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e68feaa483bfcaa7e36da45e480a4b75', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ae24a6aeb4b246a99124858e171016e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5eecf220868b75cd4567214bcd8bdb1f96f20f9974e8a65a5d42d23faa08d7f3b7ac4b175e2c0974ae8ce31b1a0bec5fbdd52783dc777f7b686db9bc05cc8a00', 'id': 'c4c72e4a-67d2-4523-84c3-367f382992e0', 'created_at': datetime.datetime(2026, 9, 28, 15, 24, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 24, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c4c72e4a-67d2-4523-84c3-367f382992e0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Trying to clone 09266e44-b628-4efd-bc3d-48da63f080e4 from image c4c72e4a-67d2-4523-84c3-367f382992e0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c4c72e4a-67d2-4523-84c3-367f382992e0', 'metadata': {}}]). {{(pid=86917) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c4c72e4a-67d2-4523-84c3-367f382992e0_ol_9dnzudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86917) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:24:22 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Image download 0.00 MB at 0.00 MB/s Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd67e21f-4013-4caf-a20d-ff0a7888bfa1]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4c72e4a-67d2-4523-84c3-367f382992e0_ol_9dnzudevstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:22 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-afedb47a-544c-46bc-8659-2c5c02405090 tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2fa4b052-7b5f-4fc2-b398-892555cc2e7d" returned: 0 in 0.391s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-afedb47a-544c-46bc-8659-2c5c02405090 tempest-GroupSnapshotsTest-671637742 None] Lock "cinder-quobyte-2fa4b052-7b5f-4fc2-b398-892555cc2e7d" released by "delete_volume" :: held 1.029s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:22 devstack sudo[102758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4c72e4a-67d2-4523-84c3-367f382992e0_ol_9dnzudevstack@QuobyteHD Sep 28 17:24:22 devstack sudo[102758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Flow 'volume_create_manager' (ff6d52a5-afe3-4b34-bfdf-b74e21aa24f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76793c32-2f65-48e9-b798-638db628f261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76793c32-2f65-48e9-b798-638db628f261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=738eedf9-5807-4d6c-a6fb-f334da887fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='395482fa3232466b8ca81c9f46818be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c745eb60-0c32-409c-adcb-312ccbec680b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:23Z,use_quota=True,user_id='c91805312969431bbf673019de49f365',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1fcc74-d605-4db6-8358-ec4335d00bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1fcc74-d605-4db6-8358-ec4335d00bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77cc7a78-bbad-4df4-86bc-3e9b403b0523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77cc7a78-bbad-4df4-86bc-3e9b403b0523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '738eedf9-5807-4d6c-a6fb-f334da887fd8', 'volume_name': 'volume-738eedf9-5807-4d6c-a6fb-f334da887fd8', 'volume_size': 1, 'snapshot_id': 'c745eb60-0c32-409c-adcb-312ccbec680b'}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d67015-8e5b-4d44-a5b4-36200eaa1557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d67015-8e5b-4d44-a5b4-36200eaa1557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e77ed900-98cb-42a4-af5f-1f73efd27788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:22 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Volume 738eedf9-5807-4d6c-a6fb-f334da887fd8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-738eedf9-5807-4d6c-a6fb-f334da887fd8', 'volume_size': 1, 'snapshot_id': 'c745eb60-0c32-409c-adcb-312ccbec680b'} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Acquiring lock "cinder-quobyte-c745eb60-0c32-409c-adcb-312ccbec680b-738eedf9-5807-4d6c-a6fb-f334da887fd8" by "_create_volume_from_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Lock "cinder-quobyte-c745eb60-0c32-409c-adcb-312ccbec680b-738eedf9-5807-4d6c-a6fb-f334da887fd8" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Creating volume 738eedf9-5807-4d6c-a6fb-f334da887fd8 from snapshot c745eb60-0c32-409c-adcb-312ccbec680b {{(pid=86917) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Acquiring lock "cinder-quobyte-738eedf9-5807-4d6c-a6fb-f334da887fd8" by "_copy_volume_from_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-afedb47a-544c-46bc-8659-2c5c02405090 tempest-GroupSnapshotsTest-671637742 None] Created reservations ['2f035a56-7011-475e-967e-211cbe44a985'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Lock "cinder-quobyte-738eedf9-5807-4d6c-a6fb-f334da887fd8" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] snapshot: c745eb60-0c32-409c-adcb-312ccbec680b, volume: 738eedf9-5807-4d6c-a6fb-f334da887fd8, {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:22 devstack cinder-volume[86917]: WARNING cinder.quota [None req-afedb47a-544c-46bc-8659-2c5c02405090 tempest-GroupSnapshotsTest-671637742 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-597725899 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-597725899, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:24:23 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8a1582-b9be-48f1-bc0a-9b0eac39b5ea]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c.c745eb60-0c32-409c-adcb-312ccbec680b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:23 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-afedb47a-544c-46bc-8659-2c5c02405090 tempest-GroupSnapshotsTest-671637742 None] Created reservations ['87ae202f-71e6-4caf-90f2-1e5b85c22cc8', 'fda2d7d2-8ff0-4edd-8716-e3751a886bc4', '6b9352a7-a09d-4704-a8f5-f4adfed780fe', '0b9fc43d-d5ae-4816-bf86-6faceb60d050'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:23 devstack sudo[102758]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4c72e4a-67d2-4523-84c3-367f382992e0_ol_9dnzudevstack@QuobyteHD" returned: 0 in 0.518s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4c72e4a-67d2-4523-84c3-367f382992e0_ol_9dnzudevstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:23 devstack sudo[102763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c.c745eb60-0c32-409c-adcb-312ccbec680b Sep 28 17:24:23 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:23 devstack sudo[102764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4c72e4a-67d2-4523-84c3-367f382992e0_ol_9dnzudevstack@QuobyteHD Sep 28 17:24:23 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-afedb47a-544c-46bc-8659-2c5c02405090 tempest-GroupSnapshotsTest-671637742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-afedb47a-544c-46bc-8659-2c5c02405090 tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:23 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-afedb47a-544c-46bc-8659-2c5c02405090 tempest-GroupSnapshotsTest-671637742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:23 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-afedb47a-544c-46bc-8659-2c5c02405090 tempest-GroupSnapshotsTest-671637742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-afedb47a-544c-46bc-8659-2c5c02405090 tempest-GroupSnapshotsTest-671637742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-afedb47a-544c-46bc-8659-2c5c02405090 tempest-GroupSnapshotsTest-671637742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:23 devstack sudo[102767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:24:23 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:23 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c.c745eb60-0c32-409c-adcb-312ccbec680b" returned: 0 in 0.457s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:23 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:24:23 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4c72e4a-67d2-4523-84c3-367f382992e0_ol_9dnzudevstack@QuobyteHD" returned: 1 in 0.415s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4c72e4a-67d2-4523-84c3-367f382992e0_ol_9dnzudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:24:23 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Temporary image c4c72e4a-67d2-4523-84c3-367f382992e0 is fetched for user 2a7dc7387928472ba473e2876fbdcd37. {{(pid=86917) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:24:23 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a2ce59-088c-4e89-9bec-7f47c8bf243e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:23 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[055dffa2-9866-4ee0-bb89-26cb4564bb89]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4c72e4a-67d2-4523-84c3-367f382992e0_ol_9dnzudevstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:23 devstack sudo[102775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c Sep 28 17:24:23 devstack sudo[102775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:23 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-afedb47a-544c-46bc-8659-2c5c02405090 tempest-GroupSnapshotsTest-671637742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.350s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:23 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-afedb47a-544c-46bc-8659-2c5c02405090 tempest-GroupSnapshotsTest-671637742 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:24:23 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-afedb47a-544c-46bc-8659-2c5c02405090 tempest-GroupSnapshotsTest-671637742 None] Delete group completed successfully. Sep 28 17:24:23 devstack sudo[102777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4c72e4a-67d2-4523-84c3-367f382992e0_ol_9dnzudevstack@QuobyteHD Sep 28 17:24:23 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:23 devstack sudo[102775]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c" returned: 0 in 0.466s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:23 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:24:23 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Creating direct copy from snapshot {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:24:23 devstack cinder-volume[86917]: DEBUG cinder.utils [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Path /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-738eedf9-5807-4d6c-a6fb-f334da887fd8 not found in is_blk_device check {{(pid=86917) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:24:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-738eedf9-5807-4d6c-a6fb-f334da887fd8 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:23 devstack sudo[102785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-738eedf9-5807-4d6c-a6fb-f334da887fd8 Sep 28 17:24:23 devstack sudo[102785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:23 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4c72e4a-67d2-4523-84c3-367f382992e0_ol_9dnzudevstack@QuobyteHD" returned: 0 in 0.419s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4c72e4a-67d2-4523-84c3-367f382992e0_ol_9dnzudevstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:24 devstack sudo[102787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4c72e4a-67d2-4523-84c3-367f382992e0_ol_9dnzudevstack@QuobyteHD Sep 28 17:24:24 devstack sudo[102787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:24 devstack sudo[102787]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4c72e4a-67d2-4523-84c3-367f382992e0_ol_9dnzudevstack@QuobyteHD" returned: 1 in 0.386s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4c72e4a-67d2-4523-84c3-367f382992e0_ol_9dnzudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:24:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:31 devstack sudo[102785]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-738eedf9-5807-4d6c-a6fb-f334da887fd8" returned: 0 in 7.561s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:31 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Image conversion details: src /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c, size 1024.00 MB, duration 7.56 sec, destination /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-738eedf9-5807-4d6c-a6fb-f334da887fd8 {{(pid=86917) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:24:31 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Converted 1024.00 MB image at 135.41 MB/s Sep 28 17:24:31 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-738eedf9-5807-4d6c-a6fb-f334da887fd8 is being set with open permissions: ugo+rw Sep 28 17:24:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-738eedf9-5807-4d6c-a6fb-f334da887fd8 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:31 devstack sudo[102840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-738eedf9-5807-4d6c-a6fb-f334da887fd8 Sep 28 17:24:31 devstack sudo[102840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:31 devstack sudo[102840]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-738eedf9-5807-4d6c-a6fb-f334da887fd8" returned: 0 in 0.310s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:31 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Lock "cinder-quobyte-738eedf9-5807-4d6c-a6fb-f334da887fd8" released by "_copy_volume_from_snapshot" :: held 8.924s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:31 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Lock "cinder-quobyte-c745eb60-0c32-409c-adcb-312ccbec680b-738eedf9-5807-4d6c-a6fb-f334da887fd8" released by "_create_volume_from_snapshot" :: held 9.014s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.037s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.519s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09266e44-b628-4efd-bc3d-48da63f080e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae24a6aeb4b246a99124858e171016e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:22Z,use_quota=True,user_id='2a7dc7387928472ba473e2876fbdcd37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc84cd59-8ad2-439a-93f3-b97854e31a2b),volume_type_id=cc84cd59-8ad2-439a-93f3-b97854e31a2b)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:24:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Creating volume 09266e44-b628-4efd-bc3d-48da63f080e4 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:24:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:24:31 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:24:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-09266e44-b628-4efd-bc3d-48da63f080e4 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:31 devstack sudo[102843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-09266e44-b628-4efd-bc3d-48da63f080e4 1073741824 Sep 28 17:24:31 devstack sudo[102843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:31 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e77ed900-98cb-42a4-af5f-1f73efd27788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-738eedf9-5807-4d6c-a6fb-f334da887fd8', 'volume_size': 1, 'snapshot_id': 'c745eb60-0c32-409c-adcb-312ccbec680b'}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:31 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d44d6a4f-2977-4fb0-b55d-57f3ff6117e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:31 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Volume volume-738eedf9-5807-4d6c-a6fb-f334da887fd8 (738eedf9-5807-4d6c-a6fb-f334da887fd8): created successfully Sep 28 17:24:31 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d44d6a4f-2977-4fb0-b55d-57f3ff6117e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Flow 'volume_create_manager' (ff6d52a5-afe3-4b34-bfdf-b74e21aa24f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:32 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-c9bd530c-af62-479b-8d64-b90ff601ac2f tempest-SnapshotDependencyTests-2113544921 None] Created volume successfully. Sep 28 17:24:32 devstack sudo[102843]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-09266e44-b628-4efd-bc3d-48da63f080e4 1073741824" returned: 0 in 0.527s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-09266e44-b628-4efd-bc3d-48da63f080e4 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:32 devstack sudo[102849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-09266e44-b628-4efd-bc3d-48da63f080e4 Sep 28 17:24:32 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e213f697-855c-4512-ba77-e898ddb59b51 tempest-SnapshotDependencyTests-2113544921 None] Acquiring lock "cinder-c745eb60-0c32-409c-adcb-312ccbec680b-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e213f697-855c-4512-ba77-e898ddb59b51 tempest-SnapshotDependencyTests-2113544921 None] Lock "cinder-c745eb60-0c32-409c-adcb-312ccbec680b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e213f697-855c-4512-ba77-e898ddb59b51 tempest-SnapshotDependencyTests-2113544921 None] Acquiring lock "cinder-quobyte-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e213f697-855c-4512-ba77-e898ddb59b51 tempest-SnapshotDependencyTests-2113544921 None] Lock "cinder-quobyte-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e213f697-855c-4512-ba77-e898ddb59b51 tempest-SnapshotDependencyTests-2113544921 None] Acquiring lock "cinder-quobyte-c745eb60-0c32-409c-adcb-312ccbec680b" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:32 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-09266e44-b628-4efd-bc3d-48da63f080e4" returned: 0 in 0.332s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:24:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e213f697-855c-4512-ba77-e898ddb59b51 tempest-SnapshotDependencyTests-2113544921 None] Lock "cinder-quobyte-c745eb60-0c32-409c-adcb-312ccbec680b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-e213f697-855c-4512-ba77-e898ddb59b51 tempest-SnapshotDependencyTests-2113544921 None] Deleting offline snapshot c745eb60-0c32-409c-adcb-312ccbec680b of volume fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:24:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-e213f697-855c-4512-ba77-e898ddb59b51 tempest-SnapshotDependencyTests-2113544921 None] snapshot_file for this snap is: volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c.c745eb60-0c32-409c-adcb-312ccbec680b {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:24:32 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9900d250-a060-48fd-8552-2aaccca3325c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e213f697-855c-4512-ba77-e898ddb59b51 tempest-SnapshotDependencyTests-2113544921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c.c745eb60-0c32-409c-adcb-312ccbec680b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:32 devstack cinder-volume[86917]: DEBUG cinder.volume.volume_utils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Attempting download of c4c72e4a-67d2-4523-84c3-367f382992e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/c4c72e4a-67d2-4523-84c3-367f382992e0', 'metadata': {}}])) to volume 09266e44-b628-4efd-bc3d-48da63f080e4. {{(pid=86917) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:24:32 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce161de-de41-4dbf-9069-0fcae001c3ff]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c4c72e4a-67d2-4523-84c3-367f382992e0_8hr7475j {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:33 devstack sudo[102852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c.c745eb60-0c32-409c-adcb-312ccbec680b Sep 28 17:24:33 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:33 devstack sudo[102853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c4c72e4a-67d2-4523-84c3-367f382992e0_8hr7475j Sep 28 17:24:33 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:33 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c4c72e4a-67d2-4523-84c3-367f382992e0_8hr7475j" returned: 0 in 0.402s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4c72e4a-67d2-4523-84c3-367f382992e0_8hr7475j {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:33 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e213f697-855c-4512-ba77-e898ddb59b51 tempest-SnapshotDependencyTests-2113544921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c.c745eb60-0c32-409c-adcb-312ccbec680b" returned: 0 in 0.495s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:33 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-e213f697-855c-4512-ba77-e898ddb59b51 tempest-SnapshotDependencyTests-2113544921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:24:33 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8543db5-9762-4453-88db-72b45af014ef]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e213f697-855c-4512-ba77-e898ddb59b51 tempest-SnapshotDependencyTests-2113544921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:33 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4c72e4a-67d2-4523-84c3-367f382992e0_8hr7475j Sep 28 17:24:33 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:33 devstack sudo[102863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c Sep 28 17:24:33 devstack sudo[102863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:33 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4c72e4a-67d2-4523-84c3-367f382992e0_8hr7475j" returned: 1 in 0.399s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4c72e4a-67d2-4523-84c3-367f382992e0_8hr7475j' failed. Not Retrying. {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:24:33 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0270d2-460c-4e33-a70e-b2b1d52ecab2]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4c72e4a-67d2-4523-84c3-367f382992e0_ol_9dnzudevstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:33 devstack sudo[102868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4c72e4a-67d2-4523-84c3-367f382992e0_ol_9dnzudevstack@QuobyteHD Sep 28 17:24:33 devstack sudo[102868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:34 devstack sudo[102863]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e213f697-855c-4512-ba77-e898ddb59b51 tempest-SnapshotDependencyTests-2113544921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c" returned: 0 in 0.693s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e213f697-855c-4512-ba77-e898ddb59b51 tempest-SnapshotDependencyTests-2113544921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c.c745eb60-0c32-409c-adcb-312ccbec680b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:34 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c.c745eb60-0c32-409c-adcb-312ccbec680b Sep 28 17:24:34 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:34 devstack sudo[102868]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4c72e4a-67d2-4523-84c3-367f382992e0_ol_9dnzudevstack@QuobyteHD" returned: 0 in 0.433s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4c72e4a-67d2-4523-84c3-367f382992e0_ol_9dnzudevstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:34 devstack sudo[102877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4c72e4a-67d2-4523-84c3-367f382992e0_ol_9dnzudevstack@QuobyteHD Sep 28 17:24:34 devstack sudo[102877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:34 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-1f618c60-ce96-485b-8382-0cfd7602eabe tempest-GroupSnapshotsV319Test-1173575648 None] Group tempest-GroupSnapshotsV319Test-Group-1464081097: creating Sep 28 17:24:34 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-1f618c60-ce96-485b-8382-0cfd7602eabe tempest-GroupSnapshotsV319Test-1173575648 None] Group tempest-GroupSnapshotsV319Test-Group-1464081097: created successfully Sep 28 17:24:34 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-1f618c60-ce96-485b-8382-0cfd7602eabe tempest-GroupSnapshotsV319Test-1173575648 None] Create group completed successfully. Sep 28 17:24:34 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e213f697-855c-4512-ba77-e898ddb59b51 tempest-SnapshotDependencyTests-2113544921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c.c745eb60-0c32-409c-adcb-312ccbec680b" returned: 0 in 0.489s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e213f697-855c-4512-ba77-e898ddb59b51 tempest-SnapshotDependencyTests-2113544921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c.c745eb60-0c32-409c-adcb-312ccbec680b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:34 devstack sudo[102877]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4c72e4a-67d2-4523-84c3-367f382992e0_ol_9dnzudevstack@QuobyteHD" returned: 1 in 0.425s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4c72e4a-67d2-4523-84c3-367f382992e0_ol_9dnzudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:24:34 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] c4c72e4a-67d2-4523-84c3-367f382992e0 was raw, converting to qcow2 {{(pid=86917) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:24:34 devstack sudo[102886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c.c745eb60-0c32-409c-adcb-312ccbec680b Sep 28 17:24:34 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c4c72e4a-67d2-4523-84c3-367f382992e0_ol_9dnzudevstack@QuobyteHD /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-09266e44-b628-4efd-bc3d-48da63f080e4 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:34 devstack sudo[102888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c4c72e4a-67d2-4523-84c3-367f382992e0_ol_9dnzudevstack@QuobyteHD /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-09266e44-b628-4efd-bc3d-48da63f080e4 Sep 28 17:24:34 devstack sudo[102888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:34 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e213f697-855c-4512-ba77-e898ddb59b51 tempest-SnapshotDependencyTests-2113544921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c.c745eb60-0c32-409c-adcb-312ccbec680b" returned: 0 in 0.260s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:34 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e213f697-855c-4512-ba77-e898ddb59b51 tempest-SnapshotDependencyTests-2113544921 None] Lock "cinder-quobyte-c745eb60-0c32-409c-adcb-312ccbec680b" released by "_delete_snapshot" :: held 2.088s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:34 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e213f697-855c-4512-ba77-e898ddb59b51 tempest-SnapshotDependencyTests-2113544921 None] Lock "cinder-quobyte-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c" released by "delete_snapshot" :: held 2.119s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:35 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-e213f697-855c-4512-ba77-e898ddb59b51 tempest-SnapshotDependencyTests-2113544921 None] Created reservations ['b5217d36-c4ff-4cdc-af44-d1436b958122', '174e248b-51ed-40e2-948a-ff6e0d3646b5', 'f5d2f2e8-c881-4ff4-854e-464658dfa00c', 'e824f973-2cbe-4846-88ce-a14b469cb0aa'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:35 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-e213f697-855c-4512-ba77-e898ddb59b51 tempest-SnapshotDependencyTests-2113544921 None] Delete snapshot completed successfully. Sep 28 17:24:35 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e213f697-855c-4512-ba77-e898ddb59b51 tempest-SnapshotDependencyTests-2113544921 None] Lock "cinder-c745eb60-0c32-409c-adcb-312ccbec680b-delete_snapshot" released by "delete_snapshot" :: held 2.295s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:35 devstack sudo[102888]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c4c72e4a-67d2-4523-84c3-367f382992e0_ol_9dnzudevstack@QuobyteHD /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-09266e44-b628-4efd-bc3d-48da63f080e4" returned: 0 in 0.545s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:35 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c4c72e4a-67d2-4523-84c3-367f382992e0_ol_9dnzudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-09266e44-b628-4efd-bc3d-48da63f080e4 {{(pid=86917) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:24:35 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 17:24:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-09266e44-b628-4efd-bc3d-48da63f080e4 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:35 devstack sudo[102895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-09266e44-b628-4efd-bc3d-48da63f080e4 1G Sep 28 17:24:35 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:35 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-09266e44-b628-4efd-bc3d-48da63f080e4 1G" returned: 0 in 0.343s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:35 devstack cinder-volume[86917]: DEBUG cinder.volume.volume_utils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Downloaded image c4c72e4a-67d2-4523-84c3-367f382992e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/c4c72e4a-67d2-4523-84c3-367f382992e0', 'metadata': {}}])) to volume 09266e44-b628-4efd-bc3d-48da63f080e4 successfully. {{(pid=86917) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:24:35 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Temporary image c4c72e4a-67d2-4523-84c3-367f382992e0 for user 2a7dc7387928472ba473e2876fbdcd37 is deleted. {{(pid=86917) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:24:35 devstack cinder-volume[86917]: DEBUG cinder.volume.volume_utils [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Marking volume 09266e44-b628-4efd-bc3d-48da63f080e4 as bootable. {{(pid=86917) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:24:35 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Copying metadata from image c4c72e4a-67d2-4523-84c3-367f382992e0 to 09266e44-b628-4efd-bc3d-48da63f080e4. {{(pid=86917) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:24:35 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Creating volume glance metadata for volume 09266e44-b628-4efd-bc3d-48da63f080e4 backed by image c4c72e4a-67d2-4523-84c3-367f382992e0 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c4c72e4a-67d2-4523-84c3-367f382992e0', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e68feaa483bfcaa7e36da45e480a4b75', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86917) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:24:35 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d988592-9cee-4f0d-97df-870cf6a8b0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09266e44-b628-4efd-bc3d-48da63f080e4', 'volume_size': 1, 'image_id': 'c4c72e4a-67d2-4523-84c3-367f382992e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c4c72e4a-67d2-4523-84c3-367f382992e0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e68feaa483bfcaa7e36da45e480a4b75', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ae24a6aeb4b246a99124858e171016e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5eecf220868b75cd4567214bcd8bdb1f96f20f9974e8a65a5d42d23faa08d7f3b7ac4b175e2c0974ae8ce31b1a0bec5fbdd52783dc777f7b686db9bc05cc8a00', 'id': 'c4c72e4a-67d2-4523-84c3-367f382992e0', 'created_at': datetime.datetime(2026, 9, 28, 15, 24, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 24, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c4c72e4a-67d2-4523-84c3-367f382992e0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:35 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c37f7913-0a98-4c7c-a71a-2504bee24fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:35 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Volume volume-09266e44-b628-4efd-bc3d-48da63f080e4 (09266e44-b628-4efd-bc3d-48da63f080e4): created successfully Sep 28 17:24:35 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c37f7913-0a98-4c7c-a71a-2504bee24fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:35 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Flow 'volume_create_manager' (b950372c-86aa-4f64-8886-ac96b6d4bca5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:35 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-414e54d6-32ff-4355-b343-71672d692510 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Created volume successfully. Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-812aeee5-48fe-4846-a02a-26241e444267 tempest-SnapshotDependencyTests-2113544921 None] Acquiring lock "cinder-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-812aeee5-48fe-4846-a02a-26241e444267 tempest-SnapshotDependencyTests-2113544921 None] Lock "cinder-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-812aeee5-48fe-4846-a02a-26241e444267 tempest-SnapshotDependencyTests-2113544921 None] Acquiring lock "cinder-quobyte-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-812aeee5-48fe-4846-a02a-26241e444267 tempest-SnapshotDependencyTests-2113544921 None] Lock "cinder-quobyte-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c" acquired by "delete_volume" :: waited 0.019s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e560211-94c0-497e-8973-b8960b4593f3]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-812aeee5-48fe-4846-a02a-26241e444267 tempest-SnapshotDependencyTests-2113544921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-af5dea3e-5ff1-4500-862f-26a7c9f8d206 tempest-GroupSnapshotsV319Test-1173575648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-af5dea3e-5ff1-4500-862f-26a7c9f8d206 tempest-GroupSnapshotsV319Test-1173575648 None] Flow 'volume_create_manager' (8bcf4b6b-4b02-4942-92c8-695c1e19ac8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-af5dea3e-5ff1-4500-862f-26a7c9f8d206 tempest-GroupSnapshotsV319Test-1173575648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf64ebd-afeb-424c-b6b2-82c79a5a6a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-af5dea3e-5ff1-4500-862f-26a7c9f8d206 tempest-GroupSnapshotsV319Test-1173575648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf64ebd-afeb-424c-b6b2-82c79a5a6a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2075929417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=934a9ab7-8dca-4202-a2ec-3f9ae5e70207,host='devstack@QuobyteHD#QuobyteHD',id=e2de3865-c176-4455-b515-c04039054d0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b9b7ba4cdd74bfda4c7ba2c1b2fd03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:36Z,use_quota=True,user_id='78f83ec32a7f4a54a71a72d1d152e1ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b7f472a-22d7-4df1-92ce-4d51c3d1ce22),volume_type_id=4b7f472a-22d7-4df1-92ce-4d51c3d1ce22)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-af5dea3e-5ff1-4500-862f-26a7c9f8d206 tempest-GroupSnapshotsV319Test-1173575648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd509bb-5ce0-463f-b7ff-c226cac72668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-af5dea3e-5ff1-4500-862f-26a7c9f8d206 tempest-GroupSnapshotsV319Test-1173575648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd509bb-5ce0-463f-b7ff-c226cac72668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-af5dea3e-5ff1-4500-862f-26a7c9f8d206 tempest-GroupSnapshotsV319Test-1173575648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3facf7a1-5e2d-468a-9d46-190ea801e6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-af5dea3e-5ff1-4500-862f-26a7c9f8d206 tempest-GroupSnapshotsV319Test-1173575648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3facf7a1-5e2d-468a-9d46-190ea801e6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2de3865-c176-4455-b515-c04039054d0f', 'volume_name': 'volume-e2de3865-c176-4455-b515-c04039054d0f', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-af5dea3e-5ff1-4500-862f-26a7c9f8d206 tempest-GroupSnapshotsV319Test-1173575648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7e31549-c48e-4e77-ae3a-d858f1448e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:36 devstack sudo[102901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c Sep 28 17:24:36 devstack sudo[102901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-af5dea3e-5ff1-4500-862f-26a7c9f8d206 tempest-GroupSnapshotsV319Test-1173575648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7e31549-c48e-4e77-ae3a-d858f1448e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-af5dea3e-5ff1-4500-862f-26a7c9f8d206 tempest-GroupSnapshotsV319Test-1173575648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01c68bdd-3452-4ac5-99b7-75302adbcbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:36 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-af5dea3e-5ff1-4500-862f-26a7c9f8d206 tempest-GroupSnapshotsV319Test-1173575648 None] Volume e2de3865-c176-4455-b515-c04039054d0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2de3865-c176-4455-b515-c04039054d0f', 'volume_size': 1} Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-af5dea3e-5ff1-4500-862f-26a7c9f8d206 tempest-GroupSnapshotsV319Test-1173575648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-af5dea3e-5ff1-4500-862f-26a7c9f8d206 tempest-GroupSnapshotsV319Test-1173575648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-af5dea3e-5ff1-4500-862f-26a7c9f8d206 tempest-GroupSnapshotsV319Test-1173575648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=934a9ab7-8dca-4202-a2ec-3f9ae5e70207,created_at=2026-09-28T15:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2075929417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=934a9ab7-8dca-4202-a2ec-3f9ae5e70207,host='devstack@QuobyteHD#QuobyteHD',id=e2de3865-c176-4455-b515-c04039054d0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b9b7ba4cdd74bfda4c7ba2c1b2fd03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:36Z,use_quota=True,user_id='78f83ec32a7f4a54a71a72d1d152e1ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b7f472a-22d7-4df1-92ce-4d51c3d1ce22),volume_type_id=4b7f472a-22d7-4df1-92ce-4d51c3d1ce22)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-af5dea3e-5ff1-4500-862f-26a7c9f8d206 tempest-GroupSnapshotsV319Test-1173575648 None] Creating volume e2de3865-c176-4455-b515-c04039054d0f {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-af5dea3e-5ff1-4500-862f-26a7c9f8d206 tempest-GroupSnapshotsV319Test-1173575648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-af5dea3e-5ff1-4500-862f-26a7c9f8d206 tempest-GroupSnapshotsV319Test-1173575648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-af5dea3e-5ff1-4500-862f-26a7c9f8d206 tempest-GroupSnapshotsV319Test-1173575648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-af5dea3e-5ff1-4500-862f-26a7c9f8d206 tempest-GroupSnapshotsV319Test-1173575648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-af5dea3e-5ff1-4500-862f-26a7c9f8d206 tempest-GroupSnapshotsV319Test-1173575648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-af5dea3e-5ff1-4500-862f-26a7c9f8d206 tempest-GroupSnapshotsV319Test-1173575648 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:24:36 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-af5dea3e-5ff1-4500-862f-26a7c9f8d206 tempest-GroupSnapshotsV319Test-1173575648 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-af5dea3e-5ff1-4500-862f-26a7c9f8d206 tempest-GroupSnapshotsV319Test-1173575648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5470f2c6-29da-481a-a497-9f6426c26e19 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Acquiring lock "cinder-09266e44-b628-4efd-bc3d-48da63f080e4-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:36 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f 1073741824 Sep 28 17:24:36 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5470f2c6-29da-481a-a497-9f6426c26e19 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Lock "cinder-09266e44-b628-4efd-bc3d-48da63f080e4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5470f2c6-29da-481a-a497-9f6426c26e19 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Acquiring lock "cinder-quobyte-09266e44-b628-4efd-bc3d-48da63f080e4" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5470f2c6-29da-481a-a497-9f6426c26e19 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Lock "cinder-quobyte-09266e44-b628-4efd-bc3d-48da63f080e4" acquired by "delete_volume" :: waited 0.024s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01c4240-c271-4520-8f80-9f5031fbe35e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5470f2c6-29da-481a-a497-9f6426c26e19 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-09266e44-b628-4efd-bc3d-48da63f080e4 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:36 devstack sudo[102905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-09266e44-b628-4efd-bc3d-48da63f080e4 Sep 28 17:24:36 devstack sudo[102905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:36 devstack sudo[102901]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-812aeee5-48fe-4846-a02a-26241e444267 tempest-SnapshotDependencyTests-2113544921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c" returned: 0 in 0.495s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-812aeee5-48fe-4846-a02a-26241e444267 tempest-SnapshotDependencyTests-2113544921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:36 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c Sep 28 17:24:36 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:37 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-af5dea3e-5ff1-4500-862f-26a7c9f8d206 tempest-GroupSnapshotsV319Test-1173575648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f 1073741824" returned: 0 in 0.621s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-af5dea3e-5ff1-4500-862f-26a7c9f8d206 tempest-GroupSnapshotsV319Test-1173575648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:37 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:37 devstack sudo[102905]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-812aeee5-48fe-4846-a02a-26241e444267 tempest-SnapshotDependencyTests-2113544921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c" returned: 0 in 0.351s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5470f2c6-29da-481a-a497-9f6426c26e19 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-09266e44-b628-4efd-bc3d-48da63f080e4" returned: 0 in 0.519s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:37 devstack sudo[102919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f Sep 28 17:24:37 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5470f2c6-29da-481a-a497-9f6426c26e19 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-09266e44-b628-4efd-bc3d-48da63f080e4 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:37 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-812aeee5-48fe-4846-a02a-26241e444267 tempest-SnapshotDependencyTests-2113544921 None] Lock "cinder-quobyte-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c" released by "delete_volume" :: held 0.952s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:37 devstack sudo[102921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-09266e44-b628-4efd-bc3d-48da63f080e4 Sep 28 17:24:37 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:37 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-812aeee5-48fe-4846-a02a-26241e444267 tempest-SnapshotDependencyTests-2113544921 None] Created reservations ['2a551a7f-22fe-4073-a4d4-8b47cadce556', 'fb837318-a444-4f1f-bc05-0645c8ba2595', 'fce51ddc-0eb3-4eb0-8355-f9cb33250c2c', '4e1b00ea-d289-4e8c-98d1-f26f67c15b89'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-812aeee5-48fe-4846-a02a-26241e444267 tempest-SnapshotDependencyTests-2113544921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-812aeee5-48fe-4846-a02a-26241e444267 tempest-SnapshotDependencyTests-2113544921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:37 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-812aeee5-48fe-4846-a02a-26241e444267 tempest-SnapshotDependencyTests-2113544921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:37 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-812aeee5-48fe-4846-a02a-26241e444267 tempest-SnapshotDependencyTests-2113544921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-812aeee5-48fe-4846-a02a-26241e444267 tempest-SnapshotDependencyTests-2113544921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-812aeee5-48fe-4846-a02a-26241e444267 tempest-SnapshotDependencyTests-2113544921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:37 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:24:37 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:37 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-af5dea3e-5ff1-4500-862f-26a7c9f8d206 tempest-GroupSnapshotsV319Test-1173575648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f" returned: 0 in 0.328s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:37 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-af5dea3e-5ff1-4500-862f-26a7c9f8d206 tempest-GroupSnapshotsV319Test-1173575648 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:24:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-af5dea3e-5ff1-4500-862f-26a7c9f8d206 tempest-GroupSnapshotsV319Test-1173575648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:37 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-af5dea3e-5ff1-4500-862f-26a7c9f8d206 tempest-GroupSnapshotsV319Test-1173575648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01c68bdd-3452-4ac5-99b7-75302adbcbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2de3865-c176-4455-b515-c04039054d0f', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:37 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-af5dea3e-5ff1-4500-862f-26a7c9f8d206 tempest-GroupSnapshotsV319Test-1173575648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb0fe615-2ad3-4db9-bd81-4354b9165e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:37 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-af5dea3e-5ff1-4500-862f-26a7c9f8d206 tempest-GroupSnapshotsV319Test-1173575648 None] Volume volume-e2de3865-c176-4455-b515-c04039054d0f (e2de3865-c176-4455-b515-c04039054d0f): created successfully Sep 28 17:24:37 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-af5dea3e-5ff1-4500-862f-26a7c9f8d206 tempest-GroupSnapshotsV319Test-1173575648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb0fe615-2ad3-4db9-bd81-4354b9165e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:37 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-af5dea3e-5ff1-4500-862f-26a7c9f8d206 tempest-GroupSnapshotsV319Test-1173575648 None] Flow 'volume_create_manager' (8bcf4b6b-4b02-4942-92c8-695c1e19ac8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:37 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-af5dea3e-5ff1-4500-862f-26a7c9f8d206 tempest-GroupSnapshotsV319Test-1173575648 None] Created volume successfully. Sep 28 17:24:37 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5470f2c6-29da-481a-a497-9f6426c26e19 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-09266e44-b628-4efd-bc3d-48da63f080e4" returned: 0 in 0.411s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:37 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5470f2c6-29da-481a-a497-9f6426c26e19 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Lock "cinder-quobyte-09266e44-b628-4efd-bc3d-48da63f080e4" released by "delete_volume" :: held 0.991s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:37 devstack cinder-volume[86917]: WARNING cinder.quota [None req-5470f2c6-29da-481a-a497-9f6426c26e19 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:24:37 devstack cinder-volume[86917]: WARNING cinder.quota [None req-5470f2c6-29da-481a-a497-9f6426c26e19 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:24:37 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=139,cinder:INSERT=37,cinder:UPDATE=120,cinder:DELETE=4 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:24:37 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-5470f2c6-29da-481a-a497-9f6426c26e19 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Created reservations ['1bc08e2c-1211-4171-ba84-8806556239b1', '80bdc7b8-c2a5-4342-b89b-e3c586391a58', '6600d980-728a-4ef6-80e7-80059995a9ea', 'b635d781-8c4e-47ec-8fcc-f9798c2a04fc'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:37 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:UPDATE=134,cinder:SELECT=121,cinder:INSERT=35,cinder:DELETE=8 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:24:37 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-812aeee5-48fe-4846-a02a-26241e444267 tempest-SnapshotDependencyTests-2113544921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.381s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:37 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-812aeee5-48fe-4846-a02a-26241e444267 tempest-SnapshotDependencyTests-2113544921 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:24:37 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-812aeee5-48fe-4846-a02a-26241e444267 tempest-SnapshotDependencyTests-2113544921 None] Deleted volume successfully. Sep 28 17:24:37 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-812aeee5-48fe-4846-a02a-26241e444267 tempest-SnapshotDependencyTests-2113544921 None] Lock "cinder-fb3bf4ce-60f9-4d7d-8f70-f256d19fc70c-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5470f2c6-29da-481a-a497-9f6426c26e19 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5470f2c6-29da-481a-a497-9f6426c26e19 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:37 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-5470f2c6-29da-481a-a497-9f6426c26e19 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:37 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-5470f2c6-29da-481a-a497-9f6426c26e19 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5470f2c6-29da-481a-a497-9f6426c26e19 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5470f2c6-29da-481a-a497-9f6426c26e19 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:37 devstack sudo[102928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:24:37 devstack sudo[102928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:38 devstack sudo[102928]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5470f2c6-29da-481a-a497-9f6426c26e19 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.269s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:38 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-5470f2c6-29da-481a-a497-9f6426c26e19 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:24:38 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-5470f2c6-29da-481a-a497-9f6426c26e19 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Deleted volume successfully. Sep 28 17:24:38 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5470f2c6-29da-481a-a497-9f6426c26e19 tempest-VolumeAndVolumeTypeFromImageTest-671169458 None] Lock "cinder-09266e44-b628-4efd-bc3d-48da63f080e4-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:38 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ecf65135-9d61-47ed-a46a-76e18a2b98cf tempest-SnapshotDependencyTests-2113544921 None] Acquiring lock "cinder-738eedf9-5807-4d6c-a6fb-f334da887fd8-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:38 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ecf65135-9d61-47ed-a46a-76e18a2b98cf tempest-SnapshotDependencyTests-2113544921 None] Lock "cinder-738eedf9-5807-4d6c-a6fb-f334da887fd8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:38 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ecf65135-9d61-47ed-a46a-76e18a2b98cf tempest-SnapshotDependencyTests-2113544921 None] Acquiring lock "cinder-quobyte-738eedf9-5807-4d6c-a6fb-f334da887fd8" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:38 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ecf65135-9d61-47ed-a46a-76e18a2b98cf tempest-SnapshotDependencyTests-2113544921 None] Lock "cinder-quobyte-738eedf9-5807-4d6c-a6fb-f334da887fd8" acquired by "delete_volume" :: waited 0.017s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:38 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6a306e-23aa-4161-9d8e-8da7f464c512]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ecf65135-9d61-47ed-a46a-76e18a2b98cf tempest-SnapshotDependencyTests-2113544921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-738eedf9-5807-4d6c-a6fb-f334da887fd8 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:38 devstack sudo[102931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-738eedf9-5807-4d6c-a6fb-f334da887fd8 Sep 28 17:24:38 devstack sudo[102931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:38 devstack sudo[102931]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ecf65135-9d61-47ed-a46a-76e18a2b98cf tempest-SnapshotDependencyTests-2113544921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-738eedf9-5807-4d6c-a6fb-f334da887fd8" returned: 0 in 0.433s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ecf65135-9d61-47ed-a46a-76e18a2b98cf tempest-SnapshotDependencyTests-2113544921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-738eedf9-5807-4d6c-a6fb-f334da887fd8 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:38 devstack sudo[102937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-738eedf9-5807-4d6c-a6fb-f334da887fd8 Sep 28 17:24:38 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:39 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:39 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-876ac261-56b7-4c5e-966e-81aced46f4a8 tempest-GroupSnapshotsV319Test-1173575648 None] GroupSnapshot a0af4672-3988-42c2-9643-d140a50995f3: creating. Sep 28 17:24:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ecf65135-9d61-47ed-a46a-76e18a2b98cf tempest-SnapshotDependencyTests-2113544921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-738eedf9-5807-4d6c-a6fb-f334da887fd8" returned: 0 in 0.362s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:39 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ecf65135-9d61-47ed-a46a-76e18a2b98cf tempest-SnapshotDependencyTests-2113544921 None] Lock "cinder-quobyte-738eedf9-5807-4d6c-a6fb-f334da887fd8" released by "delete_volume" :: held 0.854s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:39 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-876ac261-56b7-4c5e-966e-81aced46f4a8 tempest-GroupSnapshotsV319Test-1173575648 None] Group snapshot a0af4672-3988-42c2-9643-d140a50995f3: creating. {{(pid=86917) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 17:24:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-876ac261-56b7-4c5e-966e-81aced46f4a8 tempest-GroupSnapshotsV319Test-1173575648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-876ac261-56b7-4c5e-966e-81aced46f4a8 tempest-GroupSnapshotsV319Test-1173575648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:39 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-876ac261-56b7-4c5e-966e-81aced46f4a8 tempest-GroupSnapshotsV319Test-1173575648 None] Creating offline snapshot 73c1fedc-55d5-4cf7-9780-81b5df76d74a of volume e2de3865-c176-4455-b515-c04039054d0f {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:24:39 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6986ba-8471-4095-a8dd-8112f4c765b3]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-876ac261-56b7-4c5e-966e-81aced46f4a8 tempest-GroupSnapshotsV319Test-1173575648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:39 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-ecf65135-9d61-47ed-a46a-76e18a2b98cf tempest-SnapshotDependencyTests-2113544921 None] Created reservations ['fa5a375c-593f-45ae-9a90-e0fb6da082a9', '6be3fb49-5246-4869-8854-316ec594c3a0', '42d030f1-fb4c-47aa-8766-380d3ccc8fc5', '479c3bd3-ba39-4dcb-b12c-819d4fb7414d'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:39 devstack sudo[102940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f Sep 28 17:24:39 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ecf65135-9d61-47ed-a46a-76e18a2b98cf tempest-SnapshotDependencyTests-2113544921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ecf65135-9d61-47ed-a46a-76e18a2b98cf tempest-SnapshotDependencyTests-2113544921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:39 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ecf65135-9d61-47ed-a46a-76e18a2b98cf tempest-SnapshotDependencyTests-2113544921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:39 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ecf65135-9d61-47ed-a46a-76e18a2b98cf tempest-SnapshotDependencyTests-2113544921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ecf65135-9d61-47ed-a46a-76e18a2b98cf tempest-SnapshotDependencyTests-2113544921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ecf65135-9d61-47ed-a46a-76e18a2b98cf tempest-SnapshotDependencyTests-2113544921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:39 devstack sudo[102942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:24:39 devstack sudo[102942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:39 devstack sudo[102942]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ecf65135-9d61-47ed-a46a-76e18a2b98cf tempest-SnapshotDependencyTests-2113544921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.303s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:39 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-ecf65135-9d61-47ed-a46a-76e18a2b98cf tempest-SnapshotDependencyTests-2113544921 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:24:39 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-ecf65135-9d61-47ed-a46a-76e18a2b98cf tempest-SnapshotDependencyTests-2113544921 None] Deleted volume successfully. Sep 28 17:24:39 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-876ac261-56b7-4c5e-966e-81aced46f4a8 tempest-GroupSnapshotsV319Test-1173575648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f" returned: 0 in 0.578s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-876ac261-56b7-4c5e-966e-81aced46f4a8 tempest-GroupSnapshotsV319Test-1173575648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f.73c1fedc-55d5-4cf7-9780-81b5df76d74a 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:39 devstack sudo[102948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f.73c1fedc-55d5-4cf7-9780-81b5df76d74a 1G Sep 28 17:24:39 devstack sudo[102948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:39 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ecf65135-9d61-47ed-a46a-76e18a2b98cf tempest-SnapshotDependencyTests-2113544921 None] Lock "cinder-738eedf9-5807-4d6c-a6fb-f334da887fd8-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:40 devstack sudo[102948]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-876ac261-56b7-4c5e-966e-81aced46f4a8 tempest-GroupSnapshotsV319Test-1173575648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f.73c1fedc-55d5-4cf7-9780-81b5df76d74a 1G" returned: 0 in 0.526s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-876ac261-56b7-4c5e-966e-81aced46f4a8 tempest-GroupSnapshotsV319Test-1173575648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2de3865-c176-4455-b515-c04039054d0f -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f.73c1fedc-55d5-4cf7-9780-81b5df76d74a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:40 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2de3865-c176-4455-b515-c04039054d0f -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f.73c1fedc-55d5-4cf7-9780-81b5df76d74a Sep 28 17:24:40 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:40 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-876ac261-56b7-4c5e-966e-81aced46f4a8 tempest-GroupSnapshotsV319Test-1173575648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2de3865-c176-4455-b515-c04039054d0f -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f.73c1fedc-55d5-4cf7-9780-81b5df76d74a" returned: 0 in 0.398s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:40 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-876ac261-56b7-4c5e-966e-81aced46f4a8 tempest-GroupSnapshotsV319Test-1173575648 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f.73c1fedc-55d5-4cf7-9780-81b5df76d74a is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:24:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-876ac261-56b7-4c5e-966e-81aced46f4a8 tempest-GroupSnapshotsV319Test-1173575648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f.73c1fedc-55d5-4cf7-9780-81b5df76d74a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:40 devstack sudo[102961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f.73c1fedc-55d5-4cf7-9780-81b5df76d74a Sep 28 17:24:40 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:41 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-876ac261-56b7-4c5e-966e-81aced46f4a8 tempest-GroupSnapshotsV319Test-1173575648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f.73c1fedc-55d5-4cf7-9780-81b5df76d74a" returned: 0 in 0.333s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-876ac261-56b7-4c5e-966e-81aced46f4a8 tempest-GroupSnapshotsV319Test-1173575648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:41 devstack sudo[102965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f.info Sep 28 17:24:41 devstack sudo[102965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:41 devstack sudo[102965]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-876ac261-56b7-4c5e-966e-81aced46f4a8 tempest-GroupSnapshotsV319Test-1173575648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f.info" returned: 0 in 0.361s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:41 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-876ac261-56b7-4c5e-966e-81aced46f4a8 tempest-GroupSnapshotsV319Test-1173575648 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:24:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-876ac261-56b7-4c5e-966e-81aced46f4a8 tempest-GroupSnapshotsV319Test-1173575648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:41 devstack sudo[102968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f.info Sep 28 17:24:41 devstack sudo[102968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:42 devstack sudo[102968]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-876ac261-56b7-4c5e-966e-81aced46f4a8 tempest-GroupSnapshotsV319Test-1173575648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f.info" returned: 0 in 0.458s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-876ac261-56b7-4c5e-966e-81aced46f4a8 tempest-GroupSnapshotsV319Test-1173575648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.789s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:42 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-876ac261-56b7-4c5e-966e-81aced46f4a8 tempest-GroupSnapshotsV319Test-1173575648 None] group_snapshot a0af4672-3988-42c2-9643-d140a50995f3: created successfully Sep 28 17:24:42 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-c0c8f2a8-bf16-441d-839b-3fe62db493ba tempest-GroupSnapshotsV319Test-1173575648 None] group_snapshot a0af4672-3988-42c2-9643-d140a50995f3: deleting Sep 28 17:24:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c0c8f2a8-bf16-441d-839b-3fe62db493ba tempest-GroupSnapshotsV319Test-1173575648 None] group_snapshot a0af4672-3988-42c2-9643-d140a50995f3: deleting {{(pid=86917) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 17:24:43 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c0c8f2a8-bf16-441d-839b-3fe62db493ba tempest-GroupSnapshotsV319Test-1173575648 None] Acquiring lock "cinder-quobyte-e2de3865-c176-4455-b515-c04039054d0f" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:43 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c0c8f2a8-bf16-441d-839b-3fe62db493ba tempest-GroupSnapshotsV319Test-1173575648 None] Lock "cinder-quobyte-e2de3865-c176-4455-b515-c04039054d0f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:43 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c0c8f2a8-bf16-441d-839b-3fe62db493ba tempest-GroupSnapshotsV319Test-1173575648 None] Acquiring lock "cinder-quobyte-73c1fedc-55d5-4cf7-9780-81b5df76d74a" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:43 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c0c8f2a8-bf16-441d-839b-3fe62db493ba tempest-GroupSnapshotsV319Test-1173575648 None] Lock "cinder-quobyte-73c1fedc-55d5-4cf7-9780-81b5df76d74a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:43 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-c0c8f2a8-bf16-441d-839b-3fe62db493ba tempest-GroupSnapshotsV319Test-1173575648 None] Deleting offline snapshot 73c1fedc-55d5-4cf7-9780-81b5df76d74a of volume e2de3865-c176-4455-b515-c04039054d0f {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:24:43 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-c0c8f2a8-bf16-441d-839b-3fe62db493ba tempest-GroupSnapshotsV319Test-1173575648 None] snapshot_file for this snap is: volume-e2de3865-c176-4455-b515-c04039054d0f.73c1fedc-55d5-4cf7-9780-81b5df76d74a {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:24:43 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ea02d4-ff00-4a46-b3ee-7ac2a4d635b3]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c0c8f2a8-bf16-441d-839b-3fe62db493ba tempest-GroupSnapshotsV319Test-1173575648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f.73c1fedc-55d5-4cf7-9780-81b5df76d74a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:43 devstack sudo[102972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f.73c1fedc-55d5-4cf7-9780-81b5df76d74a Sep 28 17:24:43 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:43 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c0c8f2a8-bf16-441d-839b-3fe62db493ba tempest-GroupSnapshotsV319Test-1173575648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f.73c1fedc-55d5-4cf7-9780-81b5df76d74a" returned: 0 in 0.473s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:43 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-c0c8f2a8-bf16-441d-839b-3fe62db493ba tempest-GroupSnapshotsV319Test-1173575648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2de3865-c176-4455-b515-c04039054d0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:24:43 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[115fb203-0da1-46a1-9b66-b4901702d3fb]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c0c8f2a8-bf16-441d-839b-3fe62db493ba tempest-GroupSnapshotsV319Test-1173575648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:43 devstack sudo[102978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f Sep 28 17:24:43 devstack sudo[102978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:44 devstack sudo[102978]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c0c8f2a8-bf16-441d-839b-3fe62db493ba tempest-GroupSnapshotsV319Test-1173575648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f" returned: 0 in 0.440s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c0c8f2a8-bf16-441d-839b-3fe62db493ba tempest-GroupSnapshotsV319Test-1173575648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f.73c1fedc-55d5-4cf7-9780-81b5df76d74a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:44 devstack sudo[102983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f.73c1fedc-55d5-4cf7-9780-81b5df76d74a Sep 28 17:24:44 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:44 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c0c8f2a8-bf16-441d-839b-3fe62db493ba tempest-GroupSnapshotsV319Test-1173575648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f.73c1fedc-55d5-4cf7-9780-81b5df76d74a" returned: 0 in 0.462s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c0c8f2a8-bf16-441d-839b-3fe62db493ba tempest-GroupSnapshotsV319Test-1173575648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f.73c1fedc-55d5-4cf7-9780-81b5df76d74a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:44 devstack sudo[102989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f.73c1fedc-55d5-4cf7-9780-81b5df76d74a Sep 28 17:24:44 devstack sudo[102989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:44 devstack sudo[102989]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c0c8f2a8-bf16-441d-839b-3fe62db493ba tempest-GroupSnapshotsV319Test-1173575648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f.73c1fedc-55d5-4cf7-9780-81b5df76d74a" returned: 0 in 0.331s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:44 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c0c8f2a8-bf16-441d-839b-3fe62db493ba tempest-GroupSnapshotsV319Test-1173575648 None] Lock "cinder-quobyte-73c1fedc-55d5-4cf7-9780-81b5df76d74a" released by "_delete_snapshot" :: held 1.911s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:44 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c0c8f2a8-bf16-441d-839b-3fe62db493ba tempest-GroupSnapshotsV319Test-1173575648 None] Lock "cinder-quobyte-e2de3865-c176-4455-b515-c04039054d0f" released by "delete_snapshot" :: held 1.936s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:45 devstack cinder-volume[86917]: WARNING cinder.quota [None req-c0c8f2a8-bf16-441d-839b-3fe62db493ba tempest-GroupSnapshotsV319Test-1173575648 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-42946470 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-42946470, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:24:45 devstack cinder-volume[86917]: WARNING cinder.quota [None req-c0c8f2a8-bf16-441d-839b-3fe62db493ba tempest-GroupSnapshotsV319Test-1173575648 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-42946470 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-42946470, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:24:45 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-c0c8f2a8-bf16-441d-839b-3fe62db493ba tempest-GroupSnapshotsV319Test-1173575648 None] Created reservations ['c7422e9b-3c6f-41d2-ba75-fdfbbe896327', '8e8d5f65-1c7b-4f0d-a5cc-4a041d49698b', '6e4aba3f-7fcb-4442-bc98-87744e24e7d1', 'bdb76cd8-c86a-4a83-96ea-5db9c6232a6b'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:45 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-c0c8f2a8-bf16-441d-839b-3fe62db493ba tempest-GroupSnapshotsV319Test-1173575648 None] group_snapshot a0af4672-3988-42c2-9643-d140a50995f3: deleted successfully Sep 28 17:24:45 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6252c3d1-2c59-4035-a41f-7244c5e62925 tempest-GroupSnapshotsV319Test-1173575648 None] Acquiring lock "cinder-quobyte-e2de3865-c176-4455-b515-c04039054d0f" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:45 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6252c3d1-2c59-4035-a41f-7244c5e62925 tempest-GroupSnapshotsV319Test-1173575648 None] Lock "cinder-quobyte-e2de3865-c176-4455-b515-c04039054d0f" acquired by "delete_volume" :: waited 0.025s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:45 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d47ac8-1031-45b5-896e-32a20b95200b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6252c3d1-2c59-4035-a41f-7244c5e62925 tempest-GroupSnapshotsV319Test-1173575648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:45 devstack sudo[102995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f Sep 28 17:24:45 devstack sudo[102995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:46 devstack sudo[102995]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6252c3d1-2c59-4035-a41f-7244c5e62925 tempest-GroupSnapshotsV319Test-1173575648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f" returned: 0 in 0.432s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6252c3d1-2c59-4035-a41f-7244c5e62925 tempest-GroupSnapshotsV319Test-1173575648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:46 devstack sudo[103001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f Sep 28 17:24:46 devstack sudo[103001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:46 devstack sudo[103001]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6252c3d1-2c59-4035-a41f-7244c5e62925 tempest-GroupSnapshotsV319Test-1173575648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e2de3865-c176-4455-b515-c04039054d0f" returned: 0 in 0.321s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:46 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6252c3d1-2c59-4035-a41f-7244c5e62925 tempest-GroupSnapshotsV319Test-1173575648 None] Lock "cinder-quobyte-e2de3865-c176-4455-b515-c04039054d0f" released by "delete_volume" :: held 0.846s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:46 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-6252c3d1-2c59-4035-a41f-7244c5e62925 tempest-GroupSnapshotsV319Test-1173575648 None] Created reservations ['703d7629-6b97-4142-b4c1-2f51a8d54c90'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:46 devstack cinder-volume[86917]: WARNING cinder.quota [None req-6252c3d1-2c59-4035-a41f-7244c5e62925 tempest-GroupSnapshotsV319Test-1173575648 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-42946470 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-42946470, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:24:46 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-6252c3d1-2c59-4035-a41f-7244c5e62925 tempest-GroupSnapshotsV319Test-1173575648 None] Created reservations ['ed4133ba-92e3-4920-89e0-0f47639316ea', '4368e3ee-d6db-42b0-b3e4-691e024483ef', 'bec94368-52c3-4d31-bdcd-d704ae4a3ce8', '7ca0e668-87de-4ede-906d-13474ac6d883'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6252c3d1-2c59-4035-a41f-7244c5e62925 tempest-GroupSnapshotsV319Test-1173575648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6252c3d1-2c59-4035-a41f-7244c5e62925 tempest-GroupSnapshotsV319Test-1173575648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:46 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6252c3d1-2c59-4035-a41f-7244c5e62925 tempest-GroupSnapshotsV319Test-1173575648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:46 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6252c3d1-2c59-4035-a41f-7244c5e62925 tempest-GroupSnapshotsV319Test-1173575648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6252c3d1-2c59-4035-a41f-7244c5e62925 tempest-GroupSnapshotsV319Test-1173575648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6252c3d1-2c59-4035-a41f-7244c5e62925 tempest-GroupSnapshotsV319Test-1173575648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:46 devstack sudo[103004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:24:46 devstack sudo[103004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:47 devstack sudo[103004]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6252c3d1-2c59-4035-a41f-7244c5e62925 tempest-GroupSnapshotsV319Test-1173575648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.291s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:47 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-6252c3d1-2c59-4035-a41f-7244c5e62925 tempest-GroupSnapshotsV319Test-1173575648 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:24:47 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-6252c3d1-2c59-4035-a41f-7244c5e62925 tempest-GroupSnapshotsV319Test-1173575648 None] Delete group completed successfully. Sep 28 17:24:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:24:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:49 devstack sudo[103008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:24:49 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:49 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.345s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:49 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:24:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager._thread_info {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:24:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread count: 28 {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:24:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread info: [<_MainThread(MainThread, started 132915553284224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:24:54 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-d2c3edfa-5002-4a1a-9dcf-f98269981120 tempest-GroupsTest-403774582 None] Group tempest-Group1-532026317: creating Sep 28 17:24:54 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-d2c3edfa-5002-4a1a-9dcf-f98269981120 tempest-GroupsTest-403774582 None] Group tempest-Group1-532026317: created successfully Sep 28 17:24:54 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-d2c3edfa-5002-4a1a-9dcf-f98269981120 tempest-GroupsTest-403774582 None] Create group completed successfully. Sep 28 17:24:55 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-2ef2fba7-f859-499b-8564-a85c7d861a48 tempest-GroupsTest-403774582 None] Group tempest-Group2-762373850: creating Sep 28 17:24:55 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-2ef2fba7-f859-499b-8564-a85c7d861a48 tempest-GroupsTest-403774582 None] Group tempest-Group2-762373850: created successfully Sep 28 17:24:55 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-2ef2fba7-f859-499b-8564-a85c7d861a48 tempest-GroupsTest-403774582 None] Create group completed successfully. Sep 28 17:24:57 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2185608-247d-4c6e-a4bb-35b8bbe5fb90 tempest-GroupsTest-403774582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:24:57 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f2185608-247d-4c6e-a4bb-35b8bbe5fb90 tempest-GroupsTest-403774582 None] Flow 'volume_create_manager' (99a2cc3b-c424-488c-b2b2-69c06dab41f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:57 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f2185608-247d-4c6e-a4bb-35b8bbe5fb90 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dea8d21a-46db-41ce-a6b0-2c9701e1a118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:57 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f2185608-247d-4c6e-a4bb-35b8bbe5fb90 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dea8d21a-46db-41ce-a6b0-2c9701e1a118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1602231558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a55086e2-54a1-4f91-81bb-91bca435551d,host='devstack@QuobyteHD#QuobyteHD',id=ab5bb75b-9a86-4e71-9a2c-01a7f1b6d16f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='044206eb374e443d9fbc813012215a3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:57Z,use_quota=True,user_id='4a75d9099b004b77bca6fe6961bf83d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(95230c38-6a7d-482d-a8f9-fcbfea792e5e),volume_type_id=95230c38-6a7d-482d-a8f9-fcbfea792e5e)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:57 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f2185608-247d-4c6e-a4bb-35b8bbe5fb90 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24495d04-9cce-4695-8ccd-90ad625a1106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:57 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f2185608-247d-4c6e-a4bb-35b8bbe5fb90 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24495d04-9cce-4695-8ccd-90ad625a1106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:57 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f2185608-247d-4c6e-a4bb-35b8bbe5fb90 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e827d368-2556-4ffc-8ea3-9e74c02eb72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:57 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f2185608-247d-4c6e-a4bb-35b8bbe5fb90 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e827d368-2556-4ffc-8ea3-9e74c02eb72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab5bb75b-9a86-4e71-9a2c-01a7f1b6d16f', 'volume_name': 'volume-ab5bb75b-9a86-4e71-9a2c-01a7f1b6d16f', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:57 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f2185608-247d-4c6e-a4bb-35b8bbe5fb90 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d91695a-d864-488d-8e75-5ea8791dd51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:57 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f2185608-247d-4c6e-a4bb-35b8bbe5fb90 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d91695a-d864-488d-8e75-5ea8791dd51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:57 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f2185608-247d-4c6e-a4bb-35b8bbe5fb90 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c784da9-6fba-4248-9bc5-b5d7f0fc6ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:57 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-f2185608-247d-4c6e-a4bb-35b8bbe5fb90 tempest-GroupsTest-403774582 None] Volume ab5bb75b-9a86-4e71-9a2c-01a7f1b6d16f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab5bb75b-9a86-4e71-9a2c-01a7f1b6d16f', 'volume_size': 1} Sep 28 17:24:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f2185608-247d-4c6e-a4bb-35b8bbe5fb90 tempest-GroupsTest-403774582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f2185608-247d-4c6e-a4bb-35b8bbe5fb90 tempest-GroupsTest-403774582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:57 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f2185608-247d-4c6e-a4bb-35b8bbe5fb90 tempest-GroupsTest-403774582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a55086e2-54a1-4f91-81bb-91bca435551d,created_at=2026-09-28T15:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1602231558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a55086e2-54a1-4f91-81bb-91bca435551d,host='devstack@QuobyteHD#QuobyteHD',id=ab5bb75b-9a86-4e71-9a2c-01a7f1b6d16f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='044206eb374e443d9fbc813012215a3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:57Z,use_quota=True,user_id='4a75d9099b004b77bca6fe6961bf83d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(95230c38-6a7d-482d-a8f9-fcbfea792e5e),volume_type_id=95230c38-6a7d-482d-a8f9-fcbfea792e5e)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:24:57 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-f2185608-247d-4c6e-a4bb-35b8bbe5fb90 tempest-GroupsTest-403774582 None] Creating volume ab5bb75b-9a86-4e71-9a2c-01a7f1b6d16f {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:24:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f2185608-247d-4c6e-a4bb-35b8bbe5fb90 tempest-GroupsTest-403774582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f2185608-247d-4c6e-a4bb-35b8bbe5fb90 tempest-GroupsTest-403774582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:57 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f2185608-247d-4c6e-a4bb-35b8bbe5fb90 tempest-GroupsTest-403774582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:57 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f2185608-247d-4c6e-a4bb-35b8bbe5fb90 tempest-GroupsTest-403774582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f2185608-247d-4c6e-a4bb-35b8bbe5fb90 tempest-GroupsTest-403774582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:57 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f2185608-247d-4c6e-a4bb-35b8bbe5fb90 tempest-GroupsTest-403774582 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:24:57 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-f2185608-247d-4c6e-a4bb-35b8bbe5fb90 tempest-GroupsTest-403774582 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:24:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f2185608-247d-4c6e-a4bb-35b8bbe5fb90 tempest-GroupsTest-403774582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ab5bb75b-9a86-4e71-9a2c-01a7f1b6d16f 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:57 devstack sudo[103013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ab5bb75b-9a86-4e71-9a2c-01a7f1b6d16f 1073741824 Sep 28 17:24:57 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:57 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f2185608-247d-4c6e-a4bb-35b8bbe5fb90 tempest-GroupsTest-403774582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ab5bb75b-9a86-4e71-9a2c-01a7f1b6d16f 1073741824" returned: 0 in 0.522s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f2185608-247d-4c6e-a4bb-35b8bbe5fb90 tempest-GroupsTest-403774582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ab5bb75b-9a86-4e71-9a2c-01a7f1b6d16f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:57 devstack sudo[103018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ab5bb75b-9a86-4e71-9a2c-01a7f1b6d16f Sep 28 17:24:57 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:58 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f2185608-247d-4c6e-a4bb-35b8bbe5fb90 tempest-GroupsTest-403774582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ab5bb75b-9a86-4e71-9a2c-01a7f1b6d16f" returned: 0 in 0.307s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:58 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f2185608-247d-4c6e-a4bb-35b8bbe5fb90 tempest-GroupsTest-403774582 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:24:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f2185608-247d-4c6e-a4bb-35b8bbe5fb90 tempest-GroupsTest-403774582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f2185608-247d-4c6e-a4bb-35b8bbe5fb90 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c784da9-6fba-4248-9bc5-b5d7f0fc6ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab5bb75b-9a86-4e71-9a2c-01a7f1b6d16f', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f2185608-247d-4c6e-a4bb-35b8bbe5fb90 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9137865-1927-4598-a8da-7f4cb06b065c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:58 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-f2185608-247d-4c6e-a4bb-35b8bbe5fb90 tempest-GroupsTest-403774582 None] Volume volume-ab5bb75b-9a86-4e71-9a2c-01a7f1b6d16f (ab5bb75b-9a86-4e71-9a2c-01a7f1b6d16f): created successfully Sep 28 17:24:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f2185608-247d-4c6e-a4bb-35b8bbe5fb90 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9137865-1927-4598-a8da-7f4cb06b065c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f2185608-247d-4c6e-a4bb-35b8bbe5fb90 tempest-GroupsTest-403774582 None] Flow 'volume_create_manager' (99a2cc3b-c424-488c-b2b2-69c06dab41f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:58 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-f2185608-247d-4c6e-a4bb-35b8bbe5fb90 tempest-GroupsTest-403774582 None] Created volume successfully. Sep 28 17:24:58 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d8365eff-fd0a-41a5-a135-d21b2df24315 tempest-GroupsTest-403774582 None] Acquiring lock "cinder-quobyte-ab5bb75b-9a86-4e71-9a2c-01a7f1b6d16f" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:58 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d8365eff-fd0a-41a5-a135-d21b2df24315 tempest-GroupsTest-403774582 None] Lock "cinder-quobyte-ab5bb75b-9a86-4e71-9a2c-01a7f1b6d16f" acquired by "delete_volume" :: waited 0.020s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:58 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6385e7-8ca6-4cf5-a727-872657811083]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d8365eff-fd0a-41a5-a135-d21b2df24315 tempest-GroupsTest-403774582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ab5bb75b-9a86-4e71-9a2c-01a7f1b6d16f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:59 devstack sudo[103021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ab5bb75b-9a86-4e71-9a2c-01a7f1b6d16f Sep 28 17:24:59 devstack sudo[103021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:59 devstack sudo[103021]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d8365eff-fd0a-41a5-a135-d21b2df24315 tempest-GroupsTest-403774582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ab5bb75b-9a86-4e71-9a2c-01a7f1b6d16f" returned: 0 in 0.401s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d8365eff-fd0a-41a5-a135-d21b2df24315 tempest-GroupsTest-403774582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ab5bb75b-9a86-4e71-9a2c-01a7f1b6d16f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:59 devstack sudo[103026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ab5bb75b-9a86-4e71-9a2c-01a7f1b6d16f Sep 28 17:24:59 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:59 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d8365eff-fd0a-41a5-a135-d21b2df24315 tempest-GroupsTest-403774582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ab5bb75b-9a86-4e71-9a2c-01a7f1b6d16f" returned: 0 in 0.271s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:59 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d8365eff-fd0a-41a5-a135-d21b2df24315 tempest-GroupsTest-403774582 None] Lock "cinder-quobyte-ab5bb75b-9a86-4e71-9a2c-01a7f1b6d16f" released by "delete_volume" :: held 0.718s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:59 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-d8365eff-fd0a-41a5-a135-d21b2df24315 tempest-GroupsTest-403774582 None] Created reservations ['d2aa0ce4-8f2a-4e46-97a9-375c6eb9930c'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:59 devstack cinder-volume[86917]: WARNING cinder.quota [None req-d8365eff-fd0a-41a5-a135-d21b2df24315 tempest-GroupsTest-403774582 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1157764645 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1157764645, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:24:59 devstack cinder-volume[86917]: WARNING cinder.quota [None req-d8365eff-fd0a-41a5-a135-d21b2df24315 tempest-GroupsTest-403774582 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1157764645 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1157764645, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:24:59 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-d8365eff-fd0a-41a5-a135-d21b2df24315 tempest-GroupsTest-403774582 None] Created reservations ['9d7078fa-9bfb-41c3-9ccc-464d1ef9fb41', '35a3a60e-932a-4496-bad5-0ee35af75b95', '5bb89244-fe95-4ee0-b5d8-4b7cc6ce735f', '6364eac9-8d74-4ead-9d87-1136751b226c'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d8365eff-fd0a-41a5-a135-d21b2df24315 tempest-GroupsTest-403774582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d8365eff-fd0a-41a5-a135-d21b2df24315 tempest-GroupsTest-403774582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:59 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d8365eff-fd0a-41a5-a135-d21b2df24315 tempest-GroupsTest-403774582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:59 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d8365eff-fd0a-41a5-a135-d21b2df24315 tempest-GroupsTest-403774582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d8365eff-fd0a-41a5-a135-d21b2df24315 tempest-GroupsTest-403774582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d8365eff-fd0a-41a5-a135-d21b2df24315 tempest-GroupsTest-403774582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:59 devstack sudo[103029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:24:59 devstack sudo[103029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:00 devstack sudo[103029]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d8365eff-fd0a-41a5-a135-d21b2df24315 tempest-GroupsTest-403774582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.275s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:00 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-d8365eff-fd0a-41a5-a135-d21b2df24315 tempest-GroupsTest-403774582 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:25:00 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-d8365eff-fd0a-41a5-a135-d21b2df24315 tempest-GroupsTest-403774582 None] Delete group completed successfully. Sep 28 17:25:00 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-8b14c117-8e7c-415f-a02f-9080acd91157 tempest-GroupsTest-403774582 None] Created reservations ['770ae957-5b14-4d8d-b737-627cd25591e7'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:25:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8b14c117-8e7c-415f-a02f-9080acd91157 tempest-GroupsTest-403774582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8b14c117-8e7c-415f-a02f-9080acd91157 tempest-GroupsTest-403774582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:00 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-8b14c117-8e7c-415f-a02f-9080acd91157 tempest-GroupsTest-403774582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:00 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-8b14c117-8e7c-415f-a02f-9080acd91157 tempest-GroupsTest-403774582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8b14c117-8e7c-415f-a02f-9080acd91157 tempest-GroupsTest-403774582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8b14c117-8e7c-415f-a02f-9080acd91157 tempest-GroupsTest-403774582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:00 devstack sudo[103032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:25:00 devstack sudo[103032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:00 devstack sudo[103032]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8b14c117-8e7c-415f-a02f-9080acd91157 tempest-GroupsTest-403774582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.296s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:00 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-8b14c117-8e7c-415f-a02f-9080acd91157 tempest-GroupsTest-403774582 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:25:00 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-8b14c117-8e7c-415f-a02f-9080acd91157 tempest-GroupsTest-403774582 None] Delete group completed successfully. Sep 28 17:25:01 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-5f2920e1-32a4-4692-bf67-d230ad9af16f tempest-GroupsTest-403774582 None] Group tempest-GroupsTest-Group-1372741398: creating Sep 28 17:25:01 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-5f2920e1-32a4-4692-bf67-d230ad9af16f tempest-GroupsTest-403774582 None] Group tempest-GroupsTest-Group-1372741398: created successfully Sep 28 17:25:01 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-5f2920e1-32a4-4692-bf67-d230ad9af16f tempest-GroupsTest-403774582 None] Create group completed successfully. Sep 28 17:25:03 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-808bc3d5-75a3-4869-864d-09d4d6864838 tempest-GroupsTest-403774582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:25:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-808bc3d5-75a3-4869-864d-09d4d6864838 tempest-GroupsTest-403774582 None] Flow 'volume_create_manager' (76110710-9087-463b-894c-b6983bc88593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-808bc3d5-75a3-4869-864d-09d4d6864838 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed7e1de-0e71-4f95-a064-b06ead1d4677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-808bc3d5-75a3-4869-864d-09d4d6864838 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed7e1de-0e71-4f95-a064-b06ead1d4677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-865276057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e1ce4ad7-249d-488a-bc4c-0f60ece08219,host='devstack@QuobyteHD#QuobyteHD',id=f337e6d9-6509-49c1-966a-f16fad8a013b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='044206eb374e443d9fbc813012215a3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:04Z,use_quota=True,user_id='4a75d9099b004b77bca6fe6961bf83d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1289f6b-2a9c-419f-b534-65647ef86e8c),volume_type_id=e1289f6b-2a9c-419f-b534-65647ef86e8c)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-808bc3d5-75a3-4869-864d-09d4d6864838 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be3157e6-0385-4cb5-a502-57e7b8aa1bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-808bc3d5-75a3-4869-864d-09d4d6864838 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be3157e6-0385-4cb5-a502-57e7b8aa1bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-808bc3d5-75a3-4869-864d-09d4d6864838 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (011f8d0a-e9c6-4ec1-b2c8-2afa88c09ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-808bc3d5-75a3-4869-864d-09d4d6864838 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (011f8d0a-e9c6-4ec1-b2c8-2afa88c09ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f337e6d9-6509-49c1-966a-f16fad8a013b', 'volume_name': 'volume-f337e6d9-6509-49c1-966a-f16fad8a013b', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-808bc3d5-75a3-4869-864d-09d4d6864838 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c40a88-2625-4e04-bd1d-f7dd4619791b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-808bc3d5-75a3-4869-864d-09d4d6864838 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c40a88-2625-4e04-bd1d-f7dd4619791b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-808bc3d5-75a3-4869-864d-09d4d6864838 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (542c2601-513d-4934-915e-bab284fa3520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:03 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-808bc3d5-75a3-4869-864d-09d4d6864838 tempest-GroupsTest-403774582 None] Volume f337e6d9-6509-49c1-966a-f16fad8a013b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f337e6d9-6509-49c1-966a-f16fad8a013b', 'volume_size': 1} Sep 28 17:25:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-808bc3d5-75a3-4869-864d-09d4d6864838 tempest-GroupsTest-403774582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-808bc3d5-75a3-4869-864d-09d4d6864838 tempest-GroupsTest-403774582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:03 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-808bc3d5-75a3-4869-864d-09d4d6864838 tempest-GroupsTest-403774582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e1ce4ad7-249d-488a-bc4c-0f60ece08219,created_at=2026-09-28T15:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-865276057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e1ce4ad7-249d-488a-bc4c-0f60ece08219,host='devstack@QuobyteHD#QuobyteHD',id=f337e6d9-6509-49c1-966a-f16fad8a013b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='044206eb374e443d9fbc813012215a3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:04Z,use_quota=True,user_id='4a75d9099b004b77bca6fe6961bf83d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1289f6b-2a9c-419f-b534-65647ef86e8c),volume_type_id=e1289f6b-2a9c-419f-b534-65647ef86e8c)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:25:03 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-808bc3d5-75a3-4869-864d-09d4d6864838 tempest-GroupsTest-403774582 None] Creating volume f337e6d9-6509-49c1-966a-f16fad8a013b {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:25:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-808bc3d5-75a3-4869-864d-09d4d6864838 tempest-GroupsTest-403774582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-808bc3d5-75a3-4869-864d-09d4d6864838 tempest-GroupsTest-403774582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:03 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-808bc3d5-75a3-4869-864d-09d4d6864838 tempest-GroupsTest-403774582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:03 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-808bc3d5-75a3-4869-864d-09d4d6864838 tempest-GroupsTest-403774582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-808bc3d5-75a3-4869-864d-09d4d6864838 tempest-GroupsTest-403774582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:03 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-808bc3d5-75a3-4869-864d-09d4d6864838 tempest-GroupsTest-403774582 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:25:03 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-808bc3d5-75a3-4869-864d-09d4d6864838 tempest-GroupsTest-403774582 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:25:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-808bc3d5-75a3-4869-864d-09d4d6864838 tempest-GroupsTest-403774582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f337e6d9-6509-49c1-966a-f16fad8a013b 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:03 devstack sudo[103039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f337e6d9-6509-49c1-966a-f16fad8a013b 1073741824 Sep 28 17:25:03 devstack sudo[103039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:04 devstack sudo[103039]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-808bc3d5-75a3-4869-864d-09d4d6864838 tempest-GroupsTest-403774582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f337e6d9-6509-49c1-966a-f16fad8a013b 1073741824" returned: 0 in 0.460s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-808bc3d5-75a3-4869-864d-09d4d6864838 tempest-GroupsTest-403774582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f337e6d9-6509-49c1-966a-f16fad8a013b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:04 devstack sudo[103045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f337e6d9-6509-49c1-966a-f16fad8a013b Sep 28 17:25:04 devstack sudo[103045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:04 devstack sudo[103045]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-808bc3d5-75a3-4869-864d-09d4d6864838 tempest-GroupsTest-403774582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f337e6d9-6509-49c1-966a-f16fad8a013b" returned: 0 in 0.255s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:04 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-808bc3d5-75a3-4869-864d-09d4d6864838 tempest-GroupsTest-403774582 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:25:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-808bc3d5-75a3-4869-864d-09d4d6864838 tempest-GroupsTest-403774582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:04 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-808bc3d5-75a3-4869-864d-09d4d6864838 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (542c2601-513d-4934-915e-bab284fa3520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f337e6d9-6509-49c1-966a-f16fad8a013b', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:04 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-808bc3d5-75a3-4869-864d-09d4d6864838 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e305b1-e616-4f54-b90c-b3f4e75d6f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:04 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-808bc3d5-75a3-4869-864d-09d4d6864838 tempest-GroupsTest-403774582 None] Volume volume-f337e6d9-6509-49c1-966a-f16fad8a013b (f337e6d9-6509-49c1-966a-f16fad8a013b): created successfully Sep 28 17:25:04 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-808bc3d5-75a3-4869-864d-09d4d6864838 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e305b1-e616-4f54-b90c-b3f4e75d6f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:04 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-808bc3d5-75a3-4869-864d-09d4d6864838 tempest-GroupsTest-403774582 None] Flow 'volume_create_manager' (76110710-9087-463b-894c-b6983bc88593) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:04 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-808bc3d5-75a3-4869-864d-09d4d6864838 tempest-GroupsTest-403774582 None] Created volume successfully. Sep 28 17:25:05 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-93706115-1bab-4f89-8c0d-393f514558b1 tempest-GroupsTest-403774582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:25:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-93706115-1bab-4f89-8c0d-393f514558b1 tempest-GroupsTest-403774582 None] Flow 'volume_create_manager' (ebe2ccff-7117-467c-94be-1dccfd82d6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-93706115-1bab-4f89-8c0d-393f514558b1 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fec115c-95d4-49ba-8f65-746524a95a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-93706115-1bab-4f89-8c0d-393f514558b1 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fec115c-95d4-49ba-8f65-746524a95a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-400441466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e1ce4ad7-249d-488a-bc4c-0f60ece08219,host='devstack@QuobyteHD#QuobyteHD',id=3b0b318e-126a-4b21-8d51-ce9862be0b87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='044206eb374e443d9fbc813012215a3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:05Z,use_quota=True,user_id='4a75d9099b004b77bca6fe6961bf83d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1289f6b-2a9c-419f-b534-65647ef86e8c),volume_type_id=e1289f6b-2a9c-419f-b534-65647ef86e8c)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-93706115-1bab-4f89-8c0d-393f514558b1 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fce36f42-be52-4c70-8446-3d593e3d8649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-93706115-1bab-4f89-8c0d-393f514558b1 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fce36f42-be52-4c70-8446-3d593e3d8649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-93706115-1bab-4f89-8c0d-393f514558b1 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2b1f597-b41f-43c6-b17e-7cd76183f84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-93706115-1bab-4f89-8c0d-393f514558b1 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2b1f597-b41f-43c6-b17e-7cd76183f84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b0b318e-126a-4b21-8d51-ce9862be0b87', 'volume_name': 'volume-3b0b318e-126a-4b21-8d51-ce9862be0b87', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-93706115-1bab-4f89-8c0d-393f514558b1 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ad380c-3ab0-46fa-b28d-40a8022a9a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-93706115-1bab-4f89-8c0d-393f514558b1 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ad380c-3ab0-46fa-b28d-40a8022a9a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-93706115-1bab-4f89-8c0d-393f514558b1 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5ae2254-44b3-4bfa-a232-b77888a4c3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:05 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-93706115-1bab-4f89-8c0d-393f514558b1 tempest-GroupsTest-403774582 None] Volume 3b0b318e-126a-4b21-8d51-ce9862be0b87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b0b318e-126a-4b21-8d51-ce9862be0b87', 'volume_size': 1} Sep 28 17:25:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-93706115-1bab-4f89-8c0d-393f514558b1 tempest-GroupsTest-403774582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-93706115-1bab-4f89-8c0d-393f514558b1 tempest-GroupsTest-403774582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-93706115-1bab-4f89-8c0d-393f514558b1 tempest-GroupsTest-403774582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e1ce4ad7-249d-488a-bc4c-0f60ece08219,created_at=2026-09-28T15:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-400441466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e1ce4ad7-249d-488a-bc4c-0f60ece08219,host='devstack@QuobyteHD#QuobyteHD',id=3b0b318e-126a-4b21-8d51-ce9862be0b87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='044206eb374e443d9fbc813012215a3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:05Z,use_quota=True,user_id='4a75d9099b004b77bca6fe6961bf83d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1289f6b-2a9c-419f-b534-65647ef86e8c),volume_type_id=e1289f6b-2a9c-419f-b534-65647ef86e8c)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:25:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-93706115-1bab-4f89-8c0d-393f514558b1 tempest-GroupsTest-403774582 None] Creating volume 3b0b318e-126a-4b21-8d51-ce9862be0b87 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:25:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-93706115-1bab-4f89-8c0d-393f514558b1 tempest-GroupsTest-403774582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-93706115-1bab-4f89-8c0d-393f514558b1 tempest-GroupsTest-403774582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-93706115-1bab-4f89-8c0d-393f514558b1 tempest-GroupsTest-403774582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-93706115-1bab-4f89-8c0d-393f514558b1 tempest-GroupsTest-403774582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-93706115-1bab-4f89-8c0d-393f514558b1 tempest-GroupsTest-403774582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-93706115-1bab-4f89-8c0d-393f514558b1 tempest-GroupsTest-403774582 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:25:05 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-93706115-1bab-4f89-8c0d-393f514558b1 tempest-GroupsTest-403774582 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:25:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-93706115-1bab-4f89-8c0d-393f514558b1 tempest-GroupsTest-403774582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3b0b318e-126a-4b21-8d51-ce9862be0b87 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:05 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3b0b318e-126a-4b21-8d51-ce9862be0b87 1073741824 Sep 28 17:25:05 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:05 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-93706115-1bab-4f89-8c0d-393f514558b1 tempest-GroupsTest-403774582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3b0b318e-126a-4b21-8d51-ce9862be0b87 1073741824" returned: 0 in 0.465s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-93706115-1bab-4f89-8c0d-393f514558b1 tempest-GroupsTest-403774582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3b0b318e-126a-4b21-8d51-ce9862be0b87 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:06 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3b0b318e-126a-4b21-8d51-ce9862be0b87 Sep 28 17:25:06 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:06 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-93706115-1bab-4f89-8c0d-393f514558b1 tempest-GroupsTest-403774582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3b0b318e-126a-4b21-8d51-ce9862be0b87" returned: 0 in 0.267s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:06 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-93706115-1bab-4f89-8c0d-393f514558b1 tempest-GroupsTest-403774582 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:25:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-93706115-1bab-4f89-8c0d-393f514558b1 tempest-GroupsTest-403774582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:06 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-93706115-1bab-4f89-8c0d-393f514558b1 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5ae2254-44b3-4bfa-a232-b77888a4c3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b0b318e-126a-4b21-8d51-ce9862be0b87', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:06 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-93706115-1bab-4f89-8c0d-393f514558b1 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b179d8d-50f4-4309-9810-0559e0cc1ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:06 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-93706115-1bab-4f89-8c0d-393f514558b1 tempest-GroupsTest-403774582 None] Volume volume-3b0b318e-126a-4b21-8d51-ce9862be0b87 (3b0b318e-126a-4b21-8d51-ce9862be0b87): created successfully Sep 28 17:25:06 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-93706115-1bab-4f89-8c0d-393f514558b1 tempest-GroupsTest-403774582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b179d8d-50f4-4309-9810-0559e0cc1ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:06 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-93706115-1bab-4f89-8c0d-393f514558b1 tempest-GroupsTest-403774582 None] Flow 'volume_create_manager' (ebe2ccff-7117-467c-94be-1dccfd82d6cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:06 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-93706115-1bab-4f89-8c0d-393f514558b1 tempest-GroupsTest-403774582 None] Created volume successfully. Sep 28 17:25:06 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-93b6c785-a302-43b7-a18a-c4a922d81609 tempest-GroupsTest-403774582 None] Update group completed successfully. Sep 28 17:25:08 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-5795efa3-e501-4c8d-8a85-57cef051ac3b tempest-GroupsTest-403774582 None] Update group completed successfully. Sep 28 17:25:09 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-3d749a75-3e5a-4b43-92f6-3f44658922ea tempest-GroupsTest-403774582 None] Acquiring lock "cinder-quobyte-3b0b318e-126a-4b21-8d51-ce9862be0b87" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:09 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-3d749a75-3e5a-4b43-92f6-3f44658922ea tempest-GroupsTest-403774582 None] Lock "cinder-quobyte-3b0b318e-126a-4b21-8d51-ce9862be0b87" acquired by "delete_volume" :: waited 0.015s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:09 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbfe77a-1b37-4307-b4bc-aa8cc20df0b5]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3d749a75-3e5a-4b43-92f6-3f44658922ea tempest-GroupsTest-403774582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3b0b318e-126a-4b21-8d51-ce9862be0b87 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:09 devstack sudo[103056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3b0b318e-126a-4b21-8d51-ce9862be0b87 Sep 28 17:25:09 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:10 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3d749a75-3e5a-4b43-92f6-3f44658922ea tempest-GroupsTest-403774582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3b0b318e-126a-4b21-8d51-ce9862be0b87" returned: 0 in 0.382s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3d749a75-3e5a-4b43-92f6-3f44658922ea tempest-GroupsTest-403774582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3b0b318e-126a-4b21-8d51-ce9862be0b87 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:10 devstack sudo[103061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3b0b318e-126a-4b21-8d51-ce9862be0b87 Sep 28 17:25:10 devstack sudo[103061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:10 devstack sudo[103061]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3d749a75-3e5a-4b43-92f6-3f44658922ea tempest-GroupsTest-403774582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3b0b318e-126a-4b21-8d51-ce9862be0b87" returned: 0 in 0.240s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:10 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-3d749a75-3e5a-4b43-92f6-3f44658922ea tempest-GroupsTest-403774582 None] Lock "cinder-quobyte-3b0b318e-126a-4b21-8d51-ce9862be0b87" released by "delete_volume" :: held 0.671s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:10 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-3d749a75-3e5a-4b43-92f6-3f44658922ea tempest-GroupsTest-403774582 None] Acquiring lock "cinder-quobyte-f337e6d9-6509-49c1-966a-f16fad8a013b" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:10 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-3d749a75-3e5a-4b43-92f6-3f44658922ea tempest-GroupsTest-403774582 None] Lock "cinder-quobyte-f337e6d9-6509-49c1-966a-f16fad8a013b" acquired by "delete_volume" :: waited 0.015s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:10 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cd7d3f-136c-4e8a-9623-b929d6e7344d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3d749a75-3e5a-4b43-92f6-3f44658922ea tempest-GroupsTest-403774582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f337e6d9-6509-49c1-966a-f16fad8a013b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:10 devstack sudo[103064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f337e6d9-6509-49c1-966a-f16fad8a013b Sep 28 17:25:10 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:10 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3d749a75-3e5a-4b43-92f6-3f44658922ea tempest-GroupsTest-403774582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f337e6d9-6509-49c1-966a-f16fad8a013b" returned: 0 in 0.359s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3d749a75-3e5a-4b43-92f6-3f44658922ea tempest-GroupsTest-403774582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f337e6d9-6509-49c1-966a-f16fad8a013b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:10 devstack sudo[103069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f337e6d9-6509-49c1-966a-f16fad8a013b Sep 28 17:25:10 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:11 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3d749a75-3e5a-4b43-92f6-3f44658922ea tempest-GroupsTest-403774582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-f337e6d9-6509-49c1-966a-f16fad8a013b" returned: 0 in 0.258s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:11 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-3d749a75-3e5a-4b43-92f6-3f44658922ea tempest-GroupsTest-403774582 None] Lock "cinder-quobyte-f337e6d9-6509-49c1-966a-f16fad8a013b" released by "delete_volume" :: held 0.659s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:11 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-3d749a75-3e5a-4b43-92f6-3f44658922ea tempest-GroupsTest-403774582 None] Created reservations ['e7e3a65b-f001-45c7-98bc-1b473d00a67a'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:25:11 devstack cinder-volume[86917]: WARNING cinder.quota [None req-3d749a75-3e5a-4b43-92f6-3f44658922ea tempest-GroupsTest-403774582 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1772409039 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1772409039, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:25:11 devstack cinder-volume[86917]: WARNING cinder.quota [None req-3d749a75-3e5a-4b43-92f6-3f44658922ea tempest-GroupsTest-403774582 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1772409039 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1772409039, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:25:11 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-3d749a75-3e5a-4b43-92f6-3f44658922ea tempest-GroupsTest-403774582 None] Created reservations ['2c6dae83-3745-4083-9ad0-ef69302f330a', '2a28fc3f-f294-43f8-8584-3ae418eb0a21', '4841c07f-9b02-4018-ac85-1ff6b3eef18d', 'b8897d78-79f3-45e0-b015-53191ac23b9c'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:25:11 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-3d749a75-3e5a-4b43-92f6-3f44658922ea tempest-GroupsTest-403774582 None] Created reservations ['0a09defb-3d76-425c-85fe-d15fa5c18253', '5899c911-be9b-436d-8fae-a0395e2ac5c9', 'ce2487b4-b3c5-4ec8-93f6-877c25edb434', 'd52a528e-3682-493d-92df-b0bc6a23f3a9'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:25:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3d749a75-3e5a-4b43-92f6-3f44658922ea tempest-GroupsTest-403774582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3d749a75-3e5a-4b43-92f6-3f44658922ea tempest-GroupsTest-403774582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-3d749a75-3e5a-4b43-92f6-3f44658922ea tempest-GroupsTest-403774582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-3d749a75-3e5a-4b43-92f6-3f44658922ea tempest-GroupsTest-403774582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3d749a75-3e5a-4b43-92f6-3f44658922ea tempest-GroupsTest-403774582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3d749a75-3e5a-4b43-92f6-3f44658922ea tempest-GroupsTest-403774582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:11 devstack sudo[103073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:25:11 devstack sudo[103073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:11 devstack sudo[103073]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3d749a75-3e5a-4b43-92f6-3f44658922ea tempest-GroupsTest-403774582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.268s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:11 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-3d749a75-3e5a-4b43-92f6-3f44658922ea tempest-GroupsTest-403774582 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:25:11 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-3d749a75-3e5a-4b43-92f6-3f44658922ea tempest-GroupsTest-403774582 None] Delete group completed successfully. Sep 28 17:25:18 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-54c48e4c-2aa8-42ca-b79b-a950e9ad4df1 tempest-GroupsV314Test-670191561 None] Group tempest-GroupsV314Test-Group-489719071: creating Sep 28 17:25:18 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-54c48e4c-2aa8-42ca-b79b-a950e9ad4df1 tempest-GroupsV314Test-670191561 None] Group tempest-GroupsV314Test-Group-489719071: created successfully Sep 28 17:25:18 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-54c48e4c-2aa8-42ca-b79b-a950e9ad4df1 tempest-GroupsV314Test-670191561 None] Create group completed successfully. Sep 28 17:25:19 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-41969a2c-d6f6-4752-8cab-0682c285896c tempest-GroupsV314Test-670191561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:25:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-41969a2c-d6f6-4752-8cab-0682c285896c tempest-GroupsV314Test-670191561 None] Flow 'volume_create_manager' (234fcab2-ca8f-4504-8d77-10c5a7d93d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-41969a2c-d6f6-4752-8cab-0682c285896c tempest-GroupsV314Test-670191561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63550eeb-94c1-4cf7-aa39-0935ba5df1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-41969a2c-d6f6-4752-8cab-0682c285896c tempest-GroupsV314Test-670191561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63550eeb-94c1-4cf7-aa39-0935ba5df1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1187296888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eab717da-c6ba-4b03-9bec-aeca1cd5a084,host='devstack@QuobyteHD#QuobyteHD',id=93a83ebc-7685-4205-8014-736bb5243b45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e517066c2494289955ecb845109fa28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:20Z,use_quota=True,user_id='985416920e2747058334f62fb114426c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23db6d2f-59be-46c2-a830-061ed0f1de98),volume_type_id=23db6d2f-59be-46c2-a830-061ed0f1de98)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-41969a2c-d6f6-4752-8cab-0682c285896c tempest-GroupsV314Test-670191561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3eee992-8c39-47e4-bca4-38f1d9cb7b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-41969a2c-d6f6-4752-8cab-0682c285896c tempest-GroupsV314Test-670191561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3eee992-8c39-47e4-bca4-38f1d9cb7b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-41969a2c-d6f6-4752-8cab-0682c285896c tempest-GroupsV314Test-670191561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cdd3ca5-eba4-490b-aeb7-ac741b6afd78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-41969a2c-d6f6-4752-8cab-0682c285896c tempest-GroupsV314Test-670191561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cdd3ca5-eba4-490b-aeb7-ac741b6afd78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93a83ebc-7685-4205-8014-736bb5243b45', 'volume_name': 'volume-93a83ebc-7685-4205-8014-736bb5243b45', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-41969a2c-d6f6-4752-8cab-0682c285896c tempest-GroupsV314Test-670191561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa7e0901-4306-47a2-8e98-987ed54fd871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-41969a2c-d6f6-4752-8cab-0682c285896c tempest-GroupsV314Test-670191561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa7e0901-4306-47a2-8e98-987ed54fd871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-41969a2c-d6f6-4752-8cab-0682c285896c tempest-GroupsV314Test-670191561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb11893-001a-4c61-b09d-e2c4f906f953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:19 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-41969a2c-d6f6-4752-8cab-0682c285896c tempest-GroupsV314Test-670191561 None] Volume 93a83ebc-7685-4205-8014-736bb5243b45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93a83ebc-7685-4205-8014-736bb5243b45', 'volume_size': 1} Sep 28 17:25:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-41969a2c-d6f6-4752-8cab-0682c285896c tempest-GroupsV314Test-670191561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-41969a2c-d6f6-4752-8cab-0682c285896c tempest-GroupsV314Test-670191561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-41969a2c-d6f6-4752-8cab-0682c285896c tempest-GroupsV314Test-670191561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=eab717da-c6ba-4b03-9bec-aeca1cd5a084,created_at=2026-09-28T15:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1187296888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eab717da-c6ba-4b03-9bec-aeca1cd5a084,host='devstack@QuobyteHD#QuobyteHD',id=93a83ebc-7685-4205-8014-736bb5243b45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e517066c2494289955ecb845109fa28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:20Z,use_quota=True,user_id='985416920e2747058334f62fb114426c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23db6d2f-59be-46c2-a830-061ed0f1de98),volume_type_id=23db6d2f-59be-46c2-a830-061ed0f1de98)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:25:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-41969a2c-d6f6-4752-8cab-0682c285896c tempest-GroupsV314Test-670191561 None] Creating volume 93a83ebc-7685-4205-8014-736bb5243b45 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:25:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-41969a2c-d6f6-4752-8cab-0682c285896c tempest-GroupsV314Test-670191561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-41969a2c-d6f6-4752-8cab-0682c285896c tempest-GroupsV314Test-670191561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-41969a2c-d6f6-4752-8cab-0682c285896c tempest-GroupsV314Test-670191561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-41969a2c-d6f6-4752-8cab-0682c285896c tempest-GroupsV314Test-670191561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-41969a2c-d6f6-4752-8cab-0682c285896c tempest-GroupsV314Test-670191561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-41969a2c-d6f6-4752-8cab-0682c285896c tempest-GroupsV314Test-670191561 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:25:19 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-41969a2c-d6f6-4752-8cab-0682c285896c tempest-GroupsV314Test-670191561 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:25:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-41969a2c-d6f6-4752-8cab-0682c285896c tempest-GroupsV314Test-670191561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:19 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45 1073741824 Sep 28 17:25:19 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:20 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-41969a2c-d6f6-4752-8cab-0682c285896c tempest-GroupsV314Test-670191561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45 1073741824" returned: 0 in 0.447s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-41969a2c-d6f6-4752-8cab-0682c285896c tempest-GroupsV314Test-670191561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:20 devstack sudo[103507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45 Sep 28 17:25:20 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:20 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-41969a2c-d6f6-4752-8cab-0682c285896c tempest-GroupsV314Test-670191561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45" returned: 0 in 0.283s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-41969a2c-d6f6-4752-8cab-0682c285896c tempest-GroupsV314Test-670191561 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:25:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-41969a2c-d6f6-4752-8cab-0682c285896c tempest-GroupsV314Test-670191561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-41969a2c-d6f6-4752-8cab-0682c285896c tempest-GroupsV314Test-670191561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb11893-001a-4c61-b09d-e2c4f906f953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93a83ebc-7685-4205-8014-736bb5243b45', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-41969a2c-d6f6-4752-8cab-0682c285896c tempest-GroupsV314Test-670191561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (019cd14c-0d1f-44f8-b8b9-2f220efa37fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:20 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-41969a2c-d6f6-4752-8cab-0682c285896c tempest-GroupsV314Test-670191561 None] Volume volume-93a83ebc-7685-4205-8014-736bb5243b45 (93a83ebc-7685-4205-8014-736bb5243b45): created successfully Sep 28 17:25:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-41969a2c-d6f6-4752-8cab-0682c285896c tempest-GroupsV314Test-670191561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (019cd14c-0d1f-44f8-b8b9-2f220efa37fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-41969a2c-d6f6-4752-8cab-0682c285896c tempest-GroupsV314Test-670191561 None] Flow 'volume_create_manager' (234fcab2-ca8f-4504-8d77-10c5a7d93d60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:20 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-41969a2c-d6f6-4752-8cab-0682c285896c tempest-GroupsV314Test-670191561 None] Created volume successfully. Sep 28 17:25:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:21 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Cloning volume 93a83ebc-7685-4205-8014-736bb5243b45 to volume 027cb1af-e457-4c75-a966-9f31b6353b8e Sep 28 17:25:21 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Creating offline snapshot b9cc1db2-851b-41f7-ba26-12afed8bcdfd of volume 93a83ebc-7685-4205-8014-736bb5243b45 {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:25:21 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f619ba3-e9e6-4882-89d8-6496054c819e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:21 devstack sudo[103511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45 Sep 28 17:25:21 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:22 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45" returned: 0 in 0.429s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45.b9cc1db2-851b-41f7-ba26-12afed8bcdfd 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:22 devstack sudo[103516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45.b9cc1db2-851b-41f7-ba26-12afed8bcdfd 1G Sep 28 17:25:22 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:22 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45.b9cc1db2-851b-41f7-ba26-12afed8bcdfd 1G" returned: 0 in 0.443s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93a83ebc-7685-4205-8014-736bb5243b45 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45.b9cc1db2-851b-41f7-ba26-12afed8bcdfd {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:22 devstack sudo[103521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93a83ebc-7685-4205-8014-736bb5243b45 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45.b9cc1db2-851b-41f7-ba26-12afed8bcdfd Sep 28 17:25:22 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:22 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93a83ebc-7685-4205-8014-736bb5243b45 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45.b9cc1db2-851b-41f7-ba26-12afed8bcdfd" returned: 0 in 0.316s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:22 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45.b9cc1db2-851b-41f7-ba26-12afed8bcdfd is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:25:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45.b9cc1db2-851b-41f7-ba26-12afed8bcdfd {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:22 devstack sudo[103526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45.b9cc1db2-851b-41f7-ba26-12afed8bcdfd Sep 28 17:25:22 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:23 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45.b9cc1db2-851b-41f7-ba26-12afed8bcdfd" returned: 0 in 0.312s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:23 devstack sudo[103529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45.info Sep 28 17:25:23 devstack sudo[103529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:23 devstack sudo[103529]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45.info" returned: 0 in 0.269s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:23 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:25:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:23 devstack sudo[103532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45.info Sep 28 17:25:23 devstack sudo[103532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:23 devstack sudo[103532]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45.info" returned: 0 in 0.293s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:23 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Acquiring lock "cinder-quobyte-027cb1af-e457-4c75-a966-9f31b6353b8e" by "_copy_volume_from_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:23 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Lock "cinder-quobyte-027cb1af-e457-4c75-a966-9f31b6353b8e" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:23 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] snapshot: b9cc1db2-851b-41f7-ba26-12afed8bcdfd, volume: 027cb1af-e457-4c75-a966-9f31b6353b8e, {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:25:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:23 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:23 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:23 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d41031-65fb-4884-924d-aa31cd5646ea]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45.b9cc1db2-851b-41f7-ba26-12afed8bcdfd {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:24 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45.b9cc1db2-851b-41f7-ba26-12afed8bcdfd Sep 28 17:25:24 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:24 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45.b9cc1db2-851b-41f7-ba26-12afed8bcdfd" returned: 0 in 0.455s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93a83ebc-7685-4205-8014-736bb5243b45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:25:24 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d62544b-ab37-4159-8331-5b48bde1e773]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:24 devstack sudo[103541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45 Sep 28 17:25:24 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:24 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45" returned: 0 in 0.393s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45 {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:25:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Creating direct copy from snapshot {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:25:24 devstack cinder-volume[86917]: DEBUG cinder.utils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Path /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-027cb1af-e457-4c75-a966-9f31b6353b8e not found in is_blk_device check {{(pid=86917) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:25:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-027cb1af-e457-4c75-a966-9f31b6353b8e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:24 devstack sudo[103546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-027cb1af-e457-4c75-a966-9f31b6353b8e Sep 28 17:25:24 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:31 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-027cb1af-e457-4c75-a966-9f31b6353b8e" returned: 0 in 6.781s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:31 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Image conversion details: src /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45, size 1024.00 MB, duration 6.78 sec, destination /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-027cb1af-e457-4c75-a966-9f31b6353b8e {{(pid=86917) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:25:31 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Converted 1024.00 MB image at 150.98 MB/s Sep 28 17:25:31 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-027cb1af-e457-4c75-a966-9f31b6353b8e is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:25:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-027cb1af-e457-4c75-a966-9f31b6353b8e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:31 devstack sudo[103596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-027cb1af-e457-4c75-a966-9f31b6353b8e Sep 28 17:25:31 devstack sudo[103596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:31 devstack sudo[103596]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-027cb1af-e457-4c75-a966-9f31b6353b8e" returned: 0 in 0.271s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:31 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Lock "cinder-quobyte-027cb1af-e457-4c75-a966-9f31b6353b8e" released by "_copy_volume_from_snapshot" :: held 7.988s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:31 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Acquiring lock "cinder-quobyte-b9cc1db2-851b-41f7-ba26-12afed8bcdfd" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:31 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Lock "cinder-quobyte-b9cc1db2-851b-41f7-ba26-12afed8bcdfd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Deleting offline snapshot b9cc1db2-851b-41f7-ba26-12afed8bcdfd of volume 93a83ebc-7685-4205-8014-736bb5243b45 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:25:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] snapshot_file for this snap is: volume-93a83ebc-7685-4205-8014-736bb5243b45.b9cc1db2-851b-41f7-ba26-12afed8bcdfd {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:25:31 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f503b2-7e9b-436f-9c85-b110394967c3]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45.b9cc1db2-851b-41f7-ba26-12afed8bcdfd {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:31 devstack sudo[103599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45.b9cc1db2-851b-41f7-ba26-12afed8bcdfd Sep 28 17:25:31 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:32 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45.b9cc1db2-851b-41f7-ba26-12afed8bcdfd" returned: 0 in 0.418s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93a83ebc-7685-4205-8014-736bb5243b45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:25:32 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c50359-ce56-499d-9be3-56d1bcec1480]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:32 devstack sudo[103604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45 Sep 28 17:25:32 devstack sudo[103604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:32 devstack sudo[103604]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45" returned: 0 in 0.618s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45.b9cc1db2-851b-41f7-ba26-12afed8bcdfd {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:32 devstack sudo[103609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45.b9cc1db2-851b-41f7-ba26-12afed8bcdfd Sep 28 17:25:32 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:33 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:DELETE=3,cinder:UPDATE=79,cinder:SELECT=81,cinder:INSERT=19 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:25:33 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45.b9cc1db2-851b-41f7-ba26-12afed8bcdfd" returned: 0 in 0.385s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45.b9cc1db2-851b-41f7-ba26-12afed8bcdfd {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:33 devstack sudo[103615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45.b9cc1db2-851b-41f7-ba26-12afed8bcdfd Sep 28 17:25:33 devstack sudo[103615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:33 devstack sudo[103615]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45.b9cc1db2-851b-41f7-ba26-12afed8bcdfd" returned: 0 in 0.267s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:33 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Lock "cinder-quobyte-b9cc1db2-851b-41f7-ba26-12afed8bcdfd" released by "_delete_snapshot" :: held 1.797s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.057s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:33 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-34f057e9-b43d-4f78-a1b6-0176cc3eac85 tempest-GroupsV314Test-670191561 None] Create group from source-group-eab717da-c6ba-4b03-9bec-aeca1cd5a084 completed successfully. Sep 28 17:25:34 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8205056d-9144-43cd-868f-bbd92bc7d5dc tempest-GroupsV314Test-670191561 None] Acquiring lock "cinder-quobyte-027cb1af-e457-4c75-a966-9f31b6353b8e" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:34 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8205056d-9144-43cd-868f-bbd92bc7d5dc tempest-GroupsV314Test-670191561 None] Lock "cinder-quobyte-027cb1af-e457-4c75-a966-9f31b6353b8e" acquired by "delete_volume" :: waited 0.018s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:34 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[901d73e6-821d-4425-b4ed-5b0be772a87b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8205056d-9144-43cd-868f-bbd92bc7d5dc tempest-GroupsV314Test-670191561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-027cb1af-e457-4c75-a966-9f31b6353b8e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:34 devstack sudo[103618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-027cb1af-e457-4c75-a966-9f31b6353b8e Sep 28 17:25:34 devstack sudo[103618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:35 devstack sudo[103618]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8205056d-9144-43cd-868f-bbd92bc7d5dc tempest-GroupsV314Test-670191561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-027cb1af-e457-4c75-a966-9f31b6353b8e" returned: 0 in 0.446s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8205056d-9144-43cd-868f-bbd92bc7d5dc tempest-GroupsV314Test-670191561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-027cb1af-e457-4c75-a966-9f31b6353b8e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:35 devstack sudo[103623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-027cb1af-e457-4c75-a966-9f31b6353b8e Sep 28 17:25:35 devstack sudo[103623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:35 devstack sudo[103623]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8205056d-9144-43cd-868f-bbd92bc7d5dc tempest-GroupsV314Test-670191561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-027cb1af-e457-4c75-a966-9f31b6353b8e" returned: 0 in 0.361s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:35 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8205056d-9144-43cd-868f-bbd92bc7d5dc tempest-GroupsV314Test-670191561 None] Lock "cinder-quobyte-027cb1af-e457-4c75-a966-9f31b6353b8e" released by "delete_volume" :: held 0.863s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:35 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-8205056d-9144-43cd-868f-bbd92bc7d5dc tempest-GroupsV314Test-670191561 None] Created reservations ['7b9ac947-bebb-419b-80d0-83ddffcaabf3'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:25:35 devstack cinder-volume[86917]: WARNING cinder.quota [None req-8205056d-9144-43cd-868f-bbd92bc7d5dc tempest-GroupsV314Test-670191561 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-859040555 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-859040555, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:25:35 devstack cinder-volume[86917]: WARNING cinder.quota [None req-8205056d-9144-43cd-868f-bbd92bc7d5dc tempest-GroupsV314Test-670191561 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-859040555 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-859040555, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:25:35 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-8205056d-9144-43cd-868f-bbd92bc7d5dc tempest-GroupsV314Test-670191561 None] Created reservations ['25fd1b92-a584-4f44-8b86-f9d05b8ec509', '0ae599f0-9215-47a0-b450-e57fe9a18aab', 'd477340d-1669-4b74-ac5e-2d4bb29a863a', 'de99d3e0-a4a7-4f3d-be8e-c341b130b308'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:25:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8205056d-9144-43cd-868f-bbd92bc7d5dc tempest-GroupsV314Test-670191561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8205056d-9144-43cd-868f-bbd92bc7d5dc tempest-GroupsV314Test-670191561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:35 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-8205056d-9144-43cd-868f-bbd92bc7d5dc tempest-GroupsV314Test-670191561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:35 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-8205056d-9144-43cd-868f-bbd92bc7d5dc tempest-GroupsV314Test-670191561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8205056d-9144-43cd-868f-bbd92bc7d5dc tempest-GroupsV314Test-670191561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8205056d-9144-43cd-868f-bbd92bc7d5dc tempest-GroupsV314Test-670191561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:35 devstack sudo[103626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:25:35 devstack sudo[103626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:36 devstack sudo[103626]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8205056d-9144-43cd-868f-bbd92bc7d5dc tempest-GroupsV314Test-670191561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.279s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:36 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-8205056d-9144-43cd-868f-bbd92bc7d5dc tempest-GroupsV314Test-670191561 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:25:36 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-8205056d-9144-43cd-868f-bbd92bc7d5dc tempest-GroupsV314Test-670191561 None] Delete group completed successfully. Sep 28 17:25:36 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-67d165f9-c03f-42ba-b296-12063ad2bf94 tempest-GroupsV314Test-670191561 None] Acquiring lock "cinder-quobyte-93a83ebc-7685-4205-8014-736bb5243b45" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:36 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-67d165f9-c03f-42ba-b296-12063ad2bf94 tempest-GroupsV314Test-670191561 None] Lock "cinder-quobyte-93a83ebc-7685-4205-8014-736bb5243b45" acquired by "delete_volume" :: waited 0.018s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:36 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cbed50-a10a-4364-9258-4a8be2549c0c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-67d165f9-c03f-42ba-b296-12063ad2bf94 tempest-GroupsV314Test-670191561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:36 devstack sudo[103629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45 Sep 28 17:25:36 devstack sudo[103629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:36 devstack sudo[103629]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-67d165f9-c03f-42ba-b296-12063ad2bf94 tempest-GroupsV314Test-670191561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45" returned: 0 in 0.444s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-67d165f9-c03f-42ba-b296-12063ad2bf94 tempest-GroupsV314Test-670191561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:36 devstack sudo[103634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45 Sep 28 17:25:36 devstack sudo[103634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:37 devstack sudo[103634]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-67d165f9-c03f-42ba-b296-12063ad2bf94 tempest-GroupsV314Test-670191561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-93a83ebc-7685-4205-8014-736bb5243b45" returned: 0 in 0.302s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:37 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-67d165f9-c03f-42ba-b296-12063ad2bf94 tempest-GroupsV314Test-670191561 None] Lock "cinder-quobyte-93a83ebc-7685-4205-8014-736bb5243b45" released by "delete_volume" :: held 0.824s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:37 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-67d165f9-c03f-42ba-b296-12063ad2bf94 tempest-GroupsV314Test-670191561 None] Created reservations ['035f558f-58c9-42a2-b5c0-4a2548a60701'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:25:37 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-67d165f9-c03f-42ba-b296-12063ad2bf94 tempest-GroupsV314Test-670191561 None] Created reservations ['c92c1b72-ed95-4ef0-8b5c-6e5e248b4ffa', 'cc846657-ee16-42b2-af69-a92a829d200d', 'ff76408b-3b14-409b-9065-153d54d8be08', '31c29559-ea98-48ef-aa6d-263e0220c551'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:25:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-67d165f9-c03f-42ba-b296-12063ad2bf94 tempest-GroupsV314Test-670191561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-67d165f9-c03f-42ba-b296-12063ad2bf94 tempest-GroupsV314Test-670191561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:37 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-67d165f9-c03f-42ba-b296-12063ad2bf94 tempest-GroupsV314Test-670191561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:37 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-67d165f9-c03f-42ba-b296-12063ad2bf94 tempest-GroupsV314Test-670191561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-67d165f9-c03f-42ba-b296-12063ad2bf94 tempest-GroupsV314Test-670191561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-67d165f9-c03f-42ba-b296-12063ad2bf94 tempest-GroupsV314Test-670191561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:37 devstack sudo[103637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:25:37 devstack sudo[103637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:37 devstack sudo[103637]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-67d165f9-c03f-42ba-b296-12063ad2bf94 tempest-GroupsV314Test-670191561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.356s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:37 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-67d165f9-c03f-42ba-b296-12063ad2bf94 tempest-GroupsV314Test-670191561 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:25:37 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-67d165f9-c03f-42ba-b296-12063ad2bf94 tempest-GroupsV314Test-670191561 None] Delete group completed successfully. Sep 28 17:25:47 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:UPDATE=117,cinder:SELECT=90,cinder:INSERT=23,cinder:DELETE=4 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:25:47 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:UPDATE=21,cinder:SELECT=20,cinder:INSERT=3 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:25:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:25:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:49 devstack sudo[103644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:25:49 devstack sudo[103644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:49 devstack sudo[103644]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.259s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:49 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:25:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager._thread_info {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:25:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread count: 28 {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:25:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread info: [<_MainThread(MainThread, started 132915553284224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:25:51 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-427df0da-b320-447b-b0f0-d769dc2fd75c tempest-SnapshotsActionsTest-101682296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:25:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-427df0da-b320-447b-b0f0-d769dc2fd75c tempest-SnapshotsActionsTest-101682296 None] Flow 'volume_create_manager' (5398c4ba-64f4-4958-bdba-c39aca278bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-427df0da-b320-447b-b0f0-d769dc2fd75c tempest-SnapshotsActionsTest-101682296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa21dc85-cc12-4507-bda4-9c0805bc5b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-427df0da-b320-447b-b0f0-d769dc2fd75c tempest-SnapshotsActionsTest-101682296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa21dc85-cc12-4507-bda4-9c0805bc5b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1432730618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe704656-b0bf-45db-900e-382373df1bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69956450c4bd471888f9b245f851e5dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:51Z,use_quota=True,user_id='84ffeab2622846f499120e4990b7a484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-427df0da-b320-447b-b0f0-d769dc2fd75c tempest-SnapshotsActionsTest-101682296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f552eb-4ddf-49fd-a4aa-f927e6821d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-427df0da-b320-447b-b0f0-d769dc2fd75c tempest-SnapshotsActionsTest-101682296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f552eb-4ddf-49fd-a4aa-f927e6821d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-427df0da-b320-447b-b0f0-d769dc2fd75c tempest-SnapshotsActionsTest-101682296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c471edd7-19df-4808-8291-59bd28a4cc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-427df0da-b320-447b-b0f0-d769dc2fd75c tempest-SnapshotsActionsTest-101682296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c471edd7-19df-4808-8291-59bd28a4cc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe704656-b0bf-45db-900e-382373df1bb6', 'volume_name': 'volume-fe704656-b0bf-45db-900e-382373df1bb6', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-427df0da-b320-447b-b0f0-d769dc2fd75c tempest-SnapshotsActionsTest-101682296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84db19ac-6cba-4023-9ea0-4400c0a07780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-427df0da-b320-447b-b0f0-d769dc2fd75c tempest-SnapshotsActionsTest-101682296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84db19ac-6cba-4023-9ea0-4400c0a07780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-427df0da-b320-447b-b0f0-d769dc2fd75c tempest-SnapshotsActionsTest-101682296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3329876a-899a-4d3d-b2e7-b79a53969f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:51 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-427df0da-b320-447b-b0f0-d769dc2fd75c tempest-SnapshotsActionsTest-101682296 None] Volume fe704656-b0bf-45db-900e-382373df1bb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe704656-b0bf-45db-900e-382373df1bb6', 'volume_size': 1} Sep 28 17:25:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-427df0da-b320-447b-b0f0-d769dc2fd75c tempest-SnapshotsActionsTest-101682296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-427df0da-b320-447b-b0f0-d769dc2fd75c tempest-SnapshotsActionsTest-101682296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:51 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-427df0da-b320-447b-b0f0-d769dc2fd75c tempest-SnapshotsActionsTest-101682296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1432730618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe704656-b0bf-45db-900e-382373df1bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69956450c4bd471888f9b245f851e5dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:51Z,use_quota=True,user_id='84ffeab2622846f499120e4990b7a484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:25:51 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-427df0da-b320-447b-b0f0-d769dc2fd75c tempest-SnapshotsActionsTest-101682296 None] Creating volume fe704656-b0bf-45db-900e-382373df1bb6 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:25:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-427df0da-b320-447b-b0f0-d769dc2fd75c tempest-SnapshotsActionsTest-101682296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-427df0da-b320-447b-b0f0-d769dc2fd75c tempest-SnapshotsActionsTest-101682296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:51 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-427df0da-b320-447b-b0f0-d769dc2fd75c tempest-SnapshotsActionsTest-101682296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:51 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-427df0da-b320-447b-b0f0-d769dc2fd75c tempest-SnapshotsActionsTest-101682296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-427df0da-b320-447b-b0f0-d769dc2fd75c tempest-SnapshotsActionsTest-101682296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:51 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-427df0da-b320-447b-b0f0-d769dc2fd75c tempest-SnapshotsActionsTest-101682296 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:25:51 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-427df0da-b320-447b-b0f0-d769dc2fd75c tempest-SnapshotsActionsTest-101682296 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:25:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-427df0da-b320-447b-b0f0-d769dc2fd75c tempest-SnapshotsActionsTest-101682296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:51 devstack sudo[103648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6 1073741824 Sep 28 17:25:51 devstack sudo[103648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:52 devstack sudo[103648]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-427df0da-b320-447b-b0f0-d769dc2fd75c tempest-SnapshotsActionsTest-101682296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6 1073741824" returned: 0 in 0.455s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-427df0da-b320-447b-b0f0-d769dc2fd75c tempest-SnapshotsActionsTest-101682296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:52 devstack sudo[103654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6 Sep 28 17:25:52 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:52 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-427df0da-b320-447b-b0f0-d769dc2fd75c tempest-SnapshotsActionsTest-101682296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6" returned: 0 in 0.253s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-427df0da-b320-447b-b0f0-d769dc2fd75c tempest-SnapshotsActionsTest-101682296 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:25:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-427df0da-b320-447b-b0f0-d769dc2fd75c tempest-SnapshotsActionsTest-101682296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-427df0da-b320-447b-b0f0-d769dc2fd75c tempest-SnapshotsActionsTest-101682296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3329876a-899a-4d3d-b2e7-b79a53969f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe704656-b0bf-45db-900e-382373df1bb6', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-427df0da-b320-447b-b0f0-d769dc2fd75c tempest-SnapshotsActionsTest-101682296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed72d23-656d-4e70-aeb7-8f1f5a1eadc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:52 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-427df0da-b320-447b-b0f0-d769dc2fd75c tempest-SnapshotsActionsTest-101682296 None] Volume volume-fe704656-b0bf-45db-900e-382373df1bb6 (fe704656-b0bf-45db-900e-382373df1bb6): created successfully Sep 28 17:25:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-427df0da-b320-447b-b0f0-d769dc2fd75c tempest-SnapshotsActionsTest-101682296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed72d23-656d-4e70-aeb7-8f1f5a1eadc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-427df0da-b320-447b-b0f0-d769dc2fd75c tempest-SnapshotsActionsTest-101682296 None] Flow 'volume_create_manager' (5398c4ba-64f4-4958-bdba-c39aca278bf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:52 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-427df0da-b320-447b-b0f0-d769dc2fd75c tempest-SnapshotsActionsTest-101682296 None] Created volume successfully. Sep 28 17:25:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-55841ebb-d5d0-4a92-b7fd-dc34b2ea3ec7 tempest-SnapshotsActionsTest-101682296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-55841ebb-d5d0-4a92-b7fd-dc34b2ea3ec7 tempest-SnapshotsActionsTest-101682296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-55841ebb-d5d0-4a92-b7fd-dc34b2ea3ec7 tempest-SnapshotsActionsTest-101682296 None] Creating offline snapshot a344c65a-d698-4a35-b57b-68ac3eecf7a2 of volume fe704656-b0bf-45db-900e-382373df1bb6 {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:25:52 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[521662a6-f547-4010-9b59-b83b7f1a7431]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-55841ebb-d5d0-4a92-b7fd-dc34b2ea3ec7 tempest-SnapshotsActionsTest-101682296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:52 devstack sudo[103657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6 Sep 28 17:25:52 devstack sudo[103657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:53 devstack sudo[103657]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-55841ebb-d5d0-4a92-b7fd-dc34b2ea3ec7 tempest-SnapshotsActionsTest-101682296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6" returned: 0 in 0.382s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-55841ebb-d5d0-4a92-b7fd-dc34b2ea3ec7 tempest-SnapshotsActionsTest-101682296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:53 devstack sudo[103662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 1G Sep 28 17:25:53 devstack sudo[103662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:53 devstack sudo[103662]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-55841ebb-d5d0-4a92-b7fd-dc34b2ea3ec7 tempest-SnapshotsActionsTest-101682296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 1G" returned: 0 in 0.431s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-55841ebb-d5d0-4a92-b7fd-dc34b2ea3ec7 tempest-SnapshotsActionsTest-101682296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe704656-b0bf-45db-900e-382373df1bb6 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:53 devstack sudo[103667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe704656-b0bf-45db-900e-382373df1bb6 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 Sep 28 17:25:53 devstack sudo[103667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:53 devstack sudo[103667]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-55841ebb-d5d0-4a92-b7fd-dc34b2ea3ec7 tempest-SnapshotsActionsTest-101682296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe704656-b0bf-45db-900e-382373df1bb6 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2" returned: 0 in 0.296s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:53 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-55841ebb-d5d0-4a92-b7fd-dc34b2ea3ec7 tempest-SnapshotsActionsTest-101682296 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 is being set with open permissions: ugo+rw Sep 28 17:25:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-55841ebb-d5d0-4a92-b7fd-dc34b2ea3ec7 tempest-SnapshotsActionsTest-101682296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:53 devstack sudo[103672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 Sep 28 17:25:53 devstack sudo[103672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:54 devstack sudo[103672]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-55841ebb-d5d0-4a92-b7fd-dc34b2ea3ec7 tempest-SnapshotsActionsTest-101682296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2" returned: 0 in 0.262s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-55841ebb-d5d0-4a92-b7fd-dc34b2ea3ec7 tempest-SnapshotsActionsTest-101682296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:54 devstack sudo[103675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.info Sep 28 17:25:54 devstack sudo[103675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:54 devstack sudo[103675]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-55841ebb-d5d0-4a92-b7fd-dc34b2ea3ec7 tempest-SnapshotsActionsTest-101682296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.info" returned: 0 in 0.257s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:54 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-55841ebb-d5d0-4a92-b7fd-dc34b2ea3ec7 tempest-SnapshotsActionsTest-101682296 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.info is being set with open permissions: ugo+rw Sep 28 17:25:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-55841ebb-d5d0-4a92-b7fd-dc34b2ea3ec7 tempest-SnapshotsActionsTest-101682296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:54 devstack sudo[103678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.info Sep 28 17:25:54 devstack sudo[103678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:54 devstack sudo[103678]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-55841ebb-d5d0-4a92-b7fd-dc34b2ea3ec7 tempest-SnapshotsActionsTest-101682296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.info" returned: 0 in 0.262s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-55841ebb-d5d0-4a92-b7fd-dc34b2ea3ec7 tempest-SnapshotsActionsTest-101682296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.991s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:54 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-55841ebb-d5d0-4a92-b7fd-dc34b2ea3ec7 tempest-SnapshotsActionsTest-101682296 None] Create snapshot completed successfully Sep 28 17:25:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-84122cb1-dc61-4a2a-b3c5-0002b7c75ebb tempest-SnapshotsActionsTest-101682296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-84122cb1-dc61-4a2a-b3c5-0002b7c75ebb tempest-SnapshotsActionsTest-101682296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:55 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-84122cb1-dc61-4a2a-b3c5-0002b7c75ebb tempest-SnapshotsActionsTest-101682296 None] Creating offline snapshot 227f67c8-cd83-4dda-9dd6-ff05758c2a75 of volume fe704656-b0bf-45db-900e-382373df1bb6 {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:25:55 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bb3f79-e3bf-415e-a618-1c9a0628f4c1]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-84122cb1-dc61-4a2a-b3c5-0002b7c75ebb tempest-SnapshotsActionsTest-101682296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:55 devstack sudo[103681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 Sep 28 17:25:55 devstack sudo[103681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:55 devstack sudo[103681]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-84122cb1-dc61-4a2a-b3c5-0002b7c75ebb tempest-SnapshotsActionsTest-101682296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2" returned: 0 in 0.349s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:55 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-84122cb1-dc61-4a2a-b3c5-0002b7c75ebb tempest-SnapshotsActionsTest-101682296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe704656-b0bf-45db-900e-382373df1bb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:25:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-84122cb1-dc61-4a2a-b3c5-0002b7c75ebb tempest-SnapshotsActionsTest-101682296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.227f67c8-cd83-4dda-9dd6-ff05758c2a75 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:55 devstack sudo[103686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.227f67c8-cd83-4dda-9dd6-ff05758c2a75 1G Sep 28 17:25:55 devstack sudo[103686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:56 devstack sudo[103686]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-84122cb1-dc61-4a2a-b3c5-0002b7c75ebb tempest-SnapshotsActionsTest-101682296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.227f67c8-cd83-4dda-9dd6-ff05758c2a75 1G" returned: 0 in 0.467s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-84122cb1-dc61-4a2a-b3c5-0002b7c75ebb tempest-SnapshotsActionsTest-101682296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.227f67c8-cd83-4dda-9dd6-ff05758c2a75 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:56 devstack sudo[103691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.227f67c8-cd83-4dda-9dd6-ff05758c2a75 Sep 28 17:25:56 devstack sudo[103691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:56 devstack sudo[103691]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-84122cb1-dc61-4a2a-b3c5-0002b7c75ebb tempest-SnapshotsActionsTest-101682296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.227f67c8-cd83-4dda-9dd6-ff05758c2a75" returned: 0 in 0.315s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:56 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-84122cb1-dc61-4a2a-b3c5-0002b7c75ebb tempest-SnapshotsActionsTest-101682296 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.227f67c8-cd83-4dda-9dd6-ff05758c2a75 is being set with open permissions: ugo+rw Sep 28 17:25:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-84122cb1-dc61-4a2a-b3c5-0002b7c75ebb tempest-SnapshotsActionsTest-101682296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.227f67c8-cd83-4dda-9dd6-ff05758c2a75 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:56 devstack sudo[103697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.227f67c8-cd83-4dda-9dd6-ff05758c2a75 Sep 28 17:25:56 devstack sudo[103697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:56 devstack sudo[103697]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-84122cb1-dc61-4a2a-b3c5-0002b7c75ebb tempest-SnapshotsActionsTest-101682296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.227f67c8-cd83-4dda-9dd6-ff05758c2a75" returned: 0 in 0.258s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-84122cb1-dc61-4a2a-b3c5-0002b7c75ebb tempest-SnapshotsActionsTest-101682296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.491s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:56 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-84122cb1-dc61-4a2a-b3c5-0002b7c75ebb tempest-SnapshotsActionsTest-101682296 None] Create snapshot completed successfully Sep 28 17:25:57 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-88987b8d-093c-4dbc-81fc-cb05ba38abdd tempest-SnapshotsActionsTest-1837549725 None] Acquiring lock "cinder-227f67c8-cd83-4dda-9dd6-ff05758c2a75-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:57 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-88987b8d-093c-4dbc-81fc-cb05ba38abdd tempest-SnapshotsActionsTest-1837549725 None] Lock "cinder-227f67c8-cd83-4dda-9dd6-ff05758c2a75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:57 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-88987b8d-093c-4dbc-81fc-cb05ba38abdd tempest-SnapshotsActionsTest-1837549725 None] Acquiring lock "cinder-quobyte-fe704656-b0bf-45db-900e-382373df1bb6" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:57 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-88987b8d-093c-4dbc-81fc-cb05ba38abdd tempest-SnapshotsActionsTest-1837549725 None] Lock "cinder-quobyte-fe704656-b0bf-45db-900e-382373df1bb6" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:57 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-88987b8d-093c-4dbc-81fc-cb05ba38abdd tempest-SnapshotsActionsTest-1837549725 None] Acquiring lock "cinder-quobyte-227f67c8-cd83-4dda-9dd6-ff05758c2a75" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:57 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-88987b8d-093c-4dbc-81fc-cb05ba38abdd tempest-SnapshotsActionsTest-1837549725 None] Lock "cinder-quobyte-227f67c8-cd83-4dda-9dd6-ff05758c2a75" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:57 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-88987b8d-093c-4dbc-81fc-cb05ba38abdd tempest-SnapshotsActionsTest-1837549725 None] Deleting offline snapshot 227f67c8-cd83-4dda-9dd6-ff05758c2a75 of volume fe704656-b0bf-45db-900e-382373df1bb6 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:25:57 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-88987b8d-093c-4dbc-81fc-cb05ba38abdd tempest-SnapshotsActionsTest-1837549725 None] snapshot_file for this snap is: volume-fe704656-b0bf-45db-900e-382373df1bb6.227f67c8-cd83-4dda-9dd6-ff05758c2a75 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:25:57 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db61a26-10e5-4013-a4ca-88d4dfce8047]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-88987b8d-093c-4dbc-81fc-cb05ba38abdd tempest-SnapshotsActionsTest-1837549725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.227f67c8-cd83-4dda-9dd6-ff05758c2a75 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:57 devstack sudo[103700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.227f67c8-cd83-4dda-9dd6-ff05758c2a75 Sep 28 17:25:57 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:58 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-88987b8d-093c-4dbc-81fc-cb05ba38abdd tempest-SnapshotsActionsTest-1837549725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.227f67c8-cd83-4dda-9dd6-ff05758c2a75" returned: 0 in 0.414s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:58 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-88987b8d-093c-4dbc-81fc-cb05ba38abdd tempest-SnapshotsActionsTest-1837549725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe704656-b0bf-45db-900e-382373df1bb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:25:58 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[447158f1-667b-4dd7-aaa2-2fb2694b575e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-88987b8d-093c-4dbc-81fc-cb05ba38abdd tempest-SnapshotsActionsTest-1837549725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:58 devstack sudo[103705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 Sep 28 17:25:58 devstack sudo[103705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:58 devstack sudo[103705]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-88987b8d-093c-4dbc-81fc-cb05ba38abdd tempest-SnapshotsActionsTest-1837549725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2" returned: 0 in 0.407s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:58 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-88987b8d-093c-4dbc-81fc-cb05ba38abdd tempest-SnapshotsActionsTest-1837549725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe704656-b0bf-45db-900e-382373df1bb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:25:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-88987b8d-093c-4dbc-81fc-cb05ba38abdd tempest-SnapshotsActionsTest-1837549725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.227f67c8-cd83-4dda-9dd6-ff05758c2a75 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:58 devstack sudo[103710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.227f67c8-cd83-4dda-9dd6-ff05758c2a75 Sep 28 17:25:58 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:59 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-88987b8d-093c-4dbc-81fc-cb05ba38abdd tempest-SnapshotsActionsTest-1837549725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.227f67c8-cd83-4dda-9dd6-ff05758c2a75" returned: 0 in 0.385s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-88987b8d-093c-4dbc-81fc-cb05ba38abdd tempest-SnapshotsActionsTest-1837549725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.227f67c8-cd83-4dda-9dd6-ff05758c2a75 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:59 devstack sudo[103715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.227f67c8-cd83-4dda-9dd6-ff05758c2a75 Sep 28 17:25:59 devstack sudo[103715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:59 devstack sudo[103715]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-88987b8d-093c-4dbc-81fc-cb05ba38abdd tempest-SnapshotsActionsTest-1837549725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.227f67c8-cd83-4dda-9dd6-ff05758c2a75" returned: 0 in 0.256s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:59 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-88987b8d-093c-4dbc-81fc-cb05ba38abdd tempest-SnapshotsActionsTest-1837549725 None] Lock "cinder-quobyte-227f67c8-cd83-4dda-9dd6-ff05758c2a75" released by "_delete_snapshot" :: held 1.568s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:59 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-88987b8d-093c-4dbc-81fc-cb05ba38abdd tempest-SnapshotsActionsTest-1837549725 None] Lock "cinder-quobyte-fe704656-b0bf-45db-900e-382373df1bb6" released by "delete_snapshot" :: held 1.593s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:59 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-88987b8d-093c-4dbc-81fc-cb05ba38abdd tempest-SnapshotsActionsTest-1837549725 None] Created reservations ['9628b742-ba51-4e6b-99ef-029552e81003', '97dfe2e8-3411-4067-82d8-98c9b10da3f9', 'fe69dcad-2a1f-4fb3-85a9-17d413d4b5e3', 'bf944b10-dfda-465c-a1f9-1df4cac6d21f'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:25:59 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-88987b8d-093c-4dbc-81fc-cb05ba38abdd tempest-SnapshotsActionsTest-1837549725 None] Delete snapshot completed successfully. Sep 28 17:25:59 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-88987b8d-093c-4dbc-81fc-cb05ba38abdd tempest-SnapshotsActionsTest-1837549725 None] Lock "cinder-227f67c8-cd83-4dda-9dd6-ff05758c2a75-delete_snapshot" released by "delete_snapshot" :: held 1.750s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-24395f1e-0f37-478b-b082-6a49d02ff5d6 tempest-SnapshotsActionsTest-101682296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-24395f1e-0f37-478b-b082-6a49d02ff5d6 tempest-SnapshotsActionsTest-101682296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:00 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-24395f1e-0f37-478b-b082-6a49d02ff5d6 tempest-SnapshotsActionsTest-101682296 None] Creating offline snapshot df4a298d-e871-46d3-8294-ec4269ddcaa5 of volume fe704656-b0bf-45db-900e-382373df1bb6 {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:26:00 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fac955f-a064-46b8-ac93-cbe94da7ff4c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-24395f1e-0f37-478b-b082-6a49d02ff5d6 tempest-SnapshotsActionsTest-101682296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:00 devstack sudo[103718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 Sep 28 17:26:00 devstack sudo[103718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:00 devstack sudo[103718]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-24395f1e-0f37-478b-b082-6a49d02ff5d6 tempest-SnapshotsActionsTest-101682296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2" returned: 0 in 0.364s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:00 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-24395f1e-0f37-478b-b082-6a49d02ff5d6 tempest-SnapshotsActionsTest-101682296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe704656-b0bf-45db-900e-382373df1bb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:26:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-24395f1e-0f37-478b-b082-6a49d02ff5d6 tempest-SnapshotsActionsTest-101682296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.df4a298d-e871-46d3-8294-ec4269ddcaa5 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:00 devstack sudo[103723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.df4a298d-e871-46d3-8294-ec4269ddcaa5 1G Sep 28 17:26:00 devstack sudo[103723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:01 devstack sudo[103723]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-24395f1e-0f37-478b-b082-6a49d02ff5d6 tempest-SnapshotsActionsTest-101682296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.df4a298d-e871-46d3-8294-ec4269ddcaa5 1G" returned: 0 in 0.512s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-24395f1e-0f37-478b-b082-6a49d02ff5d6 tempest-SnapshotsActionsTest-101682296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.df4a298d-e871-46d3-8294-ec4269ddcaa5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:01 devstack sudo[103730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.df4a298d-e871-46d3-8294-ec4269ddcaa5 Sep 28 17:26:01 devstack sudo[103730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:01 devstack sudo[103730]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-24395f1e-0f37-478b-b082-6a49d02ff5d6 tempest-SnapshotsActionsTest-101682296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.df4a298d-e871-46d3-8294-ec4269ddcaa5" returned: 0 in 0.343s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:01 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-24395f1e-0f37-478b-b082-6a49d02ff5d6 tempest-SnapshotsActionsTest-101682296 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.df4a298d-e871-46d3-8294-ec4269ddcaa5 is being set with open permissions: ugo+rw Sep 28 17:26:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-24395f1e-0f37-478b-b082-6a49d02ff5d6 tempest-SnapshotsActionsTest-101682296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.df4a298d-e871-46d3-8294-ec4269ddcaa5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:01 devstack sudo[103735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.df4a298d-e871-46d3-8294-ec4269ddcaa5 Sep 28 17:26:01 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:01 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-24395f1e-0f37-478b-b082-6a49d02ff5d6 tempest-SnapshotsActionsTest-101682296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.df4a298d-e871-46d3-8294-ec4269ddcaa5" returned: 0 in 0.323s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-24395f1e-0f37-478b-b082-6a49d02ff5d6 tempest-SnapshotsActionsTest-101682296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.653s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:01 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-24395f1e-0f37-478b-b082-6a49d02ff5d6 tempest-SnapshotsActionsTest-101682296 None] Create snapshot completed successfully Sep 28 17:26:02 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-344dd2b2-163f-4ebb-adb8-daa836cdd6b3 tempest-SnapshotsActionsTest-1837549725 None] Acquiring lock "cinder-df4a298d-e871-46d3-8294-ec4269ddcaa5-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:02 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-344dd2b2-163f-4ebb-adb8-daa836cdd6b3 tempest-SnapshotsActionsTest-1837549725 None] Lock "cinder-df4a298d-e871-46d3-8294-ec4269ddcaa5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:02 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-344dd2b2-163f-4ebb-adb8-daa836cdd6b3 tempest-SnapshotsActionsTest-1837549725 None] Acquiring lock "cinder-quobyte-fe704656-b0bf-45db-900e-382373df1bb6" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:02 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-344dd2b2-163f-4ebb-adb8-daa836cdd6b3 tempest-SnapshotsActionsTest-1837549725 None] Lock "cinder-quobyte-fe704656-b0bf-45db-900e-382373df1bb6" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:02 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-344dd2b2-163f-4ebb-adb8-daa836cdd6b3 tempest-SnapshotsActionsTest-1837549725 None] Acquiring lock "cinder-quobyte-df4a298d-e871-46d3-8294-ec4269ddcaa5" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:02 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-344dd2b2-163f-4ebb-adb8-daa836cdd6b3 tempest-SnapshotsActionsTest-1837549725 None] Lock "cinder-quobyte-df4a298d-e871-46d3-8294-ec4269ddcaa5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:02 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-344dd2b2-163f-4ebb-adb8-daa836cdd6b3 tempest-SnapshotsActionsTest-1837549725 None] Deleting offline snapshot df4a298d-e871-46d3-8294-ec4269ddcaa5 of volume fe704656-b0bf-45db-900e-382373df1bb6 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:26:02 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-344dd2b2-163f-4ebb-adb8-daa836cdd6b3 tempest-SnapshotsActionsTest-1837549725 None] snapshot_file for this snap is: volume-fe704656-b0bf-45db-900e-382373df1bb6.df4a298d-e871-46d3-8294-ec4269ddcaa5 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:26:02 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41c3608-2429-43f1-9bb5-efc0279c074c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-344dd2b2-163f-4ebb-adb8-daa836cdd6b3 tempest-SnapshotsActionsTest-1837549725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.df4a298d-e871-46d3-8294-ec4269ddcaa5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:02 devstack sudo[103738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.df4a298d-e871-46d3-8294-ec4269ddcaa5 Sep 28 17:26:02 devstack sudo[103738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:02 devstack sudo[103738]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-344dd2b2-163f-4ebb-adb8-daa836cdd6b3 tempest-SnapshotsActionsTest-1837549725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.df4a298d-e871-46d3-8294-ec4269ddcaa5" returned: 0 in 0.445s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:02 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-344dd2b2-163f-4ebb-adb8-daa836cdd6b3 tempest-SnapshotsActionsTest-1837549725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe704656-b0bf-45db-900e-382373df1bb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:26:03 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[78338435-3733-4185-a524-0857f8a19457]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-344dd2b2-163f-4ebb-adb8-daa836cdd6b3 tempest-SnapshotsActionsTest-1837549725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:03 devstack sudo[103744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 Sep 28 17:26:03 devstack sudo[103744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:03 devstack sudo[103744]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-344dd2b2-163f-4ebb-adb8-daa836cdd6b3 tempest-SnapshotsActionsTest-1837549725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2" returned: 0 in 0.466s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:03 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-344dd2b2-163f-4ebb-adb8-daa836cdd6b3 tempest-SnapshotsActionsTest-1837549725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe704656-b0bf-45db-900e-382373df1bb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:26:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-344dd2b2-163f-4ebb-adb8-daa836cdd6b3 tempest-SnapshotsActionsTest-1837549725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.df4a298d-e871-46d3-8294-ec4269ddcaa5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:03 devstack sudo[103749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.df4a298d-e871-46d3-8294-ec4269ddcaa5 Sep 28 17:26:03 devstack sudo[103749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:03 devstack sudo[103749]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-344dd2b2-163f-4ebb-adb8-daa836cdd6b3 tempest-SnapshotsActionsTest-1837549725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.df4a298d-e871-46d3-8294-ec4269ddcaa5" returned: 0 in 0.450s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-344dd2b2-163f-4ebb-adb8-daa836cdd6b3 tempest-SnapshotsActionsTest-1837549725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.df4a298d-e871-46d3-8294-ec4269ddcaa5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:03 devstack sudo[103754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.df4a298d-e871-46d3-8294-ec4269ddcaa5 Sep 28 17:26:03 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:04 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-344dd2b2-163f-4ebb-adb8-daa836cdd6b3 tempest-SnapshotsActionsTest-1837549725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.df4a298d-e871-46d3-8294-ec4269ddcaa5" returned: 0 in 0.278s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:04 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-344dd2b2-163f-4ebb-adb8-daa836cdd6b3 tempest-SnapshotsActionsTest-1837549725 None] Lock "cinder-quobyte-df4a298d-e871-46d3-8294-ec4269ddcaa5" released by "_delete_snapshot" :: held 1.763s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:04 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-344dd2b2-163f-4ebb-adb8-daa836cdd6b3 tempest-SnapshotsActionsTest-1837549725 None] Lock "cinder-quobyte-fe704656-b0bf-45db-900e-382373df1bb6" released by "delete_snapshot" :: held 1.786s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:04 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-344dd2b2-163f-4ebb-adb8-daa836cdd6b3 tempest-SnapshotsActionsTest-1837549725 None] Created reservations ['02b22956-922d-4e9d-9498-c9b459d81eaa', '0d4bb0b9-3094-4642-8300-630c8051c8b4', '2d6e6433-875e-4c95-8775-2f23c8de0af9', '9ecd15e2-3bbf-447d-91bc-2155f1c8dae4'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:04 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-344dd2b2-163f-4ebb-adb8-daa836cdd6b3 tempest-SnapshotsActionsTest-1837549725 None] Delete snapshot completed successfully. Sep 28 17:26:04 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-344dd2b2-163f-4ebb-adb8-daa836cdd6b3 tempest-SnapshotsActionsTest-1837549725 None] Lock "cinder-df4a298d-e871-46d3-8294-ec4269ddcaa5-delete_snapshot" released by "delete_snapshot" :: held 1.967s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-eac257dd-8249-484c-b5b4-dd05d2e6784d tempest-SnapshotsActionsTest-101682296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-eac257dd-8249-484c-b5b4-dd05d2e6784d tempest-SnapshotsActionsTest-101682296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:04 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-eac257dd-8249-484c-b5b4-dd05d2e6784d tempest-SnapshotsActionsTest-101682296 None] Creating offline snapshot e19926fe-6c5f-4d05-80e1-b69d6856d6d5 of volume fe704656-b0bf-45db-900e-382373df1bb6 {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:26:05 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf59dd8b-d1bf-4fde-ae45-aefeb2d74b83]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-eac257dd-8249-484c-b5b4-dd05d2e6784d tempest-SnapshotsActionsTest-101682296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:05 devstack sudo[103757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 Sep 28 17:26:05 devstack sudo[103757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:05 devstack sudo[103757]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-eac257dd-8249-484c-b5b4-dd05d2e6784d tempest-SnapshotsActionsTest-101682296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2" returned: 0 in 0.431s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-eac257dd-8249-484c-b5b4-dd05d2e6784d tempest-SnapshotsActionsTest-101682296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe704656-b0bf-45db-900e-382373df1bb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:26:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-eac257dd-8249-484c-b5b4-dd05d2e6784d tempest-SnapshotsActionsTest-101682296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.e19926fe-6c5f-4d05-80e1-b69d6856d6d5 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:05 devstack sudo[103762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.e19926fe-6c5f-4d05-80e1-b69d6856d6d5 1G Sep 28 17:26:05 devstack sudo[103762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:05 devstack sudo[103762]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-eac257dd-8249-484c-b5b4-dd05d2e6784d tempest-SnapshotsActionsTest-101682296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.e19926fe-6c5f-4d05-80e1-b69d6856d6d5 1G" returned: 0 in 0.505s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-eac257dd-8249-484c-b5b4-dd05d2e6784d tempest-SnapshotsActionsTest-101682296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.e19926fe-6c5f-4d05-80e1-b69d6856d6d5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:06 devstack sudo[103768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.e19926fe-6c5f-4d05-80e1-b69d6856d6d5 Sep 28 17:26:06 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:06 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-eac257dd-8249-484c-b5b4-dd05d2e6784d tempest-SnapshotsActionsTest-101682296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.e19926fe-6c5f-4d05-80e1-b69d6856d6d5" returned: 0 in 0.334s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:06 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-eac257dd-8249-484c-b5b4-dd05d2e6784d tempest-SnapshotsActionsTest-101682296 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.e19926fe-6c5f-4d05-80e1-b69d6856d6d5 is being set with open permissions: ugo+rw Sep 28 17:26:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-eac257dd-8249-484c-b5b4-dd05d2e6784d tempest-SnapshotsActionsTest-101682296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.e19926fe-6c5f-4d05-80e1-b69d6856d6d5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:06 devstack sudo[103773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.e19926fe-6c5f-4d05-80e1-b69d6856d6d5 Sep 28 17:26:06 devstack sudo[103773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:06 devstack sudo[103773]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-eac257dd-8249-484c-b5b4-dd05d2e6784d tempest-SnapshotsActionsTest-101682296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.e19926fe-6c5f-4d05-80e1-b69d6856d6d5" returned: 0 in 0.294s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-eac257dd-8249-484c-b5b4-dd05d2e6784d tempest-SnapshotsActionsTest-101682296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.690s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:06 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-eac257dd-8249-484c-b5b4-dd05d2e6784d tempest-SnapshotsActionsTest-101682296 None] Create snapshot completed successfully Sep 28 17:26:07 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2803d9eb-6b1c-4762-827a-3196800acdcb tempest-SnapshotsActionsTest-1837549725 None] Acquiring lock "cinder-e19926fe-6c5f-4d05-80e1-b69d6856d6d5-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:07 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2803d9eb-6b1c-4762-827a-3196800acdcb tempest-SnapshotsActionsTest-1837549725 None] Lock "cinder-e19926fe-6c5f-4d05-80e1-b69d6856d6d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:07 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2803d9eb-6b1c-4762-827a-3196800acdcb tempest-SnapshotsActionsTest-1837549725 None] Acquiring lock "cinder-quobyte-fe704656-b0bf-45db-900e-382373df1bb6" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:07 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2803d9eb-6b1c-4762-827a-3196800acdcb tempest-SnapshotsActionsTest-1837549725 None] Lock "cinder-quobyte-fe704656-b0bf-45db-900e-382373df1bb6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:07 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2803d9eb-6b1c-4762-827a-3196800acdcb tempest-SnapshotsActionsTest-1837549725 None] Acquiring lock "cinder-quobyte-e19926fe-6c5f-4d05-80e1-b69d6856d6d5" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:07 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2803d9eb-6b1c-4762-827a-3196800acdcb tempest-SnapshotsActionsTest-1837549725 None] Lock "cinder-quobyte-e19926fe-6c5f-4d05-80e1-b69d6856d6d5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:07 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-2803d9eb-6b1c-4762-827a-3196800acdcb tempest-SnapshotsActionsTest-1837549725 None] Deleting offline snapshot e19926fe-6c5f-4d05-80e1-b69d6856d6d5 of volume fe704656-b0bf-45db-900e-382373df1bb6 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:26:07 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-2803d9eb-6b1c-4762-827a-3196800acdcb tempest-SnapshotsActionsTest-1837549725 None] snapshot_file for this snap is: volume-fe704656-b0bf-45db-900e-382373df1bb6.e19926fe-6c5f-4d05-80e1-b69d6856d6d5 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:26:07 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[618a3f0a-cc7b-4260-8560-e32703e30558]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2803d9eb-6b1c-4762-827a-3196800acdcb tempest-SnapshotsActionsTest-1837549725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.e19926fe-6c5f-4d05-80e1-b69d6856d6d5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:07 devstack sudo[103776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.e19926fe-6c5f-4d05-80e1-b69d6856d6d5 Sep 28 17:26:07 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:07 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2803d9eb-6b1c-4762-827a-3196800acdcb tempest-SnapshotsActionsTest-1837549725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.e19926fe-6c5f-4d05-80e1-b69d6856d6d5" returned: 0 in 0.418s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:07 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-2803d9eb-6b1c-4762-827a-3196800acdcb tempest-SnapshotsActionsTest-1837549725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe704656-b0bf-45db-900e-382373df1bb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:26:07 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66e01cb-94e4-45d9-bb9b-6076e737082e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2803d9eb-6b1c-4762-827a-3196800acdcb tempest-SnapshotsActionsTest-1837549725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:07 devstack sudo[103781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 Sep 28 17:26:07 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:08 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2803d9eb-6b1c-4762-827a-3196800acdcb tempest-SnapshotsActionsTest-1837549725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2" returned: 0 in 0.425s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:08 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-2803d9eb-6b1c-4762-827a-3196800acdcb tempest-SnapshotsActionsTest-1837549725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe704656-b0bf-45db-900e-382373df1bb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:26:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2803d9eb-6b1c-4762-827a-3196800acdcb tempest-SnapshotsActionsTest-1837549725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.e19926fe-6c5f-4d05-80e1-b69d6856d6d5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:08 devstack sudo[103786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.e19926fe-6c5f-4d05-80e1-b69d6856d6d5 Sep 28 17:26:08 devstack sudo[103786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:08 devstack sudo[103786]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2803d9eb-6b1c-4762-827a-3196800acdcb tempest-SnapshotsActionsTest-1837549725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.e19926fe-6c5f-4d05-80e1-b69d6856d6d5" returned: 0 in 0.433s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2803d9eb-6b1c-4762-827a-3196800acdcb tempest-SnapshotsActionsTest-1837549725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.e19926fe-6c5f-4d05-80e1-b69d6856d6d5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:08 devstack sudo[103791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.e19926fe-6c5f-4d05-80e1-b69d6856d6d5 Sep 28 17:26:08 devstack sudo[103791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:08 devstack sudo[103791]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2803d9eb-6b1c-4762-827a-3196800acdcb tempest-SnapshotsActionsTest-1837549725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.e19926fe-6c5f-4d05-80e1-b69d6856d6d5" returned: 0 in 0.310s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:08 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2803d9eb-6b1c-4762-827a-3196800acdcb tempest-SnapshotsActionsTest-1837549725 None] Lock "cinder-quobyte-e19926fe-6c5f-4d05-80e1-b69d6856d6d5" released by "_delete_snapshot" :: held 1.703s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:08 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2803d9eb-6b1c-4762-827a-3196800acdcb tempest-SnapshotsActionsTest-1837549725 None] Lock "cinder-quobyte-fe704656-b0bf-45db-900e-382373df1bb6" released by "delete_snapshot" :: held 1.732s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:09 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-2803d9eb-6b1c-4762-827a-3196800acdcb tempest-SnapshotsActionsTest-1837549725 None] Created reservations ['aee23dd3-31af-4ba3-9ab3-34f56e37967a', '6dca8926-a28a-4550-9776-e2289e56194c', 'eb379f9c-6608-44e0-8dff-0c552062982b', '81d8dafa-2198-4b07-9196-9af1c28a1c02'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:09 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-2803d9eb-6b1c-4762-827a-3196800acdcb tempest-SnapshotsActionsTest-1837549725 None] Delete snapshot completed successfully. Sep 28 17:26:09 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2803d9eb-6b1c-4762-827a-3196800acdcb tempest-SnapshotsActionsTest-1837549725 None] Lock "cinder-e19926fe-6c5f-4d05-80e1-b69d6856d6d5-delete_snapshot" released by "delete_snapshot" :: held 1.909s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-114560fa-55fd-49ab-a671-30cff6c0b3b1 tempest-SnapshotsActionsTest-101682296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-114560fa-55fd-49ab-a671-30cff6c0b3b1 tempest-SnapshotsActionsTest-101682296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-114560fa-55fd-49ab-a671-30cff6c0b3b1 tempest-SnapshotsActionsTest-101682296 None] Creating offline snapshot 08b5fd82-e949-4593-98d8-64e40c40595a of volume fe704656-b0bf-45db-900e-382373df1bb6 {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:26:09 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c01f32a-89a3-48ab-8c02-419cf7cee5d8]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-114560fa-55fd-49ab-a671-30cff6c0b3b1 tempest-SnapshotsActionsTest-101682296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:09 devstack sudo[103794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 Sep 28 17:26:09 devstack sudo[103794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:10 devstack sudo[103794]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-114560fa-55fd-49ab-a671-30cff6c0b3b1 tempest-SnapshotsActionsTest-101682296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2" returned: 0 in 0.434s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:10 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-114560fa-55fd-49ab-a671-30cff6c0b3b1 tempest-SnapshotsActionsTest-101682296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe704656-b0bf-45db-900e-382373df1bb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:26:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-114560fa-55fd-49ab-a671-30cff6c0b3b1 tempest-SnapshotsActionsTest-101682296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.08b5fd82-e949-4593-98d8-64e40c40595a 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:10 devstack sudo[103799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.08b5fd82-e949-4593-98d8-64e40c40595a 1G Sep 28 17:26:10 devstack sudo[103799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:10 devstack sudo[103799]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-114560fa-55fd-49ab-a671-30cff6c0b3b1 tempest-SnapshotsActionsTest-101682296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.08b5fd82-e949-4593-98d8-64e40c40595a 1G" returned: 0 in 0.516s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-114560fa-55fd-49ab-a671-30cff6c0b3b1 tempest-SnapshotsActionsTest-101682296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.08b5fd82-e949-4593-98d8-64e40c40595a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:10 devstack sudo[103805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.08b5fd82-e949-4593-98d8-64e40c40595a Sep 28 17:26:10 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:11 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-114560fa-55fd-49ab-a671-30cff6c0b3b1 tempest-SnapshotsActionsTest-101682296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.08b5fd82-e949-4593-98d8-64e40c40595a" returned: 0 in 0.350s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:11 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-114560fa-55fd-49ab-a671-30cff6c0b3b1 tempest-SnapshotsActionsTest-101682296 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.08b5fd82-e949-4593-98d8-64e40c40595a is being set with open permissions: ugo+rw Sep 28 17:26:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-114560fa-55fd-49ab-a671-30cff6c0b3b1 tempest-SnapshotsActionsTest-101682296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.08b5fd82-e949-4593-98d8-64e40c40595a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:11 devstack sudo[103811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.08b5fd82-e949-4593-98d8-64e40c40595a Sep 28 17:26:11 devstack sudo[103811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:11 devstack sudo[103811]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-114560fa-55fd-49ab-a671-30cff6c0b3b1 tempest-SnapshotsActionsTest-101682296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.08b5fd82-e949-4593-98d8-64e40c40595a" returned: 0 in 0.279s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-114560fa-55fd-49ab-a671-30cff6c0b3b1 tempest-SnapshotsActionsTest-101682296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.690s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:11 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-114560fa-55fd-49ab-a671-30cff6c0b3b1 tempest-SnapshotsActionsTest-101682296 None] Create snapshot completed successfully Sep 28 17:26:11 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-414281e0-a7e0-4a84-8948-ca50e3ca908a tempest-SnapshotsActionsTest-1837549725 None] Acquiring lock "cinder-08b5fd82-e949-4593-98d8-64e40c40595a-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:11 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-414281e0-a7e0-4a84-8948-ca50e3ca908a tempest-SnapshotsActionsTest-1837549725 None] Lock "cinder-08b5fd82-e949-4593-98d8-64e40c40595a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:11 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-414281e0-a7e0-4a84-8948-ca50e3ca908a tempest-SnapshotsActionsTest-1837549725 None] Acquiring lock "cinder-quobyte-fe704656-b0bf-45db-900e-382373df1bb6" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:11 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-414281e0-a7e0-4a84-8948-ca50e3ca908a tempest-SnapshotsActionsTest-1837549725 None] Lock "cinder-quobyte-fe704656-b0bf-45db-900e-382373df1bb6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:11 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-414281e0-a7e0-4a84-8948-ca50e3ca908a tempest-SnapshotsActionsTest-1837549725 None] Acquiring lock "cinder-quobyte-08b5fd82-e949-4593-98d8-64e40c40595a" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:11 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-414281e0-a7e0-4a84-8948-ca50e3ca908a tempest-SnapshotsActionsTest-1837549725 None] Lock "cinder-quobyte-08b5fd82-e949-4593-98d8-64e40c40595a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-414281e0-a7e0-4a84-8948-ca50e3ca908a tempest-SnapshotsActionsTest-1837549725 None] Deleting offline snapshot 08b5fd82-e949-4593-98d8-64e40c40595a of volume fe704656-b0bf-45db-900e-382373df1bb6 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:26:12 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-414281e0-a7e0-4a84-8948-ca50e3ca908a tempest-SnapshotsActionsTest-1837549725 None] snapshot_file for this snap is: volume-fe704656-b0bf-45db-900e-382373df1bb6.08b5fd82-e949-4593-98d8-64e40c40595a {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:26:12 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bb04bf-f42b-4071-afc8-5d671e1a7395]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414281e0-a7e0-4a84-8948-ca50e3ca908a tempest-SnapshotsActionsTest-1837549725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.08b5fd82-e949-4593-98d8-64e40c40595a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:12 devstack sudo[103814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.08b5fd82-e949-4593-98d8-64e40c40595a Sep 28 17:26:12 devstack sudo[103814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:12 devstack sudo[103814]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414281e0-a7e0-4a84-8948-ca50e3ca908a tempest-SnapshotsActionsTest-1837549725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.08b5fd82-e949-4593-98d8-64e40c40595a" returned: 0 in 0.416s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:12 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-414281e0-a7e0-4a84-8948-ca50e3ca908a tempest-SnapshotsActionsTest-1837549725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe704656-b0bf-45db-900e-382373df1bb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:26:12 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedffdd1-d1ee-45f6-a952-0fa41ee5dd03]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414281e0-a7e0-4a84-8948-ca50e3ca908a tempest-SnapshotsActionsTest-1837549725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:12 devstack sudo[103819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 Sep 28 17:26:12 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:12 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414281e0-a7e0-4a84-8948-ca50e3ca908a tempest-SnapshotsActionsTest-1837549725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2" returned: 0 in 0.436s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:12 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-414281e0-a7e0-4a84-8948-ca50e3ca908a tempest-SnapshotsActionsTest-1837549725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe704656-b0bf-45db-900e-382373df1bb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:26:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414281e0-a7e0-4a84-8948-ca50e3ca908a tempest-SnapshotsActionsTest-1837549725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.08b5fd82-e949-4593-98d8-64e40c40595a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:12 devstack sudo[103824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.08b5fd82-e949-4593-98d8-64e40c40595a Sep 28 17:26:12 devstack sudo[103824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:13 devstack sudo[103824]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414281e0-a7e0-4a84-8948-ca50e3ca908a tempest-SnapshotsActionsTest-1837549725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.08b5fd82-e949-4593-98d8-64e40c40595a" returned: 0 in 0.463s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414281e0-a7e0-4a84-8948-ca50e3ca908a tempest-SnapshotsActionsTest-1837549725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.08b5fd82-e949-4593-98d8-64e40c40595a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:13 devstack sudo[103829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.08b5fd82-e949-4593-98d8-64e40c40595a Sep 28 17:26:13 devstack sudo[103829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:13 devstack sudo[103829]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-414281e0-a7e0-4a84-8948-ca50e3ca908a tempest-SnapshotsActionsTest-1837549725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.08b5fd82-e949-4593-98d8-64e40c40595a" returned: 0 in 0.287s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:13 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-414281e0-a7e0-4a84-8948-ca50e3ca908a tempest-SnapshotsActionsTest-1837549725 None] Lock "cinder-quobyte-08b5fd82-e949-4593-98d8-64e40c40595a" released by "_delete_snapshot" :: held 1.723s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:13 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-414281e0-a7e0-4a84-8948-ca50e3ca908a tempest-SnapshotsActionsTest-1837549725 None] Lock "cinder-quobyte-fe704656-b0bf-45db-900e-382373df1bb6" released by "delete_snapshot" :: held 1.749s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:13 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-414281e0-a7e0-4a84-8948-ca50e3ca908a tempest-SnapshotsActionsTest-1837549725 None] Created reservations ['f07a898f-dca1-453c-9daa-f8b285027f54', '4d1e4f44-cc89-4a48-a153-6c651e9091be', '0112e437-68e4-4cba-ac26-7d69861346fa', '40997f37-4cdf-4a35-90ab-f4a03345ec6c'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:13 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-414281e0-a7e0-4a84-8948-ca50e3ca908a tempest-SnapshotsActionsTest-1837549725 None] Delete snapshot completed successfully. Sep 28 17:26:13 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-414281e0-a7e0-4a84-8948-ca50e3ca908a tempest-SnapshotsActionsTest-1837549725 None] Lock "cinder-08b5fd82-e949-4593-98d8-64e40c40595a-delete_snapshot" released by "delete_snapshot" :: held 1.942s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:14 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0f8a91bd-72a3-46d5-921c-5e5aef051b6d tempest-SnapshotsActionsTest-101682296 None] Acquiring lock "cinder-a344c65a-d698-4a35-b57b-68ac3eecf7a2-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:14 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0f8a91bd-72a3-46d5-921c-5e5aef051b6d tempest-SnapshotsActionsTest-101682296 None] Lock "cinder-a344c65a-d698-4a35-b57b-68ac3eecf7a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:14 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0f8a91bd-72a3-46d5-921c-5e5aef051b6d tempest-SnapshotsActionsTest-101682296 None] Acquiring lock "cinder-quobyte-fe704656-b0bf-45db-900e-382373df1bb6" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:14 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0f8a91bd-72a3-46d5-921c-5e5aef051b6d tempest-SnapshotsActionsTest-101682296 None] Lock "cinder-quobyte-fe704656-b0bf-45db-900e-382373df1bb6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:14 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0f8a91bd-72a3-46d5-921c-5e5aef051b6d tempest-SnapshotsActionsTest-101682296 None] Acquiring lock "cinder-quobyte-a344c65a-d698-4a35-b57b-68ac3eecf7a2" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:14 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0f8a91bd-72a3-46d5-921c-5e5aef051b6d tempest-SnapshotsActionsTest-101682296 None] Lock "cinder-quobyte-a344c65a-d698-4a35-b57b-68ac3eecf7a2" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:14 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-0f8a91bd-72a3-46d5-921c-5e5aef051b6d tempest-SnapshotsActionsTest-101682296 None] Deleting offline snapshot a344c65a-d698-4a35-b57b-68ac3eecf7a2 of volume fe704656-b0bf-45db-900e-382373df1bb6 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:26:14 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-0f8a91bd-72a3-46d5-921c-5e5aef051b6d tempest-SnapshotsActionsTest-101682296 None] snapshot_file for this snap is: volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:26:14 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce70afd-3235-47b4-8b6f-9196608740db]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0f8a91bd-72a3-46d5-921c-5e5aef051b6d tempest-SnapshotsActionsTest-101682296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:14 devstack sudo[103832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 Sep 28 17:26:14 devstack sudo[103832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:15 devstack sudo[103832]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0f8a91bd-72a3-46d5-921c-5e5aef051b6d tempest-SnapshotsActionsTest-101682296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2" returned: 0 in 0.448s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:15 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-0f8a91bd-72a3-46d5-921c-5e5aef051b6d tempest-SnapshotsActionsTest-101682296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe704656-b0bf-45db-900e-382373df1bb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:26:15 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5292c6d6-3c5f-4889-9da1-2c0b97efb4e9]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0f8a91bd-72a3-46d5-921c-5e5aef051b6d tempest-SnapshotsActionsTest-101682296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:15 devstack sudo[103837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6 Sep 28 17:26:15 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:15 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0f8a91bd-72a3-46d5-921c-5e5aef051b6d tempest-SnapshotsActionsTest-101682296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6" returned: 0 in 0.417s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0f8a91bd-72a3-46d5-921c-5e5aef051b6d tempest-SnapshotsActionsTest-101682296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:15 devstack sudo[103842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 Sep 28 17:26:15 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:16 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0f8a91bd-72a3-46d5-921c-5e5aef051b6d tempest-SnapshotsActionsTest-101682296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2" returned: 0 in 0.439s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0f8a91bd-72a3-46d5-921c-5e5aef051b6d tempest-SnapshotsActionsTest-101682296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:16 devstack sudo[103848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2 Sep 28 17:26:16 devstack sudo[103848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:16 devstack sudo[103848]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0f8a91bd-72a3-46d5-921c-5e5aef051b6d tempest-SnapshotsActionsTest-101682296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6.a344c65a-d698-4a35-b57b-68ac3eecf7a2" returned: 0 in 0.319s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:16 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0f8a91bd-72a3-46d5-921c-5e5aef051b6d tempest-SnapshotsActionsTest-101682296 None] Lock "cinder-quobyte-a344c65a-d698-4a35-b57b-68ac3eecf7a2" released by "_delete_snapshot" :: held 1.761s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:16 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0f8a91bd-72a3-46d5-921c-5e5aef051b6d tempest-SnapshotsActionsTest-101682296 None] Lock "cinder-quobyte-fe704656-b0bf-45db-900e-382373df1bb6" released by "delete_snapshot" :: held 1.789s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:16 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-0f8a91bd-72a3-46d5-921c-5e5aef051b6d tempest-SnapshotsActionsTest-101682296 None] Created reservations ['d2b40f1f-bcdf-4218-bca5-982cdb34e4af', '8f44b7ef-74b6-410f-996e-9459c81e4210', '044afa8b-5f5c-4214-8332-b27a2cd735b0', '89d4b570-72a7-48fb-b9bb-92076dfe2ffe'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:16 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-0f8a91bd-72a3-46d5-921c-5e5aef051b6d tempest-SnapshotsActionsTest-101682296 None] Delete snapshot completed successfully. Sep 28 17:26:16 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0f8a91bd-72a3-46d5-921c-5e5aef051b6d tempest-SnapshotsActionsTest-101682296 None] Lock "cinder-a344c65a-d698-4a35-b57b-68ac3eecf7a2-delete_snapshot" released by "delete_snapshot" :: held 1.967s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:16 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-677fc0c9-4f2e-451d-9721-0c6c19684f2d tempest-SnapshotsActionsTest-101682296 None] Acquiring lock "cinder-fe704656-b0bf-45db-900e-382373df1bb6-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:16 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-677fc0c9-4f2e-451d-9721-0c6c19684f2d tempest-SnapshotsActionsTest-101682296 None] Lock "cinder-fe704656-b0bf-45db-900e-382373df1bb6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:16 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-677fc0c9-4f2e-451d-9721-0c6c19684f2d tempest-SnapshotsActionsTest-101682296 None] Acquiring lock "cinder-quobyte-fe704656-b0bf-45db-900e-382373df1bb6" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:16 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-677fc0c9-4f2e-451d-9721-0c6c19684f2d tempest-SnapshotsActionsTest-101682296 None] Lock "cinder-quobyte-fe704656-b0bf-45db-900e-382373df1bb6" acquired by "delete_volume" :: waited 0.018s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:17 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[723c3750-d4e7-462d-9677-daa68983238a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-677fc0c9-4f2e-451d-9721-0c6c19684f2d tempest-SnapshotsActionsTest-101682296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:17 devstack sudo[103851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6 Sep 28 17:26:17 devstack sudo[103851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:17 devstack sudo[103851]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-677fc0c9-4f2e-451d-9721-0c6c19684f2d tempest-SnapshotsActionsTest-101682296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6" returned: 0 in 0.420s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-677fc0c9-4f2e-451d-9721-0c6c19684f2d tempest-SnapshotsActionsTest-101682296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:17 devstack sudo[103856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6 Sep 28 17:26:17 devstack sudo[103856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:17 devstack sudo[103856]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-677fc0c9-4f2e-451d-9721-0c6c19684f2d tempest-SnapshotsActionsTest-101682296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fe704656-b0bf-45db-900e-382373df1bb6" returned: 0 in 0.324s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:17 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-677fc0c9-4f2e-451d-9721-0c6c19684f2d tempest-SnapshotsActionsTest-101682296 None] Lock "cinder-quobyte-fe704656-b0bf-45db-900e-382373df1bb6" released by "delete_volume" :: held 0.821s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:17 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-677fc0c9-4f2e-451d-9721-0c6c19684f2d tempest-SnapshotsActionsTest-101682296 None] Created reservations ['695d9095-b222-4215-a80b-f25b5309c82a', 'ebc80677-a489-48ca-a097-e0b6bed07ec6', '5c03567f-273c-4372-9ab2-c9ca53c4a2a2', '31136ff1-20d7-45b1-aa03-b403b2aa914f'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-677fc0c9-4f2e-451d-9721-0c6c19684f2d tempest-SnapshotsActionsTest-101682296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-677fc0c9-4f2e-451d-9721-0c6c19684f2d tempest-SnapshotsActionsTest-101682296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:17 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-677fc0c9-4f2e-451d-9721-0c6c19684f2d tempest-SnapshotsActionsTest-101682296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:17 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-677fc0c9-4f2e-451d-9721-0c6c19684f2d tempest-SnapshotsActionsTest-101682296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-677fc0c9-4f2e-451d-9721-0c6c19684f2d tempest-SnapshotsActionsTest-101682296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-677fc0c9-4f2e-451d-9721-0c6c19684f2d tempest-SnapshotsActionsTest-101682296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:17 devstack sudo[103859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:26:17 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:18 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-677fc0c9-4f2e-451d-9721-0c6c19684f2d tempest-SnapshotsActionsTest-101682296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.255s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:18 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-677fc0c9-4f2e-451d-9721-0c6c19684f2d tempest-SnapshotsActionsTest-101682296 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:18 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-677fc0c9-4f2e-451d-9721-0c6c19684f2d tempest-SnapshotsActionsTest-101682296 None] Deleted volume successfully. Sep 28 17:26:18 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-677fc0c9-4f2e-451d-9721-0c6c19684f2d tempest-SnapshotsActionsTest-101682296 None] Lock "cinder-fe704656-b0bf-45db-900e-382373df1bb6-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:27 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:UPDATE=49,cinder:SELECT=42,cinder:DELETE=3,cinder:INSERT=9 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:26:28 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=47,cinder:UPDATE=40,cinder:INSERT=17,cinder:DELETE=4 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:26:43 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-78c55a04-3f1a-46ae-a89c-1201be49796a tempest-VolumeQuotasAdminTestJSON-88817206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-78c55a04-3f1a-46ae-a89c-1201be49796a tempest-VolumeQuotasAdminTestJSON-88817206 None] Flow 'volume_create_manager' (5e4e1c5d-06be-4119-ac61-7d173d1fc175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-78c55a04-3f1a-46ae-a89c-1201be49796a tempest-VolumeQuotasAdminTestJSON-88817206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f55d75-6047-4530-b3ec-fe43969a96b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-78c55a04-3f1a-46ae-a89c-1201be49796a tempest-VolumeQuotasAdminTestJSON-88817206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f55d75-6047-4530-b3ec-fe43969a96b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1931630978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=decd6c19-abbf-4481-8f85-32ea26e7bef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c1e72bb72942ab8c3877671b38e9b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:44Z,use_quota=True,user_id='1f2015d6573040478c082d2c6f7f060f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-78c55a04-3f1a-46ae-a89c-1201be49796a tempest-VolumeQuotasAdminTestJSON-88817206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0435696c-aa6b-4e05-845a-182fbdc1a741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-78c55a04-3f1a-46ae-a89c-1201be49796a tempest-VolumeQuotasAdminTestJSON-88817206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0435696c-aa6b-4e05-845a-182fbdc1a741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-78c55a04-3f1a-46ae-a89c-1201be49796a tempest-VolumeQuotasAdminTestJSON-88817206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d8ad7a1-6e43-4ca1-a0ff-50c37d7535af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-78c55a04-3f1a-46ae-a89c-1201be49796a tempest-VolumeQuotasAdminTestJSON-88817206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d8ad7a1-6e43-4ca1-a0ff-50c37d7535af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'decd6c19-abbf-4481-8f85-32ea26e7bef3', 'volume_name': 'volume-decd6c19-abbf-4481-8f85-32ea26e7bef3', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-78c55a04-3f1a-46ae-a89c-1201be49796a tempest-VolumeQuotasAdminTestJSON-88817206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4222dd55-90e7-43f3-8731-34f6d798c926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-78c55a04-3f1a-46ae-a89c-1201be49796a tempest-VolumeQuotasAdminTestJSON-88817206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4222dd55-90e7-43f3-8731-34f6d798c926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-78c55a04-3f1a-46ae-a89c-1201be49796a tempest-VolumeQuotasAdminTestJSON-88817206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c146dfe1-efc7-44b9-a3f4-3b969adc2ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:43 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-78c55a04-3f1a-46ae-a89c-1201be49796a tempest-VolumeQuotasAdminTestJSON-88817206 None] Volume decd6c19-abbf-4481-8f85-32ea26e7bef3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-decd6c19-abbf-4481-8f85-32ea26e7bef3', 'volume_size': 1} Sep 28 17:26:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-78c55a04-3f1a-46ae-a89c-1201be49796a tempest-VolumeQuotasAdminTestJSON-88817206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-78c55a04-3f1a-46ae-a89c-1201be49796a tempest-VolumeQuotasAdminTestJSON-88817206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:43 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-78c55a04-3f1a-46ae-a89c-1201be49796a tempest-VolumeQuotasAdminTestJSON-88817206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1931630978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=decd6c19-abbf-4481-8f85-32ea26e7bef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c1e72bb72942ab8c3877671b38e9b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:44Z,use_quota=True,user_id='1f2015d6573040478c082d2c6f7f060f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:43 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-78c55a04-3f1a-46ae-a89c-1201be49796a tempest-VolumeQuotasAdminTestJSON-88817206 None] Creating volume decd6c19-abbf-4481-8f85-32ea26e7bef3 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-78c55a04-3f1a-46ae-a89c-1201be49796a tempest-VolumeQuotasAdminTestJSON-88817206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-78c55a04-3f1a-46ae-a89c-1201be49796a tempest-VolumeQuotasAdminTestJSON-88817206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:43 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-78c55a04-3f1a-46ae-a89c-1201be49796a tempest-VolumeQuotasAdminTestJSON-88817206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:43 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-78c55a04-3f1a-46ae-a89c-1201be49796a tempest-VolumeQuotasAdminTestJSON-88817206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-78c55a04-3f1a-46ae-a89c-1201be49796a tempest-VolumeQuotasAdminTestJSON-88817206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:43 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-78c55a04-3f1a-46ae-a89c-1201be49796a tempest-VolumeQuotasAdminTestJSON-88817206 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:43 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-78c55a04-3f1a-46ae-a89c-1201be49796a tempest-VolumeQuotasAdminTestJSON-88817206 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:26:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-78c55a04-3f1a-46ae-a89c-1201be49796a tempest-VolumeQuotasAdminTestJSON-88817206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-decd6c19-abbf-4481-8f85-32ea26e7bef3 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:43 devstack sudo[103909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-decd6c19-abbf-4481-8f85-32ea26e7bef3 1073741824 Sep 28 17:26:43 devstack sudo[103909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:44 devstack sudo[103909]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-78c55a04-3f1a-46ae-a89c-1201be49796a tempest-VolumeQuotasAdminTestJSON-88817206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-decd6c19-abbf-4481-8f85-32ea26e7bef3 1073741824" returned: 0 in 0.458s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-78c55a04-3f1a-46ae-a89c-1201be49796a tempest-VolumeQuotasAdminTestJSON-88817206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-decd6c19-abbf-4481-8f85-32ea26e7bef3 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:44 devstack sudo[103915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-decd6c19-abbf-4481-8f85-32ea26e7bef3 Sep 28 17:26:44 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:44 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-78c55a04-3f1a-46ae-a89c-1201be49796a tempest-VolumeQuotasAdminTestJSON-88817206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-decd6c19-abbf-4481-8f85-32ea26e7bef3" returned: 0 in 0.256s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:44 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-78c55a04-3f1a-46ae-a89c-1201be49796a tempest-VolumeQuotasAdminTestJSON-88817206 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-78c55a04-3f1a-46ae-a89c-1201be49796a tempest-VolumeQuotasAdminTestJSON-88817206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-78c55a04-3f1a-46ae-a89c-1201be49796a tempest-VolumeQuotasAdminTestJSON-88817206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c146dfe1-efc7-44b9-a3f4-3b969adc2ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-decd6c19-abbf-4481-8f85-32ea26e7bef3', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-78c55a04-3f1a-46ae-a89c-1201be49796a tempest-VolumeQuotasAdminTestJSON-88817206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c95d826-2db4-4032-bc77-60d4626f540e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:44 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-78c55a04-3f1a-46ae-a89c-1201be49796a tempest-VolumeQuotasAdminTestJSON-88817206 None] Volume volume-decd6c19-abbf-4481-8f85-32ea26e7bef3 (decd6c19-abbf-4481-8f85-32ea26e7bef3): created successfully Sep 28 17:26:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-78c55a04-3f1a-46ae-a89c-1201be49796a tempest-VolumeQuotasAdminTestJSON-88817206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c95d826-2db4-4032-bc77-60d4626f540e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:44 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-78c55a04-3f1a-46ae-a89c-1201be49796a tempest-VolumeQuotasAdminTestJSON-88817206 None] Flow 'volume_create_manager' (5e4e1c5d-06be-4119-ac61-7d173d1fc175) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:44 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-78c55a04-3f1a-46ae-a89c-1201be49796a tempest-VolumeQuotasAdminTestJSON-88817206 None] Created volume successfully. Sep 28 17:26:44 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-932eb840-fec9-41c1-8ad7-4986505d32c7 tempest-VolumeQuotasAdminTestJSON-88817206 None] Acquiring lock "cinder-decd6c19-abbf-4481-8f85-32ea26e7bef3-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:44 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-932eb840-fec9-41c1-8ad7-4986505d32c7 tempest-VolumeQuotasAdminTestJSON-88817206 None] Lock "cinder-decd6c19-abbf-4481-8f85-32ea26e7bef3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:44 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-932eb840-fec9-41c1-8ad7-4986505d32c7 tempest-VolumeQuotasAdminTestJSON-88817206 None] Acquiring lock "cinder-quobyte-decd6c19-abbf-4481-8f85-32ea26e7bef3" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:44 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-932eb840-fec9-41c1-8ad7-4986505d32c7 tempest-VolumeQuotasAdminTestJSON-88817206 None] Lock "cinder-quobyte-decd6c19-abbf-4481-8f85-32ea26e7bef3" acquired by "delete_volume" :: waited 0.017s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:44 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd06137-6165-4ad5-963f-5733727b8f17]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-932eb840-fec9-41c1-8ad7-4986505d32c7 tempest-VolumeQuotasAdminTestJSON-88817206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-decd6c19-abbf-4481-8f85-32ea26e7bef3 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:44 devstack sudo[103918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-decd6c19-abbf-4481-8f85-32ea26e7bef3 Sep 28 17:26:44 devstack sudo[103918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:45 devstack sudo[103918]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-932eb840-fec9-41c1-8ad7-4986505d32c7 tempest-VolumeQuotasAdminTestJSON-88817206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-decd6c19-abbf-4481-8f85-32ea26e7bef3" returned: 0 in 0.419s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-932eb840-fec9-41c1-8ad7-4986505d32c7 tempest-VolumeQuotasAdminTestJSON-88817206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-decd6c19-abbf-4481-8f85-32ea26e7bef3 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:45 devstack sudo[103923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-decd6c19-abbf-4481-8f85-32ea26e7bef3 Sep 28 17:26:45 devstack sudo[103923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:45 devstack sudo[103923]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-932eb840-fec9-41c1-8ad7-4986505d32c7 tempest-VolumeQuotasAdminTestJSON-88817206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-decd6c19-abbf-4481-8f85-32ea26e7bef3" returned: 0 in 0.358s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:45 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-932eb840-fec9-41c1-8ad7-4986505d32c7 tempest-VolumeQuotasAdminTestJSON-88817206 None] Lock "cinder-quobyte-decd6c19-abbf-4481-8f85-32ea26e7bef3" released by "delete_volume" :: held 0.826s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:45 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-932eb840-fec9-41c1-8ad7-4986505d32c7 tempest-VolumeQuotasAdminTestJSON-88817206 None] Created reservations ['585b58ca-a7b4-4f05-8eda-ca6c1f7d94e2', 'dc14c9f8-79ab-4561-9989-aae25ff17843', 'c9421fd2-1765-40aa-8049-4aa0c0a328ab', '5dbf5247-8113-4544-951d-a919e610506e'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-932eb840-fec9-41c1-8ad7-4986505d32c7 tempest-VolumeQuotasAdminTestJSON-88817206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-932eb840-fec9-41c1-8ad7-4986505d32c7 tempest-VolumeQuotasAdminTestJSON-88817206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-932eb840-fec9-41c1-8ad7-4986505d32c7 tempest-VolumeQuotasAdminTestJSON-88817206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-932eb840-fec9-41c1-8ad7-4986505d32c7 tempest-VolumeQuotasAdminTestJSON-88817206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-932eb840-fec9-41c1-8ad7-4986505d32c7 tempest-VolumeQuotasAdminTestJSON-88817206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-932eb840-fec9-41c1-8ad7-4986505d32c7 tempest-VolumeQuotasAdminTestJSON-88817206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:45 devstack sudo[103928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:26:45 devstack sudo[103928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:46 devstack sudo[103928]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-932eb840-fec9-41c1-8ad7-4986505d32c7 tempest-VolumeQuotasAdminTestJSON-88817206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.303s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:46 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-932eb840-fec9-41c1-8ad7-4986505d32c7 tempest-VolumeQuotasAdminTestJSON-88817206 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:46 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-932eb840-fec9-41c1-8ad7-4986505d32c7 tempest-VolumeQuotasAdminTestJSON-88817206 None] Deleted volume successfully. Sep 28 17:26:46 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-932eb840-fec9-41c1-8ad7-4986505d32c7 tempest-VolumeQuotasAdminTestJSON-88817206 None] Lock "cinder-decd6c19-abbf-4481-8f85-32ea26e7bef3-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:46 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5cfa62c-e303-4fae-8eed-dcf41ab2916e tempest-VolumeQuotasAdminTestJSON-88817206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a5cfa62c-e303-4fae-8eed-dcf41ab2916e tempest-VolumeQuotasAdminTestJSON-88817206 None] Flow 'volume_create_manager' (57d1fe5f-355d-411a-8032-4cc2af1c36a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a5cfa62c-e303-4fae-8eed-dcf41ab2916e tempest-VolumeQuotasAdminTestJSON-88817206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e5557e4-faef-47c6-acec-a8810c15b372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a5cfa62c-e303-4fae-8eed-dcf41ab2916e tempest-VolumeQuotasAdminTestJSON-88817206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e5557e4-faef-47c6-acec-a8810c15b372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-372346540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61cc1ac3-5a6a-4b5e-9f29-f06a2883e8ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c1e72bb72942ab8c3877671b38e9b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:47Z,use_quota=True,user_id='1f2015d6573040478c082d2c6f7f060f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a5cfa62c-e303-4fae-8eed-dcf41ab2916e tempest-VolumeQuotasAdminTestJSON-88817206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc837296-92d3-42a9-9bf8-3d2d07a597aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a5cfa62c-e303-4fae-8eed-dcf41ab2916e tempest-VolumeQuotasAdminTestJSON-88817206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc837296-92d3-42a9-9bf8-3d2d07a597aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a5cfa62c-e303-4fae-8eed-dcf41ab2916e tempest-VolumeQuotasAdminTestJSON-88817206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bd5f3f4-89b9-4a5b-b657-fa4d46421fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a5cfa62c-e303-4fae-8eed-dcf41ab2916e tempest-VolumeQuotasAdminTestJSON-88817206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bd5f3f4-89b9-4a5b-b657-fa4d46421fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61cc1ac3-5a6a-4b5e-9f29-f06a2883e8ec', 'volume_name': 'volume-61cc1ac3-5a6a-4b5e-9f29-f06a2883e8ec', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a5cfa62c-e303-4fae-8eed-dcf41ab2916e tempest-VolumeQuotasAdminTestJSON-88817206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a13246-e277-4a0e-8aaa-1e54ead8f654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a5cfa62c-e303-4fae-8eed-dcf41ab2916e tempest-VolumeQuotasAdminTestJSON-88817206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a13246-e277-4a0e-8aaa-1e54ead8f654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a5cfa62c-e303-4fae-8eed-dcf41ab2916e tempest-VolumeQuotasAdminTestJSON-88817206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab9813c-8412-4e22-b351-1a52ef540ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:46 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-a5cfa62c-e303-4fae-8eed-dcf41ab2916e tempest-VolumeQuotasAdminTestJSON-88817206 None] Volume 61cc1ac3-5a6a-4b5e-9f29-f06a2883e8ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61cc1ac3-5a6a-4b5e-9f29-f06a2883e8ec', 'volume_size': 1} Sep 28 17:26:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a5cfa62c-e303-4fae-8eed-dcf41ab2916e tempest-VolumeQuotasAdminTestJSON-88817206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a5cfa62c-e303-4fae-8eed-dcf41ab2916e tempest-VolumeQuotasAdminTestJSON-88817206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:46 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a5cfa62c-e303-4fae-8eed-dcf41ab2916e tempest-VolumeQuotasAdminTestJSON-88817206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-372346540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61cc1ac3-5a6a-4b5e-9f29-f06a2883e8ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c1e72bb72942ab8c3877671b38e9b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:47Z,use_quota=True,user_id='1f2015d6573040478c082d2c6f7f060f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:46 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-a5cfa62c-e303-4fae-8eed-dcf41ab2916e tempest-VolumeQuotasAdminTestJSON-88817206 None] Creating volume 61cc1ac3-5a6a-4b5e-9f29-f06a2883e8ec {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a5cfa62c-e303-4fae-8eed-dcf41ab2916e tempest-VolumeQuotasAdminTestJSON-88817206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a5cfa62c-e303-4fae-8eed-dcf41ab2916e tempest-VolumeQuotasAdminTestJSON-88817206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:46 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a5cfa62c-e303-4fae-8eed-dcf41ab2916e tempest-VolumeQuotasAdminTestJSON-88817206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:46 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a5cfa62c-e303-4fae-8eed-dcf41ab2916e tempest-VolumeQuotasAdminTestJSON-88817206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a5cfa62c-e303-4fae-8eed-dcf41ab2916e tempest-VolumeQuotasAdminTestJSON-88817206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:46 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a5cfa62c-e303-4fae-8eed-dcf41ab2916e tempest-VolumeQuotasAdminTestJSON-88817206 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:46 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-a5cfa62c-e303-4fae-8eed-dcf41ab2916e tempest-VolumeQuotasAdminTestJSON-88817206 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:26:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a5cfa62c-e303-4fae-8eed-dcf41ab2916e tempest-VolumeQuotasAdminTestJSON-88817206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-61cc1ac3-5a6a-4b5e-9f29-f06a2883e8ec 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:46 devstack sudo[103931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-61cc1ac3-5a6a-4b5e-9f29-f06a2883e8ec 1073741824 Sep 28 17:26:46 devstack sudo[103931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:47 devstack sudo[103931]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a5cfa62c-e303-4fae-8eed-dcf41ab2916e tempest-VolumeQuotasAdminTestJSON-88817206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-61cc1ac3-5a6a-4b5e-9f29-f06a2883e8ec 1073741824" returned: 0 in 0.478s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a5cfa62c-e303-4fae-8eed-dcf41ab2916e tempest-VolumeQuotasAdminTestJSON-88817206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-61cc1ac3-5a6a-4b5e-9f29-f06a2883e8ec {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:47 devstack sudo[103936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-61cc1ac3-5a6a-4b5e-9f29-f06a2883e8ec Sep 28 17:26:47 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:47 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a5cfa62c-e303-4fae-8eed-dcf41ab2916e tempest-VolumeQuotasAdminTestJSON-88817206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-61cc1ac3-5a6a-4b5e-9f29-f06a2883e8ec" returned: 0 in 0.258s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:47 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a5cfa62c-e303-4fae-8eed-dcf41ab2916e tempest-VolumeQuotasAdminTestJSON-88817206 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a5cfa62c-e303-4fae-8eed-dcf41ab2916e tempest-VolumeQuotasAdminTestJSON-88817206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:47 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a5cfa62c-e303-4fae-8eed-dcf41ab2916e tempest-VolumeQuotasAdminTestJSON-88817206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab9813c-8412-4e22-b351-1a52ef540ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61cc1ac3-5a6a-4b5e-9f29-f06a2883e8ec', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:47 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a5cfa62c-e303-4fae-8eed-dcf41ab2916e tempest-VolumeQuotasAdminTestJSON-88817206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (487505ed-98ba-4871-9a20-3c7dc3425d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:47 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-a5cfa62c-e303-4fae-8eed-dcf41ab2916e tempest-VolumeQuotasAdminTestJSON-88817206 None] Volume volume-61cc1ac3-5a6a-4b5e-9f29-f06a2883e8ec (61cc1ac3-5a6a-4b5e-9f29-f06a2883e8ec): created successfully Sep 28 17:26:47 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a5cfa62c-e303-4fae-8eed-dcf41ab2916e tempest-VolumeQuotasAdminTestJSON-88817206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (487505ed-98ba-4871-9a20-3c7dc3425d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:47 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a5cfa62c-e303-4fae-8eed-dcf41ab2916e tempest-VolumeQuotasAdminTestJSON-88817206 None] Flow 'volume_create_manager' (57d1fe5f-355d-411a-8032-4cc2af1c36a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:47 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-a5cfa62c-e303-4fae-8eed-dcf41ab2916e tempest-VolumeQuotasAdminTestJSON-88817206 None] Created volume successfully. Sep 28 17:26:49 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-0750a565-2845-4b64-8b66-982afd284a77 tempest-VolumeQuotasAdminTestJSON-1056941845 None] Transfer volume completed successfully. Sep 28 17:26:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:26:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:49 devstack sudo[103939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:26:49 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:49 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.288s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:49 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager._thread_info {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:26:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread count: 28 {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:26:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread info: [<_MainThread(MainThread, started 132915553284224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:26:49 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-694137c0-9c11-4734-af7b-a264e0a54160 tempest-VolumeQuotasAdminTestJSON-702731358 None] Acquiring lock "cinder-61cc1ac3-5a6a-4b5e-9f29-f06a2883e8ec-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:49 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-694137c0-9c11-4734-af7b-a264e0a54160 tempest-VolumeQuotasAdminTestJSON-702731358 None] Lock "cinder-61cc1ac3-5a6a-4b5e-9f29-f06a2883e8ec-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:49 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-694137c0-9c11-4734-af7b-a264e0a54160 tempest-VolumeQuotasAdminTestJSON-702731358 None] Acquiring lock "cinder-quobyte-61cc1ac3-5a6a-4b5e-9f29-f06a2883e8ec" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:49 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-694137c0-9c11-4734-af7b-a264e0a54160 tempest-VolumeQuotasAdminTestJSON-702731358 None] Lock "cinder-quobyte-61cc1ac3-5a6a-4b5e-9f29-f06a2883e8ec" acquired by "delete_volume" :: waited 0.016s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:49 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7705ac26-715c-4bef-9eac-2f4af4f1db9d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-694137c0-9c11-4734-af7b-a264e0a54160 tempest-VolumeQuotasAdminTestJSON-702731358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-61cc1ac3-5a6a-4b5e-9f29-f06a2883e8ec {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:50 devstack sudo[103942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-61cc1ac3-5a6a-4b5e-9f29-f06a2883e8ec Sep 28 17:26:50 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:50 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-694137c0-9c11-4734-af7b-a264e0a54160 tempest-VolumeQuotasAdminTestJSON-702731358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-61cc1ac3-5a6a-4b5e-9f29-f06a2883e8ec" returned: 0 in 0.393s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-694137c0-9c11-4734-af7b-a264e0a54160 tempest-VolumeQuotasAdminTestJSON-702731358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-61cc1ac3-5a6a-4b5e-9f29-f06a2883e8ec {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:50 devstack sudo[103947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-61cc1ac3-5a6a-4b5e-9f29-f06a2883e8ec Sep 28 17:26:50 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:50 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-694137c0-9c11-4734-af7b-a264e0a54160 tempest-VolumeQuotasAdminTestJSON-702731358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-61cc1ac3-5a6a-4b5e-9f29-f06a2883e8ec" returned: 0 in 0.256s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:50 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-694137c0-9c11-4734-af7b-a264e0a54160 tempest-VolumeQuotasAdminTestJSON-702731358 None] Lock "cinder-quobyte-61cc1ac3-5a6a-4b5e-9f29-f06a2883e8ec" released by "delete_volume" :: held 0.695s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:50 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-694137c0-9c11-4734-af7b-a264e0a54160 tempest-VolumeQuotasAdminTestJSON-702731358 None] Created reservations ['813dde64-29c8-4a43-b188-6164e62a57a4', '6bf8e1dd-0738-4252-abb9-e98fb6ee0492', '464cd78e-2866-4846-9d37-98ce473e3da4', '3ea13bdf-9102-49d7-b266-d3fe9d365ebd'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-694137c0-9c11-4734-af7b-a264e0a54160 tempest-VolumeQuotasAdminTestJSON-702731358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-694137c0-9c11-4734-af7b-a264e0a54160 tempest-VolumeQuotasAdminTestJSON-702731358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:50 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-694137c0-9c11-4734-af7b-a264e0a54160 tempest-VolumeQuotasAdminTestJSON-702731358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:50 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-694137c0-9c11-4734-af7b-a264e0a54160 tempest-VolumeQuotasAdminTestJSON-702731358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-694137c0-9c11-4734-af7b-a264e0a54160 tempest-VolumeQuotasAdminTestJSON-702731358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-694137c0-9c11-4734-af7b-a264e0a54160 tempest-VolumeQuotasAdminTestJSON-702731358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:50 devstack sudo[103950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:26:50 devstack sudo[103950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:51 devstack sudo[103950]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-694137c0-9c11-4734-af7b-a264e0a54160 tempest-VolumeQuotasAdminTestJSON-702731358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.281s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:51 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-694137c0-9c11-4734-af7b-a264e0a54160 tempest-VolumeQuotasAdminTestJSON-702731358 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:51 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-694137c0-9c11-4734-af7b-a264e0a54160 tempest-VolumeQuotasAdminTestJSON-702731358 None] Deleted volume successfully. Sep 28 17:26:51 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-694137c0-9c11-4734-af7b-a264e0a54160 tempest-VolumeQuotasAdminTestJSON-702731358 None] Lock "cinder-61cc1ac3-5a6a-4b5e-9f29-f06a2883e8ec-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:58 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-6589fd47-a7f9-447a-9837-690ecbeee8c8 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6589fd47-a7f9-447a-9837-690ecbeee8c8 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Flow 'volume_create_manager' (48fae14a-3fd1-45b1-9b10-4239a1133716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6589fd47-a7f9-447a-9837-690ecbeee8c8 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70920b68-2e5b-423b-b930-a593d001c744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6589fd47-a7f9-447a-9837-690ecbeee8c8 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70920b68-2e5b-423b-b930-a593d001c744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1046364066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6810816-2109-43ec-b2b0-fe40cf3eebe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9878374d259b460899f061c83a4d43f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:58Z,use_quota=True,user_id='20e1ff30c62d4f91aa9ff7d6ab2cf1a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6589fd47-a7f9-447a-9837-690ecbeee8c8 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d1b3133-a371-46aa-b1b2-8d2eb46c40b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6589fd47-a7f9-447a-9837-690ecbeee8c8 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d1b3133-a371-46aa-b1b2-8d2eb46c40b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6589fd47-a7f9-447a-9837-690ecbeee8c8 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04eae7e1-8dd2-4435-8d19-77e995f70747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6589fd47-a7f9-447a-9837-690ecbeee8c8 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04eae7e1-8dd2-4435-8d19-77e995f70747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6810816-2109-43ec-b2b0-fe40cf3eebe5', 'volume_name': 'volume-c6810816-2109-43ec-b2b0-fe40cf3eebe5', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6589fd47-a7f9-447a-9837-690ecbeee8c8 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e1fed8-9975-4788-b21c-193c8f08108d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6589fd47-a7f9-447a-9837-690ecbeee8c8 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e1fed8-9975-4788-b21c-193c8f08108d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6589fd47-a7f9-447a-9837-690ecbeee8c8 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1e61b0-a129-43b8-9382-ee35f2b67fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:58 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-6589fd47-a7f9-447a-9837-690ecbeee8c8 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Volume c6810816-2109-43ec-b2b0-fe40cf3eebe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6810816-2109-43ec-b2b0-fe40cf3eebe5', 'volume_size': 1} Sep 28 17:26:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6589fd47-a7f9-447a-9837-690ecbeee8c8 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6589fd47-a7f9-447a-9837-690ecbeee8c8 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:58 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6589fd47-a7f9-447a-9837-690ecbeee8c8 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1046364066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6810816-2109-43ec-b2b0-fe40cf3eebe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9878374d259b460899f061c83a4d43f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:58Z,use_quota=True,user_id='20e1ff30c62d4f91aa9ff7d6ab2cf1a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:58 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-6589fd47-a7f9-447a-9837-690ecbeee8c8 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Creating volume c6810816-2109-43ec-b2b0-fe40cf3eebe5 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6589fd47-a7f9-447a-9837-690ecbeee8c8 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6589fd47-a7f9-447a-9837-690ecbeee8c8 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:58 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6589fd47-a7f9-447a-9837-690ecbeee8c8 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:58 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6589fd47-a7f9-447a-9837-690ecbeee8c8 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6589fd47-a7f9-447a-9837-690ecbeee8c8 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:58 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6589fd47-a7f9-447a-9837-690ecbeee8c8 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:58 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-6589fd47-a7f9-447a-9837-690ecbeee8c8 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:26:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6589fd47-a7f9-447a-9837-690ecbeee8c8 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c6810816-2109-43ec-b2b0-fe40cf3eebe5 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:58 devstack sudo[103954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c6810816-2109-43ec-b2b0-fe40cf3eebe5 1073741824 Sep 28 17:26:58 devstack sudo[103954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:58 devstack sudo[103954]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6589fd47-a7f9-447a-9837-690ecbeee8c8 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c6810816-2109-43ec-b2b0-fe40cf3eebe5 1073741824" returned: 0 in 0.454s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6589fd47-a7f9-447a-9837-690ecbeee8c8 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c6810816-2109-43ec-b2b0-fe40cf3eebe5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:59 devstack sudo[103960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c6810816-2109-43ec-b2b0-fe40cf3eebe5 Sep 28 17:26:59 devstack sudo[103960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:59 devstack sudo[103960]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6589fd47-a7f9-447a-9837-690ecbeee8c8 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c6810816-2109-43ec-b2b0-fe40cf3eebe5" returned: 0 in 0.269s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:59 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6589fd47-a7f9-447a-9837-690ecbeee8c8 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6589fd47-a7f9-447a-9837-690ecbeee8c8 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6589fd47-a7f9-447a-9837-690ecbeee8c8 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1e61b0-a129-43b8-9382-ee35f2b67fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6810816-2109-43ec-b2b0-fe40cf3eebe5', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6589fd47-a7f9-447a-9837-690ecbeee8c8 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd4f4a66-ca9d-4e83-bd93-b40ea1bdad64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:59 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-6589fd47-a7f9-447a-9837-690ecbeee8c8 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Volume volume-c6810816-2109-43ec-b2b0-fe40cf3eebe5 (c6810816-2109-43ec-b2b0-fe40cf3eebe5): created successfully Sep 28 17:26:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6589fd47-a7f9-447a-9837-690ecbeee8c8 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd4f4a66-ca9d-4e83-bd93-b40ea1bdad64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6589fd47-a7f9-447a-9837-690ecbeee8c8 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Flow 'volume_create_manager' (48fae14a-3fd1-45b1-9b10-4239a1133716) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:59 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-6589fd47-a7f9-447a-9837-690ecbeee8c8 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Created volume successfully. Sep 28 17:27:00 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-465a993e-81ea-4812-b127-23c5452d1892 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Acquiring lock "cinder-c6810816-2109-43ec-b2b0-fe40cf3eebe5-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:00 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-465a993e-81ea-4812-b127-23c5452d1892 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Lock "cinder-c6810816-2109-43ec-b2b0-fe40cf3eebe5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:00 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-465a993e-81ea-4812-b127-23c5452d1892 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Acquiring lock "cinder-quobyte-c6810816-2109-43ec-b2b0-fe40cf3eebe5" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:00 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-465a993e-81ea-4812-b127-23c5452d1892 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Lock "cinder-quobyte-c6810816-2109-43ec-b2b0-fe40cf3eebe5" acquired by "delete_volume" :: waited 0.016s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:00 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b9f9c3-118d-4e22-bff6-138f4301c3c1]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-465a993e-81ea-4812-b127-23c5452d1892 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c6810816-2109-43ec-b2b0-fe40cf3eebe5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:00 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c6810816-2109-43ec-b2b0-fe40cf3eebe5 Sep 28 17:27:00 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:00 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-465a993e-81ea-4812-b127-23c5452d1892 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c6810816-2109-43ec-b2b0-fe40cf3eebe5" returned: 0 in 0.383s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-465a993e-81ea-4812-b127-23c5452d1892 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c6810816-2109-43ec-b2b0-fe40cf3eebe5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:00 devstack sudo[103968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c6810816-2109-43ec-b2b0-fe40cf3eebe5 Sep 28 17:27:00 devstack sudo[103968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:01 devstack sudo[103968]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-465a993e-81ea-4812-b127-23c5452d1892 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c6810816-2109-43ec-b2b0-fe40cf3eebe5" returned: 0 in 0.244s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:01 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-465a993e-81ea-4812-b127-23c5452d1892 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Lock "cinder-quobyte-c6810816-2109-43ec-b2b0-fe40cf3eebe5" released by "delete_volume" :: held 0.671s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:01 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-465a993e-81ea-4812-b127-23c5452d1892 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Created reservations ['d877d0f4-8d71-46a7-a1a6-1e53cb1831fa', 'de52377e-0878-4a47-b221-9caa0c69ad19', '1a187a52-4528-4adc-8063-25553a118faa', '42c2588e-ec98-4155-bea3-618c60fbef37'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-465a993e-81ea-4812-b127-23c5452d1892 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-465a993e-81ea-4812-b127-23c5452d1892 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:01 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-465a993e-81ea-4812-b127-23c5452d1892 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:01 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-465a993e-81ea-4812-b127-23c5452d1892 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-465a993e-81ea-4812-b127-23c5452d1892 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-465a993e-81ea-4812-b127-23c5452d1892 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:01 devstack sudo[103972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:27:01 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:01 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-465a993e-81ea-4812-b127-23c5452d1892 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.280s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:01 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-465a993e-81ea-4812-b127-23c5452d1892 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:01 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-465a993e-81ea-4812-b127-23c5452d1892 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Deleted volume successfully. Sep 28 17:27:01 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-465a993e-81ea-4812-b127-23c5452d1892 tempest-VolumeQuotasNegativeTestJSON-1962684215 None] Lock "cinder-c6810816-2109-43ec-b2b0-fe40cf3eebe5-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:11 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=19,cinder:UPDATE=37,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:27:11 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=24,cinder:UPDATE=29,cinder:DELETE=5,cinder:INSERT=9 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:27:18 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-7758b535-c57b-4612-959e-1718c1590185 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:27:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7758b535-c57b-4612-959e-1718c1590185 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Flow 'volume_create_manager' (1a71f122-07b3-4bdb-90c1-0f88b2309411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7758b535-c57b-4612-959e-1718c1590185 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce7382f8-79bb-414a-b2e6-82029c80441a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7758b535-c57b-4612-959e-1718c1590185 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce7382f8-79bb-414a-b2e6-82029c80441a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2017758590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64472ec1-250b-407c-86be-777b536e972f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db41e976a574963aea49b06a243b824',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:18Z,use_quota=True,user_id='c8e177dedb8b4b78b6cf2f32595a2bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7758b535-c57b-4612-959e-1718c1590185 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7e34ecc-db95-4fb6-95d2-0c607ff6148f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7758b535-c57b-4612-959e-1718c1590185 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7e34ecc-db95-4fb6-95d2-0c607ff6148f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7758b535-c57b-4612-959e-1718c1590185 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec71b3c3-559d-4437-a8be-69d73a4a30e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7758b535-c57b-4612-959e-1718c1590185 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec71b3c3-559d-4437-a8be-69d73a4a30e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64472ec1-250b-407c-86be-777b536e972f', 'volume_name': 'volume-64472ec1-250b-407c-86be-777b536e972f', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7758b535-c57b-4612-959e-1718c1590185 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (727dc780-042d-410c-a1f8-77ff7ca09dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7758b535-c57b-4612-959e-1718c1590185 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (727dc780-042d-410c-a1f8-77ff7ca09dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7758b535-c57b-4612-959e-1718c1590185 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb1ee249-ba56-448f-8ec5-c54372fdf8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:18 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-7758b535-c57b-4612-959e-1718c1590185 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Volume 64472ec1-250b-407c-86be-777b536e972f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64472ec1-250b-407c-86be-777b536e972f', 'volume_size': 1} Sep 28 17:27:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7758b535-c57b-4612-959e-1718c1590185 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7758b535-c57b-4612-959e-1718c1590185 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-7758b535-c57b-4612-959e-1718c1590185 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2017758590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64472ec1-250b-407c-86be-777b536e972f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db41e976a574963aea49b06a243b824',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:18Z,use_quota=True,user_id='c8e177dedb8b4b78b6cf2f32595a2bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:27:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-7758b535-c57b-4612-959e-1718c1590185 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Creating volume 64472ec1-250b-407c-86be-777b536e972f {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:27:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7758b535-c57b-4612-959e-1718c1590185 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7758b535-c57b-4612-959e-1718c1590185 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-7758b535-c57b-4612-959e-1718c1590185 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-7758b535-c57b-4612-959e-1718c1590185 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7758b535-c57b-4612-959e-1718c1590185 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-7758b535-c57b-4612-959e-1718c1590185 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:27:18 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-7758b535-c57b-4612-959e-1718c1590185 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:27:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7758b535-c57b-4612-959e-1718c1590185 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:18 devstack sudo[103977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f 1073741824 Sep 28 17:27:18 devstack sudo[103977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:18 devstack sudo[103977]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7758b535-c57b-4612-959e-1718c1590185 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f 1073741824" returned: 0 in 0.444s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7758b535-c57b-4612-959e-1718c1590185 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:19 devstack sudo[103989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f Sep 28 17:27:19 devstack sudo[103989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:19 devstack sudo[103989]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7758b535-c57b-4612-959e-1718c1590185 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f" returned: 0 in 0.283s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-7758b535-c57b-4612-959e-1718c1590185 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:27:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7758b535-c57b-4612-959e-1718c1590185 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7758b535-c57b-4612-959e-1718c1590185 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb1ee249-ba56-448f-8ec5-c54372fdf8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64472ec1-250b-407c-86be-777b536e972f', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7758b535-c57b-4612-959e-1718c1590185 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (502f7245-b467-4c8f-ba83-98793cb1e44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:19 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-7758b535-c57b-4612-959e-1718c1590185 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Volume volume-64472ec1-250b-407c-86be-777b536e972f (64472ec1-250b-407c-86be-777b536e972f): created successfully Sep 28 17:27:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7758b535-c57b-4612-959e-1718c1590185 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (502f7245-b467-4c8f-ba83-98793cb1e44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7758b535-c57b-4612-959e-1718c1590185 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Flow 'volume_create_manager' (1a71f122-07b3-4bdb-90c1-0f88b2309411) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:19 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-7758b535-c57b-4612-959e-1718c1590185 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Created volume successfully. Sep 28 17:27:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4b37c0d3-cd2b-4b3a-9f4e-7ad78d92dac2 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4b37c0d3-cd2b-4b3a-9f4e-7ad78d92dac2 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-4b37c0d3-cd2b-4b3a-9f4e-7ad78d92dac2 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Creating offline snapshot 389f3c9f-dadb-4ce6-9cd5-25a069ec21ec of volume 64472ec1-250b-407c-86be-777b536e972f {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:27:20 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f04d28-14ab-47fe-87df-bb52c6aedab0]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4b37c0d3-cd2b-4b3a-9f4e-7ad78d92dac2 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:20 devstack sudo[103992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f Sep 28 17:27:20 devstack sudo[103992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:21 devstack sudo[103992]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4b37c0d3-cd2b-4b3a-9f4e-7ad78d92dac2 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f" returned: 0 in 0.385s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4b37c0d3-cd2b-4b3a-9f4e-7ad78d92dac2 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f.389f3c9f-dadb-4ce6-9cd5-25a069ec21ec 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:21 devstack sudo[103998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f.389f3c9f-dadb-4ce6-9cd5-25a069ec21ec 1G Sep 28 17:27:21 devstack sudo[103998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:21 devstack sudo[103998]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4b37c0d3-cd2b-4b3a-9f4e-7ad78d92dac2 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f.389f3c9f-dadb-4ce6-9cd5-25a069ec21ec 1G" returned: 0 in 0.420s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4b37c0d3-cd2b-4b3a-9f4e-7ad78d92dac2 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64472ec1-250b-407c-86be-777b536e972f -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f.389f3c9f-dadb-4ce6-9cd5-25a069ec21ec {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:21 devstack sudo[104003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64472ec1-250b-407c-86be-777b536e972f -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f.389f3c9f-dadb-4ce6-9cd5-25a069ec21ec Sep 28 17:27:21 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:21 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4b37c0d3-cd2b-4b3a-9f4e-7ad78d92dac2 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64472ec1-250b-407c-86be-777b536e972f -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f.389f3c9f-dadb-4ce6-9cd5-25a069ec21ec" returned: 0 in 0.316s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:21 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-4b37c0d3-cd2b-4b3a-9f4e-7ad78d92dac2 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f.389f3c9f-dadb-4ce6-9cd5-25a069ec21ec is being set with open permissions: ugo+rw Sep 28 17:27:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4b37c0d3-cd2b-4b3a-9f4e-7ad78d92dac2 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f.389f3c9f-dadb-4ce6-9cd5-25a069ec21ec {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:21 devstack sudo[104008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f.389f3c9f-dadb-4ce6-9cd5-25a069ec21ec Sep 28 17:27:21 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:22 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4b37c0d3-cd2b-4b3a-9f4e-7ad78d92dac2 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f.389f3c9f-dadb-4ce6-9cd5-25a069ec21ec" returned: 0 in 0.297s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4b37c0d3-cd2b-4b3a-9f4e-7ad78d92dac2 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:22 devstack sudo[104011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f.info Sep 28 17:27:22 devstack sudo[104011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:22 devstack sudo[104011]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4b37c0d3-cd2b-4b3a-9f4e-7ad78d92dac2 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f.info" returned: 0 in 0.269s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:22 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-4b37c0d3-cd2b-4b3a-9f4e-7ad78d92dac2 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f.info is being set with open permissions: ugo+rw Sep 28 17:27:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4b37c0d3-cd2b-4b3a-9f4e-7ad78d92dac2 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:22 devstack sudo[104014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f.info Sep 28 17:27:22 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:22 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4b37c0d3-cd2b-4b3a-9f4e-7ad78d92dac2 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f.info" returned: 0 in 0.262s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4b37c0d3-cd2b-4b3a-9f4e-7ad78d92dac2 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.051s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:22 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-4b37c0d3-cd2b-4b3a-9f4e-7ad78d92dac2 tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Create snapshot completed successfully Sep 28 17:27:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-45b25bf8-f9f1-42b4-bc22-63248e0af19c tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Acquiring lock "cinder-389f3c9f-dadb-4ce6-9cd5-25a069ec21ec-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-45b25bf8-f9f1-42b4-bc22-63248e0af19c tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Lock "cinder-389f3c9f-dadb-4ce6-9cd5-25a069ec21ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-45b25bf8-f9f1-42b4-bc22-63248e0af19c tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Acquiring lock "cinder-quobyte-64472ec1-250b-407c-86be-777b536e972f" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-45b25bf8-f9f1-42b4-bc22-63248e0af19c tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Lock "cinder-quobyte-64472ec1-250b-407c-86be-777b536e972f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-45b25bf8-f9f1-42b4-bc22-63248e0af19c tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Acquiring lock "cinder-quobyte-389f3c9f-dadb-4ce6-9cd5-25a069ec21ec" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-45b25bf8-f9f1-42b4-bc22-63248e0af19c tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Lock "cinder-quobyte-389f3c9f-dadb-4ce6-9cd5-25a069ec21ec" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-45b25bf8-f9f1-42b4-bc22-63248e0af19c tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Deleting offline snapshot 389f3c9f-dadb-4ce6-9cd5-25a069ec21ec of volume 64472ec1-250b-407c-86be-777b536e972f {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:27:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-45b25bf8-f9f1-42b4-bc22-63248e0af19c tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] snapshot_file for this snap is: volume-64472ec1-250b-407c-86be-777b536e972f.389f3c9f-dadb-4ce6-9cd5-25a069ec21ec {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:27:24 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b642e631-5e43-4a78-a3a9-1b843b2c1b51]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-45b25bf8-f9f1-42b4-bc22-63248e0af19c tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f.389f3c9f-dadb-4ce6-9cd5-25a069ec21ec {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:24 devstack sudo[104017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f.389f3c9f-dadb-4ce6-9cd5-25a069ec21ec Sep 28 17:27:24 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:24 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-45b25bf8-f9f1-42b4-bc22-63248e0af19c tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f.389f3c9f-dadb-4ce6-9cd5-25a069ec21ec" returned: 0 in 0.381s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-45b25bf8-f9f1-42b4-bc22-63248e0af19c tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64472ec1-250b-407c-86be-777b536e972f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:27:24 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6b9e2e-a084-40e8-96c8-4f2eb21a13db]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-45b25bf8-f9f1-42b4-bc22-63248e0af19c tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:24 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f Sep 28 17:27:24 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:25 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-45b25bf8-f9f1-42b4-bc22-63248e0af19c tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f" returned: 0 in 0.369s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-45b25bf8-f9f1-42b4-bc22-63248e0af19c tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f.389f3c9f-dadb-4ce6-9cd5-25a069ec21ec {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:25 devstack sudo[104028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f.389f3c9f-dadb-4ce6-9cd5-25a069ec21ec Sep 28 17:27:25 devstack sudo[104028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:25 devstack sudo[104028]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-45b25bf8-f9f1-42b4-bc22-63248e0af19c tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f.389f3c9f-dadb-4ce6-9cd5-25a069ec21ec" returned: 0 in 0.387s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-45b25bf8-f9f1-42b4-bc22-63248e0af19c tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f.389f3c9f-dadb-4ce6-9cd5-25a069ec21ec {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:25 devstack sudo[104033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f.389f3c9f-dadb-4ce6-9cd5-25a069ec21ec Sep 28 17:27:25 devstack sudo[104033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:25 devstack sudo[104033]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-45b25bf8-f9f1-42b4-bc22-63248e0af19c tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f.389f3c9f-dadb-4ce6-9cd5-25a069ec21ec" returned: 0 in 0.294s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:25 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-45b25bf8-f9f1-42b4-bc22-63248e0af19c tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Lock "cinder-quobyte-389f3c9f-dadb-4ce6-9cd5-25a069ec21ec" released by "_delete_snapshot" :: held 1.556s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:25 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-45b25bf8-f9f1-42b4-bc22-63248e0af19c tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Lock "cinder-quobyte-64472ec1-250b-407c-86be-777b536e972f" released by "delete_snapshot" :: held 1.589s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:26 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-45b25bf8-f9f1-42b4-bc22-63248e0af19c tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Created reservations ['5eeeb960-cb8d-4687-bf2d-512f3b451aba', '80b96327-bb6e-43f9-b4a6-6e4a6c78ba81', 'f65d0744-3b47-4327-961c-b391e8e906ab', '41088317-8dc8-4a2d-992d-54e22bc5a4f2'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:26 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-45b25bf8-f9f1-42b4-bc22-63248e0af19c tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Delete snapshot completed successfully. Sep 28 17:27:26 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-45b25bf8-f9f1-42b4-bc22-63248e0af19c tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Lock "cinder-389f3c9f-dadb-4ce6-9cd5-25a069ec21ec-delete_snapshot" released by "delete_snapshot" :: held 1.758s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:26 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b3f13afc-1070-4fcd-aa5f-e53e99fb77ee tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Acquiring lock "cinder-64472ec1-250b-407c-86be-777b536e972f-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:26 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b3f13afc-1070-4fcd-aa5f-e53e99fb77ee tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Lock "cinder-64472ec1-250b-407c-86be-777b536e972f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:26 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b3f13afc-1070-4fcd-aa5f-e53e99fb77ee tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Acquiring lock "cinder-quobyte-64472ec1-250b-407c-86be-777b536e972f" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:26 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b3f13afc-1070-4fcd-aa5f-e53e99fb77ee tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Lock "cinder-quobyte-64472ec1-250b-407c-86be-777b536e972f" acquired by "delete_volume" :: waited 0.023s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:26 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5e3dd7-c6a9-486a-a71b-6e699d23b045]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b3f13afc-1070-4fcd-aa5f-e53e99fb77ee tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:26 devstack sudo[104036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f Sep 28 17:27:26 devstack sudo[104036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:27 devstack sudo[104036]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b3f13afc-1070-4fcd-aa5f-e53e99fb77ee tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f" returned: 0 in 0.406s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b3f13afc-1070-4fcd-aa5f-e53e99fb77ee tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:27 devstack sudo[104041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f Sep 28 17:27:27 devstack sudo[104041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:27 devstack sudo[104041]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b3f13afc-1070-4fcd-aa5f-e53e99fb77ee tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-64472ec1-250b-407c-86be-777b536e972f" returned: 0 in 0.275s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b3f13afc-1070-4fcd-aa5f-e53e99fb77ee tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Lock "cinder-quobyte-64472ec1-250b-407c-86be-777b536e972f" released by "delete_volume" :: held 0.762s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:27 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-b3f13afc-1070-4fcd-aa5f-e53e99fb77ee tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Created reservations ['f9811f02-4394-4cd8-bdd2-5b134ab17e4b', '14206f89-a30c-4a42-9696-c516bcca05f5', '8f78390c-2dc9-4129-aaca-95f711e00b5e', '99bc9e25-dbb2-425e-a9f3-2b35c8ef6796'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b3f13afc-1070-4fcd-aa5f-e53e99fb77ee tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b3f13afc-1070-4fcd-aa5f-e53e99fb77ee tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:27 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b3f13afc-1070-4fcd-aa5f-e53e99fb77ee tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:27 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b3f13afc-1070-4fcd-aa5f-e53e99fb77ee tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b3f13afc-1070-4fcd-aa5f-e53e99fb77ee tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b3f13afc-1070-4fcd-aa5f-e53e99fb77ee tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:27 devstack sudo[104044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:27:27 devstack sudo[104044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:27 devstack sudo[104044]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b3f13afc-1070-4fcd-aa5f-e53e99fb77ee tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.252s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:27 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-b3f13afc-1070-4fcd-aa5f-e53e99fb77ee tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:27 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-b3f13afc-1070-4fcd-aa5f-e53e99fb77ee tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Deleted volume successfully. Sep 28 17:27:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b3f13afc-1070-4fcd-aa5f-e53e99fb77ee tempest-VolumeSnapshotQuotasNegativeTestJSON-866807335 None] Lock "cinder-64472ec1-250b-407c-86be-777b536e972f-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:37 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=15,cinder:UPDATE=23,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:27:37 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:UPDATE=13,cinder:SELECT=17,cinder:DELETE=2,cinder:INSERT=4 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:27:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:27:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:49 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:27:49 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:49 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.309s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:49 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager._thread_info {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:27:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread count: 28 {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:27:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread info: [<_MainThread(MainThread, started 132915553284224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:28:01 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4b4d181-cb32-4359-aeca-57b650f8d78a tempest-VolumesActionsTest-633054478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d4b4d181-cb32-4359-aeca-57b650f8d78a tempest-VolumesActionsTest-633054478 None] Flow 'volume_create_manager' (5768d52f-593f-4f15-8a6f-0baaed867b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d4b4d181-cb32-4359-aeca-57b650f8d78a tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7cbdd6b-d372-4796-aed9-6b11f103d91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d4b4d181-cb32-4359-aeca-57b650f8d78a tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7cbdd6b-d372-4796-aed9-6b11f103d91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-114670622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac1cc3c-5e4d-417d-9502-bc1756e022e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c832212458cd45eaafabd5bbb69638b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:01Z,use_quota=True,user_id='8a4272d1db3d4cdfa5036c4284157672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d4b4d181-cb32-4359-aeca-57b650f8d78a tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af999c4b-0b61-437a-8590-d4c89dc653dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d4b4d181-cb32-4359-aeca-57b650f8d78a tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af999c4b-0b61-437a-8590-d4c89dc653dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d4b4d181-cb32-4359-aeca-57b650f8d78a tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24295021-136f-4ff5-b37e-79364dd9656a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d4b4d181-cb32-4359-aeca-57b650f8d78a tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24295021-136f-4ff5-b37e-79364dd9656a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fac1cc3c-5e4d-417d-9502-bc1756e022e0', 'volume_name': 'volume-fac1cc3c-5e4d-417d-9502-bc1756e022e0', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d4b4d181-cb32-4359-aeca-57b650f8d78a tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4824191c-4981-40ae-a8e4-df413ff09fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d4b4d181-cb32-4359-aeca-57b650f8d78a tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4824191c-4981-40ae-a8e4-df413ff09fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d4b4d181-cb32-4359-aeca-57b650f8d78a tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149fff3d-3574-487d-b3d6-9d0589e18837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:01 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-d4b4d181-cb32-4359-aeca-57b650f8d78a tempest-VolumesActionsTest-633054478 None] Volume fac1cc3c-5e4d-417d-9502-bc1756e022e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fac1cc3c-5e4d-417d-9502-bc1756e022e0', 'volume_size': 1} Sep 28 17:28:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d4b4d181-cb32-4359-aeca-57b650f8d78a tempest-VolumesActionsTest-633054478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d4b4d181-cb32-4359-aeca-57b650f8d78a tempest-VolumesActionsTest-633054478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:01 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d4b4d181-cb32-4359-aeca-57b650f8d78a tempest-VolumesActionsTest-633054478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-114670622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac1cc3c-5e4d-417d-9502-bc1756e022e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c832212458cd45eaafabd5bbb69638b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:01Z,use_quota=True,user_id='8a4272d1db3d4cdfa5036c4284157672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:01 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-d4b4d181-cb32-4359-aeca-57b650f8d78a tempest-VolumesActionsTest-633054478 None] Creating volume fac1cc3c-5e4d-417d-9502-bc1756e022e0 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d4b4d181-cb32-4359-aeca-57b650f8d78a tempest-VolumesActionsTest-633054478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d4b4d181-cb32-4359-aeca-57b650f8d78a tempest-VolumesActionsTest-633054478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:01 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d4b4d181-cb32-4359-aeca-57b650f8d78a tempest-VolumesActionsTest-633054478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:01 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d4b4d181-cb32-4359-aeca-57b650f8d78a tempest-VolumesActionsTest-633054478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d4b4d181-cb32-4359-aeca-57b650f8d78a tempest-VolumesActionsTest-633054478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:01 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d4b4d181-cb32-4359-aeca-57b650f8d78a tempest-VolumesActionsTest-633054478 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:01 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-d4b4d181-cb32-4359-aeca-57b650f8d78a tempest-VolumesActionsTest-633054478 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:28:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d4b4d181-cb32-4359-aeca-57b650f8d78a tempest-VolumesActionsTest-633054478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fac1cc3c-5e4d-417d-9502-bc1756e022e0 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:01 devstack sudo[104196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fac1cc3c-5e4d-417d-9502-bc1756e022e0 1073741824 Sep 28 17:28:01 devstack sudo[104196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:01 devstack sudo[104196]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d4b4d181-cb32-4359-aeca-57b650f8d78a tempest-VolumesActionsTest-633054478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fac1cc3c-5e4d-417d-9502-bc1756e022e0 1073741824" returned: 0 in 0.451s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d4b4d181-cb32-4359-aeca-57b650f8d78a tempest-VolumesActionsTest-633054478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fac1cc3c-5e4d-417d-9502-bc1756e022e0 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:01 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fac1cc3c-5e4d-417d-9502-bc1756e022e0 Sep 28 17:28:01 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:02 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d4b4d181-cb32-4359-aeca-57b650f8d78a tempest-VolumesActionsTest-633054478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fac1cc3c-5e4d-417d-9502-bc1756e022e0" returned: 0 in 0.254s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:02 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d4b4d181-cb32-4359-aeca-57b650f8d78a tempest-VolumesActionsTest-633054478 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d4b4d181-cb32-4359-aeca-57b650f8d78a tempest-VolumesActionsTest-633054478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:02 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d4b4d181-cb32-4359-aeca-57b650f8d78a tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149fff3d-3574-487d-b3d6-9d0589e18837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fac1cc3c-5e4d-417d-9502-bc1756e022e0', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:02 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d4b4d181-cb32-4359-aeca-57b650f8d78a tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af53b51-1534-4e97-9500-df32e6a0b478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:02 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-d4b4d181-cb32-4359-aeca-57b650f8d78a tempest-VolumesActionsTest-633054478 None] Volume volume-fac1cc3c-5e4d-417d-9502-bc1756e022e0 (fac1cc3c-5e4d-417d-9502-bc1756e022e0): created successfully Sep 28 17:28:02 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d4b4d181-cb32-4359-aeca-57b650f8d78a tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af53b51-1534-4e97-9500-df32e6a0b478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:02 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-d4b4d181-cb32-4359-aeca-57b650f8d78a tempest-VolumesActionsTest-633054478 None] Flow 'volume_create_manager' (5768d52f-593f-4f15-8a6f-0baaed867b1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:02 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-d4b4d181-cb32-4359-aeca-57b650f8d78a tempest-VolumesActionsTest-633054478 None] Created volume successfully. Sep 28 17:28:03 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f1c1b39b-994b-44c5-8cce-374fe8224a3a tempest-VolumesActionsTest-633054478 None] Acquiring lock "cinder-fac1cc3c-5e4d-417d-9502-bc1756e022e0" by "attach_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:03 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f1c1b39b-994b-44c5-8cce-374fe8224a3a tempest-VolumesActionsTest-633054478 None] Lock "cinder-fac1cc3c-5e4d-417d-9502-bc1756e022e0" acquired by "attach_volume" :: waited 0.028s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:03 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-f1c1b39b-994b-44c5-8cce-374fe8224a3a tempest-VolumesActionsTest-633054478 None] Attaching volume fac1cc3c-5e4d-417d-9502-bc1756e022e0 to instance 9507f9f1-7f19-4628-845c-b83490a09d1c at mountpoint /dev/vdb on host None. Sep 28 17:28:03 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-f1c1b39b-994b-44c5-8cce-374fe8224a3a tempest-VolumesActionsTest-633054478 None] Attach volume completed successfully. Sep 28 17:28:03 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f1c1b39b-994b-44c5-8cce-374fe8224a3a tempest-VolumesActionsTest-633054478 None] Lock "cinder-fac1cc3c-5e4d-417d-9502-bc1756e022e0" released by "attach_volume" :: held 0.098s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:04 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-560722ee-fa22-4025-9891-ed850a7d9432 tempest-VolumesActionsTest-1672563516 None] Terminate volume connection completed successfully. Sep 28 17:28:04 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-560722ee-fa22-4025-9891-ed850a7d9432 tempest-VolumesActionsTest-1672563516 None] Acquiring lock "cinder-fac1cc3c-5e4d-417d-9502-bc1756e022e0-detach_volume" by "detach_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:04 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-560722ee-fa22-4025-9891-ed850a7d9432 tempest-VolumesActionsTest-1672563516 None] Lock "cinder-fac1cc3c-5e4d-417d-9502-bc1756e022e0-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:04 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-560722ee-fa22-4025-9891-ed850a7d9432 tempest-VolumesActionsTest-1672563516 None] Detaching volume fac1cc3c-5e4d-417d-9502-bc1756e022e0 from instance 9507f9f1-7f19-4628-845c-b83490a09d1c. Sep 28 17:28:04 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-560722ee-fa22-4025-9891-ed850a7d9432 tempest-VolumesActionsTest-1672563516 None] Detach volume completed successfully. Sep 28 17:28:04 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-560722ee-fa22-4025-9891-ed850a7d9432 tempest-VolumesActionsTest-1672563516 None] Lock "cinder-fac1cc3c-5e4d-417d-9502-bc1756e022e0-detach_volume" released by "detach_volume" :: held 0.083s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:04 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2d62ed9d-9060-486e-b768-4b6639749ed3 tempest-VolumesActionsTest-633054478 None] Acquiring lock "cinder-fac1cc3c-5e4d-417d-9502-bc1756e022e0-detach_volume" by "detach_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:04 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2d62ed9d-9060-486e-b768-4b6639749ed3 tempest-VolumesActionsTest-633054478 None] Lock "cinder-fac1cc3c-5e4d-417d-9502-bc1756e022e0-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:04 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-2d62ed9d-9060-486e-b768-4b6639749ed3 tempest-VolumesActionsTest-633054478 None] Volume detach called, but volume not attached. Sep 28 17:28:04 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2d62ed9d-9060-486e-b768-4b6639749ed3 tempest-VolumesActionsTest-633054478 None] Lock "cinder-fac1cc3c-5e4d-417d-9502-bc1756e022e0-detach_volume" released by "detach_volume" :: held 0.028s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:04 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0e8f957d-be9e-4d7e-aaad-9545e491aa64 tempest-VolumesActionsTest-633054478 None] Acquiring lock "cinder-fac1cc3c-5e4d-417d-9502-bc1756e022e0-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:04 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0e8f957d-be9e-4d7e-aaad-9545e491aa64 tempest-VolumesActionsTest-633054478 None] Lock "cinder-fac1cc3c-5e4d-417d-9502-bc1756e022e0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:04 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0e8f957d-be9e-4d7e-aaad-9545e491aa64 tempest-VolumesActionsTest-633054478 None] Acquiring lock "cinder-quobyte-fac1cc3c-5e4d-417d-9502-bc1756e022e0" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:04 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0e8f957d-be9e-4d7e-aaad-9545e491aa64 tempest-VolumesActionsTest-633054478 None] Lock "cinder-quobyte-fac1cc3c-5e4d-417d-9502-bc1756e022e0" acquired by "delete_volume" :: waited 0.024s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:04 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc85db0-6259-4606-96c4-3eb904a637b3]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0e8f957d-be9e-4d7e-aaad-9545e491aa64 tempest-VolumesActionsTest-633054478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fac1cc3c-5e4d-417d-9502-bc1756e022e0 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:05 devstack sudo[104205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fac1cc3c-5e4d-417d-9502-bc1756e022e0 Sep 28 17:28:05 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:05 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0e8f957d-be9e-4d7e-aaad-9545e491aa64 tempest-VolumesActionsTest-633054478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fac1cc3c-5e4d-417d-9502-bc1756e022e0" returned: 0 in 0.432s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0e8f957d-be9e-4d7e-aaad-9545e491aa64 tempest-VolumesActionsTest-633054478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fac1cc3c-5e4d-417d-9502-bc1756e022e0 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:05 devstack sudo[104210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fac1cc3c-5e4d-417d-9502-bc1756e022e0 Sep 28 17:28:05 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:05 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0e8f957d-be9e-4d7e-aaad-9545e491aa64 tempest-VolumesActionsTest-633054478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-fac1cc3c-5e4d-417d-9502-bc1756e022e0" returned: 0 in 0.245s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:05 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0e8f957d-be9e-4d7e-aaad-9545e491aa64 tempest-VolumesActionsTest-633054478 None] Lock "cinder-quobyte-fac1cc3c-5e4d-417d-9502-bc1756e022e0" released by "delete_volume" :: held 0.733s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:05 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-0e8f957d-be9e-4d7e-aaad-9545e491aa64 tempest-VolumesActionsTest-633054478 None] Created reservations ['900d6b4f-bc90-4342-8107-4e2f8c75b96f', 'd1539760-001f-480a-9ff0-663bb45b1deb', '97a032d5-2b7d-43ac-9e25-26e9022a261f', '597db8a1-55ea-4220-8f99-95e84cba3c16'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0e8f957d-be9e-4d7e-aaad-9545e491aa64 tempest-VolumesActionsTest-633054478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0e8f957d-be9e-4d7e-aaad-9545e491aa64 tempest-VolumesActionsTest-633054478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0e8f957d-be9e-4d7e-aaad-9545e491aa64 tempest-VolumesActionsTest-633054478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0e8f957d-be9e-4d7e-aaad-9545e491aa64 tempest-VolumesActionsTest-633054478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0e8f957d-be9e-4d7e-aaad-9545e491aa64 tempest-VolumesActionsTest-633054478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0e8f957d-be9e-4d7e-aaad-9545e491aa64 tempest-VolumesActionsTest-633054478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:05 devstack sudo[104213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:28:05 devstack sudo[104213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:06 devstack sudo[104213]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0e8f957d-be9e-4d7e-aaad-9545e491aa64 tempest-VolumesActionsTest-633054478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.276s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:06 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-0e8f957d-be9e-4d7e-aaad-9545e491aa64 tempest-VolumesActionsTest-633054478 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:06 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-0e8f957d-be9e-4d7e-aaad-9545e491aa64 tempest-VolumesActionsTest-633054478 None] Deleted volume successfully. Sep 28 17:28:06 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0e8f957d-be9e-4d7e-aaad-9545e491aa64 tempest-VolumesActionsTest-633054478 None] Lock "cinder-fac1cc3c-5e4d-417d-9502-bc1756e022e0-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:09 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a32d35f-4667-4707-825c-95047ac4f73c tempest-VolumesActionsTest-633054478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1a32d35f-4667-4707-825c-95047ac4f73c tempest-VolumesActionsTest-633054478 None] Flow 'volume_create_manager' (c1988c79-99f6-4911-9c77-53ac34eeaed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1a32d35f-4667-4707-825c-95047ac4f73c tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe05e5cb-52da-4b91-8362-badc260cc978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1a32d35f-4667-4707-825c-95047ac4f73c tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe05e5cb-52da-4b91-8362-badc260cc978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1964943271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26d21433-0450-4e56-8b19-7ed7fb27e797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c832212458cd45eaafabd5bbb69638b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:09Z,use_quota=True,user_id='8a4272d1db3d4cdfa5036c4284157672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1a32d35f-4667-4707-825c-95047ac4f73c tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8996bbb7-0818-4fbf-addd-7de8512ad9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1a32d35f-4667-4707-825c-95047ac4f73c tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8996bbb7-0818-4fbf-addd-7de8512ad9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1a32d35f-4667-4707-825c-95047ac4f73c tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ee90a76-d98d-46da-8742-0c3e39769cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1a32d35f-4667-4707-825c-95047ac4f73c tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ee90a76-d98d-46da-8742-0c3e39769cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26d21433-0450-4e56-8b19-7ed7fb27e797', 'volume_name': 'volume-26d21433-0450-4e56-8b19-7ed7fb27e797', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1a32d35f-4667-4707-825c-95047ac4f73c tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7617ef5-aaf4-4bac-9597-46171671be83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1a32d35f-4667-4707-825c-95047ac4f73c tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7617ef5-aaf4-4bac-9597-46171671be83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1a32d35f-4667-4707-825c-95047ac4f73c tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c5a392-260e-45b5-8f3d-d49fd5be808c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:09 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-1a32d35f-4667-4707-825c-95047ac4f73c tempest-VolumesActionsTest-633054478 None] Volume 26d21433-0450-4e56-8b19-7ed7fb27e797: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26d21433-0450-4e56-8b19-7ed7fb27e797', 'volume_size': 1} Sep 28 17:28:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1a32d35f-4667-4707-825c-95047ac4f73c tempest-VolumesActionsTest-633054478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1a32d35f-4667-4707-825c-95047ac4f73c tempest-VolumesActionsTest-633054478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-1a32d35f-4667-4707-825c-95047ac4f73c tempest-VolumesActionsTest-633054478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1964943271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26d21433-0450-4e56-8b19-7ed7fb27e797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c832212458cd45eaafabd5bbb69638b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:09Z,use_quota=True,user_id='8a4272d1db3d4cdfa5036c4284157672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-1a32d35f-4667-4707-825c-95047ac4f73c tempest-VolumesActionsTest-633054478 None] Creating volume 26d21433-0450-4e56-8b19-7ed7fb27e797 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1a32d35f-4667-4707-825c-95047ac4f73c tempest-VolumesActionsTest-633054478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1a32d35f-4667-4707-825c-95047ac4f73c tempest-VolumesActionsTest-633054478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-1a32d35f-4667-4707-825c-95047ac4f73c tempest-VolumesActionsTest-633054478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-1a32d35f-4667-4707-825c-95047ac4f73c tempest-VolumesActionsTest-633054478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1a32d35f-4667-4707-825c-95047ac4f73c tempest-VolumesActionsTest-633054478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-1a32d35f-4667-4707-825c-95047ac4f73c tempest-VolumesActionsTest-633054478 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:09 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-1a32d35f-4667-4707-825c-95047ac4f73c tempest-VolumesActionsTest-633054478 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:28:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1a32d35f-4667-4707-825c-95047ac4f73c tempest-VolumesActionsTest-633054478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-26d21433-0450-4e56-8b19-7ed7fb27e797 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:09 devstack sudo[104244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-26d21433-0450-4e56-8b19-7ed7fb27e797 1073741824 Sep 28 17:28:09 devstack sudo[104244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:09 devstack sudo[104244]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1a32d35f-4667-4707-825c-95047ac4f73c tempest-VolumesActionsTest-633054478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-26d21433-0450-4e56-8b19-7ed7fb27e797 1073741824" returned: 0 in 0.405s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1a32d35f-4667-4707-825c-95047ac4f73c tempest-VolumesActionsTest-633054478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-26d21433-0450-4e56-8b19-7ed7fb27e797 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:09 devstack sudo[104249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-26d21433-0450-4e56-8b19-7ed7fb27e797 Sep 28 17:28:09 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:09 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1a32d35f-4667-4707-825c-95047ac4f73c tempest-VolumesActionsTest-633054478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-26d21433-0450-4e56-8b19-7ed7fb27e797" returned: 0 in 0.233s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-1a32d35f-4667-4707-825c-95047ac4f73c tempest-VolumesActionsTest-633054478 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1a32d35f-4667-4707-825c-95047ac4f73c tempest-VolumesActionsTest-633054478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1a32d35f-4667-4707-825c-95047ac4f73c tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c5a392-260e-45b5-8f3d-d49fd5be808c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26d21433-0450-4e56-8b19-7ed7fb27e797', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1a32d35f-4667-4707-825c-95047ac4f73c tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c5660f-8bf7-4ed5-9444-7d52cd4c6662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:09 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-1a32d35f-4667-4707-825c-95047ac4f73c tempest-VolumesActionsTest-633054478 None] Volume volume-26d21433-0450-4e56-8b19-7ed7fb27e797 (26d21433-0450-4e56-8b19-7ed7fb27e797): created successfully Sep 28 17:28:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1a32d35f-4667-4707-825c-95047ac4f73c tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c5660f-8bf7-4ed5-9444-7d52cd4c6662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1a32d35f-4667-4707-825c-95047ac4f73c tempest-VolumesActionsTest-633054478 None] Flow 'volume_create_manager' (c1988c79-99f6-4911-9c77-53ac34eeaed7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:09 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-1a32d35f-4667-4707-825c-95047ac4f73c tempest-VolumesActionsTest-633054478 None] Created volume successfully. Sep 28 17:28:10 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8a1e29f4-df25-4428-83d6-eb2f2bc7e7da tempest-VolumesActionsTest-1672563516 None] Acquiring lock "cinder-26d21433-0450-4e56-8b19-7ed7fb27e797-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:10 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8a1e29f4-df25-4428-83d6-eb2f2bc7e7da tempest-VolumesActionsTest-1672563516 None] Lock "cinder-26d21433-0450-4e56-8b19-7ed7fb27e797-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:10 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8a1e29f4-df25-4428-83d6-eb2f2bc7e7da tempest-VolumesActionsTest-1672563516 None] Acquiring lock "cinder-quobyte-26d21433-0450-4e56-8b19-7ed7fb27e797" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:10 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8a1e29f4-df25-4428-83d6-eb2f2bc7e7da tempest-VolumesActionsTest-1672563516 None] Lock "cinder-quobyte-26d21433-0450-4e56-8b19-7ed7fb27e797" acquired by "delete_volume" :: waited 0.014s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:10 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8efd99-d9e6-44ed-b688-6f0e3e175acc]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8a1e29f4-df25-4428-83d6-eb2f2bc7e7da tempest-VolumesActionsTest-1672563516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-26d21433-0450-4e56-8b19-7ed7fb27e797 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:10 devstack sudo[104252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-26d21433-0450-4e56-8b19-7ed7fb27e797 Sep 28 17:28:10 devstack sudo[104252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:10 devstack sudo[104252]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8a1e29f4-df25-4428-83d6-eb2f2bc7e7da tempest-VolumesActionsTest-1672563516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-26d21433-0450-4e56-8b19-7ed7fb27e797" returned: 0 in 0.407s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8a1e29f4-df25-4428-83d6-eb2f2bc7e7da tempest-VolumesActionsTest-1672563516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-26d21433-0450-4e56-8b19-7ed7fb27e797 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:10 devstack sudo[104257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-26d21433-0450-4e56-8b19-7ed7fb27e797 Sep 28 17:28:10 devstack sudo[104257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:10 devstack sudo[104257]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8a1e29f4-df25-4428-83d6-eb2f2bc7e7da tempest-VolumesActionsTest-1672563516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-26d21433-0450-4e56-8b19-7ed7fb27e797" returned: 0 in 0.251s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:11 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8a1e29f4-df25-4428-83d6-eb2f2bc7e7da tempest-VolumesActionsTest-1672563516 None] Lock "cinder-quobyte-26d21433-0450-4e56-8b19-7ed7fb27e797" released by "delete_volume" :: held 0.699s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:11 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-8a1e29f4-df25-4428-83d6-eb2f2bc7e7da tempest-VolumesActionsTest-1672563516 None] Created reservations ['4bee0ff5-e9dd-4448-b8bd-dcbceab6049c', 'fd995f4f-97e6-4499-81a9-a108eb4772e5', '7360ec97-adf4-4890-99b6-0c2c39803f2a', 'ced35817-17ee-4efa-9d72-75c40678d280'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8a1e29f4-df25-4428-83d6-eb2f2bc7e7da tempest-VolumesActionsTest-1672563516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8a1e29f4-df25-4428-83d6-eb2f2bc7e7da tempest-VolumesActionsTest-1672563516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-8a1e29f4-df25-4428-83d6-eb2f2bc7e7da tempest-VolumesActionsTest-1672563516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-8a1e29f4-df25-4428-83d6-eb2f2bc7e7da tempest-VolumesActionsTest-1672563516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8a1e29f4-df25-4428-83d6-eb2f2bc7e7da tempest-VolumesActionsTest-1672563516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8a1e29f4-df25-4428-83d6-eb2f2bc7e7da tempest-VolumesActionsTest-1672563516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:11 devstack sudo[104261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:28:11 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:11 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8a1e29f4-df25-4428-83d6-eb2f2bc7e7da tempest-VolumesActionsTest-1672563516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.245s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:11 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-8a1e29f4-df25-4428-83d6-eb2f2bc7e7da tempest-VolumesActionsTest-1672563516 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:11 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-8a1e29f4-df25-4428-83d6-eb2f2bc7e7da tempest-VolumesActionsTest-1672563516 None] Deleted volume successfully. Sep 28 17:28:11 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8a1e29f4-df25-4428-83d6-eb2f2bc7e7da tempest-VolumesActionsTest-1672563516 None] Lock "cinder-26d21433-0450-4e56-8b19-7ed7fb27e797-delete_volume" released by "delete_volume" :: held 1.143s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:11 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-156c2aaf-2fb7-4a6f-8eab-65f13942c6d1 tempest-VolumesActionsTest-633054478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-156c2aaf-2fb7-4a6f-8eab-65f13942c6d1 tempest-VolumesActionsTest-633054478 None] Flow 'volume_create_manager' (134b59b1-1976-44e0-bec2-4ba125ed658c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-156c2aaf-2fb7-4a6f-8eab-65f13942c6d1 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a491f20-6568-427f-aa35-97a2441ff7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-156c2aaf-2fb7-4a6f-8eab-65f13942c6d1 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a491f20-6568-427f-aa35-97a2441ff7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-868109774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d03d9793-b11e-43c0-ab9f-c16972d8c639,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c832212458cd45eaafabd5bbb69638b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:12Z,use_quota=True,user_id='8a4272d1db3d4cdfa5036c4284157672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-156c2aaf-2fb7-4a6f-8eab-65f13942c6d1 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f17cf6f-d1f6-48db-ada4-4641293fb6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-156c2aaf-2fb7-4a6f-8eab-65f13942c6d1 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f17cf6f-d1f6-48db-ada4-4641293fb6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-156c2aaf-2fb7-4a6f-8eab-65f13942c6d1 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e0dcc6-cd14-4d69-82dd-cce84f1b55db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-156c2aaf-2fb7-4a6f-8eab-65f13942c6d1 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e0dcc6-cd14-4d69-82dd-cce84f1b55db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd03d9793-b11e-43c0-ab9f-c16972d8c639', 'volume_name': 'volume-d03d9793-b11e-43c0-ab9f-c16972d8c639', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-156c2aaf-2fb7-4a6f-8eab-65f13942c6d1 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6a79912-7867-458b-a478-baa48b9773e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-156c2aaf-2fb7-4a6f-8eab-65f13942c6d1 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6a79912-7867-458b-a478-baa48b9773e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-156c2aaf-2fb7-4a6f-8eab-65f13942c6d1 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05424e5a-3a04-4781-8100-ddde04024594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:11 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-156c2aaf-2fb7-4a6f-8eab-65f13942c6d1 tempest-VolumesActionsTest-633054478 None] Volume d03d9793-b11e-43c0-ab9f-c16972d8c639: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d03d9793-b11e-43c0-ab9f-c16972d8c639', 'volume_size': 1} Sep 28 17:28:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-156c2aaf-2fb7-4a6f-8eab-65f13942c6d1 tempest-VolumesActionsTest-633054478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-156c2aaf-2fb7-4a6f-8eab-65f13942c6d1 tempest-VolumesActionsTest-633054478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-156c2aaf-2fb7-4a6f-8eab-65f13942c6d1 tempest-VolumesActionsTest-633054478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-868109774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d03d9793-b11e-43c0-ab9f-c16972d8c639,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c832212458cd45eaafabd5bbb69638b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:12Z,use_quota=True,user_id='8a4272d1db3d4cdfa5036c4284157672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-156c2aaf-2fb7-4a6f-8eab-65f13942c6d1 tempest-VolumesActionsTest-633054478 None] Creating volume d03d9793-b11e-43c0-ab9f-c16972d8c639 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-156c2aaf-2fb7-4a6f-8eab-65f13942c6d1 tempest-VolumesActionsTest-633054478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-156c2aaf-2fb7-4a6f-8eab-65f13942c6d1 tempest-VolumesActionsTest-633054478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-156c2aaf-2fb7-4a6f-8eab-65f13942c6d1 tempest-VolumesActionsTest-633054478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-156c2aaf-2fb7-4a6f-8eab-65f13942c6d1 tempest-VolumesActionsTest-633054478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-156c2aaf-2fb7-4a6f-8eab-65f13942c6d1 tempest-VolumesActionsTest-633054478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-156c2aaf-2fb7-4a6f-8eab-65f13942c6d1 tempest-VolumesActionsTest-633054478 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:11 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-156c2aaf-2fb7-4a6f-8eab-65f13942c6d1 tempest-VolumesActionsTest-633054478 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:28:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-156c2aaf-2fb7-4a6f-8eab-65f13942c6d1 tempest-VolumesActionsTest-633054478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d03d9793-b11e-43c0-ab9f-c16972d8c639 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:12 devstack sudo[104264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d03d9793-b11e-43c0-ab9f-c16972d8c639 1073741824 Sep 28 17:28:12 devstack sudo[104264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:12 devstack sudo[104264]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-156c2aaf-2fb7-4a6f-8eab-65f13942c6d1 tempest-VolumesActionsTest-633054478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d03d9793-b11e-43c0-ab9f-c16972d8c639 1073741824" returned: 0 in 0.427s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-156c2aaf-2fb7-4a6f-8eab-65f13942c6d1 tempest-VolumesActionsTest-633054478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d03d9793-b11e-43c0-ab9f-c16972d8c639 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:12 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d03d9793-b11e-43c0-ab9f-c16972d8c639 Sep 28 17:28:12 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:12 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-156c2aaf-2fb7-4a6f-8eab-65f13942c6d1 tempest-VolumesActionsTest-633054478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d03d9793-b11e-43c0-ab9f-c16972d8c639" returned: 0 in 0.247s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:12 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-156c2aaf-2fb7-4a6f-8eab-65f13942c6d1 tempest-VolumesActionsTest-633054478 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-156c2aaf-2fb7-4a6f-8eab-65f13942c6d1 tempest-VolumesActionsTest-633054478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-156c2aaf-2fb7-4a6f-8eab-65f13942c6d1 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05424e5a-3a04-4781-8100-ddde04024594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d03d9793-b11e-43c0-ab9f-c16972d8c639', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-156c2aaf-2fb7-4a6f-8eab-65f13942c6d1 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c6a4d89-5a20-4abd-b217-42d8cf1b2d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:12 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-156c2aaf-2fb7-4a6f-8eab-65f13942c6d1 tempest-VolumesActionsTest-633054478 None] Volume volume-d03d9793-b11e-43c0-ab9f-c16972d8c639 (d03d9793-b11e-43c0-ab9f-c16972d8c639): created successfully Sep 28 17:28:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-156c2aaf-2fb7-4a6f-8eab-65f13942c6d1 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c6a4d89-5a20-4abd-b217-42d8cf1b2d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-156c2aaf-2fb7-4a6f-8eab-65f13942c6d1 tempest-VolumesActionsTest-633054478 None] Flow 'volume_create_manager' (134b59b1-1976-44e0-bec2-4ba125ed658c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:12 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-156c2aaf-2fb7-4a6f-8eab-65f13942c6d1 tempest-VolumesActionsTest-633054478 None] Created volume successfully. Sep 28 17:28:13 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ef33de4c-b9a4-49db-9ba4-586d7ebbf7a4 tempest-VolumesActionsTest-1672563516 None] Acquiring lock "cinder-d03d9793-b11e-43c0-ab9f-c16972d8c639-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:13 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ef33de4c-b9a4-49db-9ba4-586d7ebbf7a4 tempest-VolumesActionsTest-1672563516 None] Lock "cinder-d03d9793-b11e-43c0-ab9f-c16972d8c639-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:13 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ef33de4c-b9a4-49db-9ba4-586d7ebbf7a4 tempest-VolumesActionsTest-1672563516 None] Acquiring lock "cinder-quobyte-d03d9793-b11e-43c0-ab9f-c16972d8c639" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:13 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ef33de4c-b9a4-49db-9ba4-586d7ebbf7a4 tempest-VolumesActionsTest-1672563516 None] Lock "cinder-quobyte-d03d9793-b11e-43c0-ab9f-c16972d8c639" acquired by "delete_volume" :: waited 0.015s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:13 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0ffcfd-fd00-4074-96ad-9f578c6fdd48]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ef33de4c-b9a4-49db-9ba4-586d7ebbf7a4 tempest-VolumesActionsTest-1672563516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d03d9793-b11e-43c0-ab9f-c16972d8c639 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:13 devstack sudo[104272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d03d9793-b11e-43c0-ab9f-c16972d8c639 Sep 28 17:28:13 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:13 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ef33de4c-b9a4-49db-9ba4-586d7ebbf7a4 tempest-VolumesActionsTest-1672563516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d03d9793-b11e-43c0-ab9f-c16972d8c639" returned: 0 in 0.361s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ef33de4c-b9a4-49db-9ba4-586d7ebbf7a4 tempest-VolumesActionsTest-1672563516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d03d9793-b11e-43c0-ab9f-c16972d8c639 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:13 devstack sudo[104277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d03d9793-b11e-43c0-ab9f-c16972d8c639 Sep 28 17:28:13 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:13 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ef33de4c-b9a4-49db-9ba4-586d7ebbf7a4 tempest-VolumesActionsTest-1672563516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d03d9793-b11e-43c0-ab9f-c16972d8c639" returned: 0 in 0.248s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:13 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ef33de4c-b9a4-49db-9ba4-586d7ebbf7a4 tempest-VolumesActionsTest-1672563516 None] Lock "cinder-quobyte-d03d9793-b11e-43c0-ab9f-c16972d8c639" released by "delete_volume" :: held 0.649s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:13 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-ef33de4c-b9a4-49db-9ba4-586d7ebbf7a4 tempest-VolumesActionsTest-1672563516 None] Created reservations ['890ac888-3ecc-4b15-b1c6-33e09d7f600c', '7bc926a8-3cb7-457a-9be4-ce2744c8edd6', 'a7430960-6516-4b55-94e8-1867a8ebecf2', '6c7f39fa-bee9-4425-aa0d-3f92d9fcfe26'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ef33de4c-b9a4-49db-9ba4-586d7ebbf7a4 tempest-VolumesActionsTest-1672563516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ef33de4c-b9a4-49db-9ba4-586d7ebbf7a4 tempest-VolumesActionsTest-1672563516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:13 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ef33de4c-b9a4-49db-9ba4-586d7ebbf7a4 tempest-VolumesActionsTest-1672563516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:13 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ef33de4c-b9a4-49db-9ba4-586d7ebbf7a4 tempest-VolumesActionsTest-1672563516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ef33de4c-b9a4-49db-9ba4-586d7ebbf7a4 tempest-VolumesActionsTest-1672563516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ef33de4c-b9a4-49db-9ba4-586d7ebbf7a4 tempest-VolumesActionsTest-1672563516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:13 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:28:13 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:14 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ef33de4c-b9a4-49db-9ba4-586d7ebbf7a4 tempest-VolumesActionsTest-1672563516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.245s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:14 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-ef33de4c-b9a4-49db-9ba4-586d7ebbf7a4 tempest-VolumesActionsTest-1672563516 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:14 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-ef33de4c-b9a4-49db-9ba4-586d7ebbf7a4 tempest-VolumesActionsTest-1672563516 None] Deleted volume successfully. Sep 28 17:28:14 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ef33de4c-b9a4-49db-9ba4-586d7ebbf7a4 tempest-VolumesActionsTest-1672563516 None] Lock "cinder-d03d9793-b11e-43c0-ab9f-c16972d8c639-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:14 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-75c06ac6-d98e-41ac-9f7c-b8e0e91ccd92 tempest-VolumesActionsTest-633054478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-75c06ac6-d98e-41ac-9f7c-b8e0e91ccd92 tempest-VolumesActionsTest-633054478 None] Flow 'volume_create_manager' (27c1edd1-135d-4fb2-93b6-f008f9ad935f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-75c06ac6-d98e-41ac-9f7c-b8e0e91ccd92 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b860ba7-78f5-46b9-8083-fcf445d9d151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-75c06ac6-d98e-41ac-9f7c-b8e0e91ccd92 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b860ba7-78f5-46b9-8083-fcf445d9d151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1564084861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0c3e306-83d1-4036-ba6d-56f001428367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c832212458cd45eaafabd5bbb69638b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:15Z,use_quota=True,user_id='8a4272d1db3d4cdfa5036c4284157672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-75c06ac6-d98e-41ac-9f7c-b8e0e91ccd92 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97418b67-a8b6-4418-a80c-d7e5e44262cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-75c06ac6-d98e-41ac-9f7c-b8e0e91ccd92 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97418b67-a8b6-4418-a80c-d7e5e44262cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-75c06ac6-d98e-41ac-9f7c-b8e0e91ccd92 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7360310d-3470-46d1-b5a6-3f180832bdd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-75c06ac6-d98e-41ac-9f7c-b8e0e91ccd92 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7360310d-3470-46d1-b5a6-3f180832bdd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0c3e306-83d1-4036-ba6d-56f001428367', 'volume_name': 'volume-a0c3e306-83d1-4036-ba6d-56f001428367', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-75c06ac6-d98e-41ac-9f7c-b8e0e91ccd92 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2736ced6-f2b5-4cc2-a838-060182fd67cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-75c06ac6-d98e-41ac-9f7c-b8e0e91ccd92 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2736ced6-f2b5-4cc2-a838-060182fd67cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-75c06ac6-d98e-41ac-9f7c-b8e0e91ccd92 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9192327-8e4d-4c51-ac68-f2d6030c660f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:14 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-75c06ac6-d98e-41ac-9f7c-b8e0e91ccd92 tempest-VolumesActionsTest-633054478 None] Volume a0c3e306-83d1-4036-ba6d-56f001428367: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0c3e306-83d1-4036-ba6d-56f001428367', 'volume_size': 1} Sep 28 17:28:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-75c06ac6-d98e-41ac-9f7c-b8e0e91ccd92 tempest-VolumesActionsTest-633054478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-75c06ac6-d98e-41ac-9f7c-b8e0e91ccd92 tempest-VolumesActionsTest-633054478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:14 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-75c06ac6-d98e-41ac-9f7c-b8e0e91ccd92 tempest-VolumesActionsTest-633054478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1564084861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0c3e306-83d1-4036-ba6d-56f001428367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c832212458cd45eaafabd5bbb69638b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:15Z,use_quota=True,user_id='8a4272d1db3d4cdfa5036c4284157672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:14 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-75c06ac6-d98e-41ac-9f7c-b8e0e91ccd92 tempest-VolumesActionsTest-633054478 None] Creating volume a0c3e306-83d1-4036-ba6d-56f001428367 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-75c06ac6-d98e-41ac-9f7c-b8e0e91ccd92 tempest-VolumesActionsTest-633054478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-75c06ac6-d98e-41ac-9f7c-b8e0e91ccd92 tempest-VolumesActionsTest-633054478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:14 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-75c06ac6-d98e-41ac-9f7c-b8e0e91ccd92 tempest-VolumesActionsTest-633054478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:14 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-75c06ac6-d98e-41ac-9f7c-b8e0e91ccd92 tempest-VolumesActionsTest-633054478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-75c06ac6-d98e-41ac-9f7c-b8e0e91ccd92 tempest-VolumesActionsTest-633054478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:14 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-75c06ac6-d98e-41ac-9f7c-b8e0e91ccd92 tempest-VolumesActionsTest-633054478 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:14 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-75c06ac6-d98e-41ac-9f7c-b8e0e91ccd92 tempest-VolumesActionsTest-633054478 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:28:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-75c06ac6-d98e-41ac-9f7c-b8e0e91ccd92 tempest-VolumesActionsTest-633054478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a0c3e306-83d1-4036-ba6d-56f001428367 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:14 devstack sudo[104283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a0c3e306-83d1-4036-ba6d-56f001428367 1073741824 Sep 28 17:28:14 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:15 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-75c06ac6-d98e-41ac-9f7c-b8e0e91ccd92 tempest-VolumesActionsTest-633054478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a0c3e306-83d1-4036-ba6d-56f001428367 1073741824" returned: 0 in 0.434s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-75c06ac6-d98e-41ac-9f7c-b8e0e91ccd92 tempest-VolumesActionsTest-633054478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a0c3e306-83d1-4036-ba6d-56f001428367 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:15 devstack sudo[104288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a0c3e306-83d1-4036-ba6d-56f001428367 Sep 28 17:28:15 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:15 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-75c06ac6-d98e-41ac-9f7c-b8e0e91ccd92 tempest-VolumesActionsTest-633054478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a0c3e306-83d1-4036-ba6d-56f001428367" returned: 0 in 0.249s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:15 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-75c06ac6-d98e-41ac-9f7c-b8e0e91ccd92 tempest-VolumesActionsTest-633054478 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-75c06ac6-d98e-41ac-9f7c-b8e0e91ccd92 tempest-VolumesActionsTest-633054478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-75c06ac6-d98e-41ac-9f7c-b8e0e91ccd92 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9192327-8e4d-4c51-ac68-f2d6030c660f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0c3e306-83d1-4036-ba6d-56f001428367', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-75c06ac6-d98e-41ac-9f7c-b8e0e91ccd92 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1acff801-9cb4-451e-a4db-3bf0a38b824e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:15 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-75c06ac6-d98e-41ac-9f7c-b8e0e91ccd92 tempest-VolumesActionsTest-633054478 None] Volume volume-a0c3e306-83d1-4036-ba6d-56f001428367 (a0c3e306-83d1-4036-ba6d-56f001428367): created successfully Sep 28 17:28:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-75c06ac6-d98e-41ac-9f7c-b8e0e91ccd92 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1acff801-9cb4-451e-a4db-3bf0a38b824e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-75c06ac6-d98e-41ac-9f7c-b8e0e91ccd92 tempest-VolumesActionsTest-633054478 None] Flow 'volume_create_manager' (27c1edd1-135d-4fb2-93b6-f008f9ad935f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:15 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-75c06ac6-d98e-41ac-9f7c-b8e0e91ccd92 tempest-VolumesActionsTest-633054478 None] Created volume successfully. Sep 28 17:28:15 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1637dda7-a53d-4bf1-a0f0-06cb27fa9a12 tempest-VolumesActionsTest-1672563516 None] Acquiring lock "cinder-a0c3e306-83d1-4036-ba6d-56f001428367-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:15 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1637dda7-a53d-4bf1-a0f0-06cb27fa9a12 tempest-VolumesActionsTest-1672563516 None] Lock "cinder-a0c3e306-83d1-4036-ba6d-56f001428367-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:15 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1637dda7-a53d-4bf1-a0f0-06cb27fa9a12 tempest-VolumesActionsTest-1672563516 None] Acquiring lock "cinder-quobyte-a0c3e306-83d1-4036-ba6d-56f001428367" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:15 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1637dda7-a53d-4bf1-a0f0-06cb27fa9a12 tempest-VolumesActionsTest-1672563516 None] Lock "cinder-quobyte-a0c3e306-83d1-4036-ba6d-56f001428367" acquired by "delete_volume" :: waited 0.016s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:15 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0245a9f-f84e-4eed-a4ef-e0e1db649eb5]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1637dda7-a53d-4bf1-a0f0-06cb27fa9a12 tempest-VolumesActionsTest-1672563516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a0c3e306-83d1-4036-ba6d-56f001428367 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:16 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a0c3e306-83d1-4036-ba6d-56f001428367 Sep 28 17:28:16 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:16 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1637dda7-a53d-4bf1-a0f0-06cb27fa9a12 tempest-VolumesActionsTest-1672563516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a0c3e306-83d1-4036-ba6d-56f001428367" returned: 0 in 0.351s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1637dda7-a53d-4bf1-a0f0-06cb27fa9a12 tempest-VolumesActionsTest-1672563516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a0c3e306-83d1-4036-ba6d-56f001428367 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:16 devstack sudo[104296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a0c3e306-83d1-4036-ba6d-56f001428367 Sep 28 17:28:16 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:16 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1637dda7-a53d-4bf1-a0f0-06cb27fa9a12 tempest-VolumesActionsTest-1672563516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a0c3e306-83d1-4036-ba6d-56f001428367" returned: 0 in 0.248s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:16 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1637dda7-a53d-4bf1-a0f0-06cb27fa9a12 tempest-VolumesActionsTest-1672563516 None] Lock "cinder-quobyte-a0c3e306-83d1-4036-ba6d-56f001428367" released by "delete_volume" :: held 0.644s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:16 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-1637dda7-a53d-4bf1-a0f0-06cb27fa9a12 tempest-VolumesActionsTest-1672563516 None] Created reservations ['3745fd6b-d355-4e70-b071-01a809a3df74', 'a9c0f82a-3049-47cf-8c1c-f90eab2fc7db', '976b819e-4c77-4cfc-a816-7cdb0af48892', 'e1b11020-81fa-4983-9ecf-b74354cb990d'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1637dda7-a53d-4bf1-a0f0-06cb27fa9a12 tempest-VolumesActionsTest-1672563516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1637dda7-a53d-4bf1-a0f0-06cb27fa9a12 tempest-VolumesActionsTest-1672563516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:16 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-1637dda7-a53d-4bf1-a0f0-06cb27fa9a12 tempest-VolumesActionsTest-1672563516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:16 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-1637dda7-a53d-4bf1-a0f0-06cb27fa9a12 tempest-VolumesActionsTest-1672563516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1637dda7-a53d-4bf1-a0f0-06cb27fa9a12 tempest-VolumesActionsTest-1672563516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1637dda7-a53d-4bf1-a0f0-06cb27fa9a12 tempest-VolumesActionsTest-1672563516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:16 devstack sudo[104299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:28:16 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:16 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1637dda7-a53d-4bf1-a0f0-06cb27fa9a12 tempest-VolumesActionsTest-1672563516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.239s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:16 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-1637dda7-a53d-4bf1-a0f0-06cb27fa9a12 tempest-VolumesActionsTest-1672563516 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:16 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-1637dda7-a53d-4bf1-a0f0-06cb27fa9a12 tempest-VolumesActionsTest-1672563516 None] Deleted volume successfully. Sep 28 17:28:16 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1637dda7-a53d-4bf1-a0f0-06cb27fa9a12 tempest-VolumesActionsTest-1672563516 None] Lock "cinder-a0c3e306-83d1-4036-ba6d-56f001428367-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:17 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-0578cadb-89f0-40b0-92f9-d3f217deaf99 tempest-VolumesActionsTest-633054478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0578cadb-89f0-40b0-92f9-d3f217deaf99 tempest-VolumesActionsTest-633054478 None] Flow 'volume_create_manager' (d82a4ea8-eb26-466b-af60-011e2a6eb9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0578cadb-89f0-40b0-92f9-d3f217deaf99 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0650a505-d0c7-4f91-b0e1-77dfc0e17767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0578cadb-89f0-40b0-92f9-d3f217deaf99 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0650a505-d0c7-4f91-b0e1-77dfc0e17767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-496215240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be95a8d4-6a01-4e5b-9c96-891079f27554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c832212458cd45eaafabd5bbb69638b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:17Z,use_quota=True,user_id='8a4272d1db3d4cdfa5036c4284157672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0578cadb-89f0-40b0-92f9-d3f217deaf99 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b99f70e-f6ed-45c2-a0ff-4fcd7985b698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0578cadb-89f0-40b0-92f9-d3f217deaf99 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b99f70e-f6ed-45c2-a0ff-4fcd7985b698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0578cadb-89f0-40b0-92f9-d3f217deaf99 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c655f91e-4458-418d-bd0a-6a2ddea601a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0578cadb-89f0-40b0-92f9-d3f217deaf99 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c655f91e-4458-418d-bd0a-6a2ddea601a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be95a8d4-6a01-4e5b-9c96-891079f27554', 'volume_name': 'volume-be95a8d4-6a01-4e5b-9c96-891079f27554', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0578cadb-89f0-40b0-92f9-d3f217deaf99 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a2277e-1542-44fc-8117-b26f6ccaa2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0578cadb-89f0-40b0-92f9-d3f217deaf99 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a2277e-1542-44fc-8117-b26f6ccaa2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0578cadb-89f0-40b0-92f9-d3f217deaf99 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ad1dfe4-cfb2-4f9e-b4c2-c360b42d74fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:17 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-0578cadb-89f0-40b0-92f9-d3f217deaf99 tempest-VolumesActionsTest-633054478 None] Volume be95a8d4-6a01-4e5b-9c96-891079f27554: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be95a8d4-6a01-4e5b-9c96-891079f27554', 'volume_size': 1} Sep 28 17:28:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0578cadb-89f0-40b0-92f9-d3f217deaf99 tempest-VolumesActionsTest-633054478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0578cadb-89f0-40b0-92f9-d3f217deaf99 tempest-VolumesActionsTest-633054478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:17 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0578cadb-89f0-40b0-92f9-d3f217deaf99 tempest-VolumesActionsTest-633054478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-496215240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be95a8d4-6a01-4e5b-9c96-891079f27554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c832212458cd45eaafabd5bbb69638b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:17Z,use_quota=True,user_id='8a4272d1db3d4cdfa5036c4284157672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:17 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-0578cadb-89f0-40b0-92f9-d3f217deaf99 tempest-VolumesActionsTest-633054478 None] Creating volume be95a8d4-6a01-4e5b-9c96-891079f27554 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0578cadb-89f0-40b0-92f9-d3f217deaf99 tempest-VolumesActionsTest-633054478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0578cadb-89f0-40b0-92f9-d3f217deaf99 tempest-VolumesActionsTest-633054478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:17 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0578cadb-89f0-40b0-92f9-d3f217deaf99 tempest-VolumesActionsTest-633054478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:17 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0578cadb-89f0-40b0-92f9-d3f217deaf99 tempest-VolumesActionsTest-633054478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0578cadb-89f0-40b0-92f9-d3f217deaf99 tempest-VolumesActionsTest-633054478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:17 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0578cadb-89f0-40b0-92f9-d3f217deaf99 tempest-VolumesActionsTest-633054478 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:17 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-0578cadb-89f0-40b0-92f9-d3f217deaf99 tempest-VolumesActionsTest-633054478 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:28:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0578cadb-89f0-40b0-92f9-d3f217deaf99 tempest-VolumesActionsTest-633054478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-be95a8d4-6a01-4e5b-9c96-891079f27554 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:17 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-be95a8d4-6a01-4e5b-9c96-891079f27554 1073741824 Sep 28 17:28:17 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:17 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0578cadb-89f0-40b0-92f9-d3f217deaf99 tempest-VolumesActionsTest-633054478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-be95a8d4-6a01-4e5b-9c96-891079f27554 1073741824" returned: 0 in 0.419s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0578cadb-89f0-40b0-92f9-d3f217deaf99 tempest-VolumesActionsTest-633054478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-be95a8d4-6a01-4e5b-9c96-891079f27554 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:18 devstack sudo[104308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-be95a8d4-6a01-4e5b-9c96-891079f27554 Sep 28 17:28:18 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:18 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0578cadb-89f0-40b0-92f9-d3f217deaf99 tempest-VolumesActionsTest-633054478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-be95a8d4-6a01-4e5b-9c96-891079f27554" returned: 0 in 0.243s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0578cadb-89f0-40b0-92f9-d3f217deaf99 tempest-VolumesActionsTest-633054478 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0578cadb-89f0-40b0-92f9-d3f217deaf99 tempest-VolumesActionsTest-633054478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0578cadb-89f0-40b0-92f9-d3f217deaf99 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ad1dfe4-cfb2-4f9e-b4c2-c360b42d74fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be95a8d4-6a01-4e5b-9c96-891079f27554', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0578cadb-89f0-40b0-92f9-d3f217deaf99 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (479810bc-6fcc-4180-8e39-28f5cd53e09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:18 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-0578cadb-89f0-40b0-92f9-d3f217deaf99 tempest-VolumesActionsTest-633054478 None] Volume volume-be95a8d4-6a01-4e5b-9c96-891079f27554 (be95a8d4-6a01-4e5b-9c96-891079f27554): created successfully Sep 28 17:28:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0578cadb-89f0-40b0-92f9-d3f217deaf99 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (479810bc-6fcc-4180-8e39-28f5cd53e09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0578cadb-89f0-40b0-92f9-d3f217deaf99 tempest-VolumesActionsTest-633054478 None] Flow 'volume_create_manager' (d82a4ea8-eb26-466b-af60-011e2a6eb9f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:18 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-0578cadb-89f0-40b0-92f9-d3f217deaf99 tempest-VolumesActionsTest-633054478 None] Created volume successfully. Sep 28 17:28:18 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ae2f9aef-0f20-4ae9-bcc7-55f10341a688 tempest-VolumesActionsTest-1672563516 None] Acquiring lock "cinder-be95a8d4-6a01-4e5b-9c96-891079f27554-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:18 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ae2f9aef-0f20-4ae9-bcc7-55f10341a688 tempest-VolumesActionsTest-1672563516 None] Lock "cinder-be95a8d4-6a01-4e5b-9c96-891079f27554-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:18 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ae2f9aef-0f20-4ae9-bcc7-55f10341a688 tempest-VolumesActionsTest-1672563516 None] Acquiring lock "cinder-quobyte-be95a8d4-6a01-4e5b-9c96-891079f27554" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:18 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ae2f9aef-0f20-4ae9-bcc7-55f10341a688 tempest-VolumesActionsTest-1672563516 None] Lock "cinder-quobyte-be95a8d4-6a01-4e5b-9c96-891079f27554" acquired by "delete_volume" :: waited 0.013s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:18 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[be43b53a-5449-4754-ad74-12b674f6f069]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ae2f9aef-0f20-4ae9-bcc7-55f10341a688 tempest-VolumesActionsTest-1672563516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-be95a8d4-6a01-4e5b-9c96-891079f27554 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:18 devstack sudo[104317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-be95a8d4-6a01-4e5b-9c96-891079f27554 Sep 28 17:28:18 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:19 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ae2f9aef-0f20-4ae9-bcc7-55f10341a688 tempest-VolumesActionsTest-1672563516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-be95a8d4-6a01-4e5b-9c96-891079f27554" returned: 0 in 0.414s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ae2f9aef-0f20-4ae9-bcc7-55f10341a688 tempest-VolumesActionsTest-1672563516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-be95a8d4-6a01-4e5b-9c96-891079f27554 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:19 devstack sudo[104325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-be95a8d4-6a01-4e5b-9c96-891079f27554 Sep 28 17:28:19 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:19 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ae2f9aef-0f20-4ae9-bcc7-55f10341a688 tempest-VolumesActionsTest-1672563516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-be95a8d4-6a01-4e5b-9c96-891079f27554" returned: 0 in 0.244s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:19 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ae2f9aef-0f20-4ae9-bcc7-55f10341a688 tempest-VolumesActionsTest-1672563516 None] Lock "cinder-quobyte-be95a8d4-6a01-4e5b-9c96-891079f27554" released by "delete_volume" :: held 0.695s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:19 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-ae2f9aef-0f20-4ae9-bcc7-55f10341a688 tempest-VolumesActionsTest-1672563516 None] Created reservations ['7869dd68-4977-4bcb-b417-af8c987bead2', '12aab9f2-c1a0-450d-8aab-030e27e01b6c', 'fbd07956-be4f-4156-9e4a-c9f095929d20', '02a12012-3bb3-4ec1-a9ad-ed6a8a1f4c16'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ae2f9aef-0f20-4ae9-bcc7-55f10341a688 tempest-VolumesActionsTest-1672563516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ae2f9aef-0f20-4ae9-bcc7-55f10341a688 tempest-VolumesActionsTest-1672563516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ae2f9aef-0f20-4ae9-bcc7-55f10341a688 tempest-VolumesActionsTest-1672563516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ae2f9aef-0f20-4ae9-bcc7-55f10341a688 tempest-VolumesActionsTest-1672563516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ae2f9aef-0f20-4ae9-bcc7-55f10341a688 tempest-VolumesActionsTest-1672563516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ae2f9aef-0f20-4ae9-bcc7-55f10341a688 tempest-VolumesActionsTest-1672563516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:19 devstack sudo[104328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:28:19 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:19 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ae2f9aef-0f20-4ae9-bcc7-55f10341a688 tempest-VolumesActionsTest-1672563516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.247s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:19 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-ae2f9aef-0f20-4ae9-bcc7-55f10341a688 tempest-VolumesActionsTest-1672563516 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:19 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-ae2f9aef-0f20-4ae9-bcc7-55f10341a688 tempest-VolumesActionsTest-1672563516 None] Deleted volume successfully. Sep 28 17:28:19 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ae2f9aef-0f20-4ae9-bcc7-55f10341a688 tempest-VolumesActionsTest-1672563516 None] Lock "cinder-be95a8d4-6a01-4e5b-9c96-891079f27554-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:20 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff88ba8e-921b-4547-b89a-2a470f6fb905 tempest-VolumesActionsTest-633054478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff88ba8e-921b-4547-b89a-2a470f6fb905 tempest-VolumesActionsTest-633054478 None] Flow 'volume_create_manager' (8b8be018-ac2a-413e-9fd3-a269037df0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff88ba8e-921b-4547-b89a-2a470f6fb905 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da4ccfc-2a74-4dc8-807e-78a4e4cd2a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff88ba8e-921b-4547-b89a-2a470f6fb905 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da4ccfc-2a74-4dc8-807e-78a4e4cd2a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1197215954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8681f019-a8a4-4b6a-bb2a-97ad6c2fa4a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c832212458cd45eaafabd5bbb69638b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:20Z,use_quota=True,user_id='8a4272d1db3d4cdfa5036c4284157672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff88ba8e-921b-4547-b89a-2a470f6fb905 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ca2aeb5-b5b1-43dc-a6f4-83e9253a23ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff88ba8e-921b-4547-b89a-2a470f6fb905 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ca2aeb5-b5b1-43dc-a6f4-83e9253a23ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff88ba8e-921b-4547-b89a-2a470f6fb905 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f97d49f0-fd41-4fa3-9cc2-bb11188000d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff88ba8e-921b-4547-b89a-2a470f6fb905 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f97d49f0-fd41-4fa3-9cc2-bb11188000d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8681f019-a8a4-4b6a-bb2a-97ad6c2fa4a7', 'volume_name': 'volume-8681f019-a8a4-4b6a-bb2a-97ad6c2fa4a7', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff88ba8e-921b-4547-b89a-2a470f6fb905 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae4a6d88-c4a7-4bfb-8f7e-2debad7f162d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff88ba8e-921b-4547-b89a-2a470f6fb905 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae4a6d88-c4a7-4bfb-8f7e-2debad7f162d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff88ba8e-921b-4547-b89a-2a470f6fb905 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01071aaa-7aad-4699-b468-9f29b6b4dcae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:20 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-ff88ba8e-921b-4547-b89a-2a470f6fb905 tempest-VolumesActionsTest-633054478 None] Volume 8681f019-a8a4-4b6a-bb2a-97ad6c2fa4a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8681f019-a8a4-4b6a-bb2a-97ad6c2fa4a7', 'volume_size': 1} Sep 28 17:28:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ff88ba8e-921b-4547-b89a-2a470f6fb905 tempest-VolumesActionsTest-633054478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ff88ba8e-921b-4547-b89a-2a470f6fb905 tempest-VolumesActionsTest-633054478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ff88ba8e-921b-4547-b89a-2a470f6fb905 tempest-VolumesActionsTest-633054478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1197215954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8681f019-a8a4-4b6a-bb2a-97ad6c2fa4a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c832212458cd45eaafabd5bbb69638b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:20Z,use_quota=True,user_id='8a4272d1db3d4cdfa5036c4284157672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-ff88ba8e-921b-4547-b89a-2a470f6fb905 tempest-VolumesActionsTest-633054478 None] Creating volume 8681f019-a8a4-4b6a-bb2a-97ad6c2fa4a7 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ff88ba8e-921b-4547-b89a-2a470f6fb905 tempest-VolumesActionsTest-633054478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ff88ba8e-921b-4547-b89a-2a470f6fb905 tempest-VolumesActionsTest-633054478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ff88ba8e-921b-4547-b89a-2a470f6fb905 tempest-VolumesActionsTest-633054478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ff88ba8e-921b-4547-b89a-2a470f6fb905 tempest-VolumesActionsTest-633054478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ff88ba8e-921b-4547-b89a-2a470f6fb905 tempest-VolumesActionsTest-633054478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ff88ba8e-921b-4547-b89a-2a470f6fb905 tempest-VolumesActionsTest-633054478 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:20 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-ff88ba8e-921b-4547-b89a-2a470f6fb905 tempest-VolumesActionsTest-633054478 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:28:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ff88ba8e-921b-4547-b89a-2a470f6fb905 tempest-VolumesActionsTest-633054478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8681f019-a8a4-4b6a-bb2a-97ad6c2fa4a7 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:20 devstack sudo[104331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8681f019-a8a4-4b6a-bb2a-97ad6c2fa4a7 1073741824 Sep 28 17:28:20 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:20 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ff88ba8e-921b-4547-b89a-2a470f6fb905 tempest-VolumesActionsTest-633054478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8681f019-a8a4-4b6a-bb2a-97ad6c2fa4a7 1073741824" returned: 0 in 0.385s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ff88ba8e-921b-4547-b89a-2a470f6fb905 tempest-VolumesActionsTest-633054478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8681f019-a8a4-4b6a-bb2a-97ad6c2fa4a7 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:20 devstack sudo[104336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8681f019-a8a4-4b6a-bb2a-97ad6c2fa4a7 Sep 28 17:28:20 devstack sudo[104336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:21 devstack sudo[104336]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ff88ba8e-921b-4547-b89a-2a470f6fb905 tempest-VolumesActionsTest-633054478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8681f019-a8a4-4b6a-bb2a-97ad6c2fa4a7" returned: 0 in 0.234s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:21 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ff88ba8e-921b-4547-b89a-2a470f6fb905 tempest-VolumesActionsTest-633054478 None] <== create_volume: return (661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ff88ba8e-921b-4547-b89a-2a470f6fb905 tempest-VolumesActionsTest-633054478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.664s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff88ba8e-921b-4547-b89a-2a470f6fb905 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01071aaa-7aad-4699-b468-9f29b6b4dcae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8681f019-a8a4-4b6a-bb2a-97ad6c2fa4a7', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff88ba8e-921b-4547-b89a-2a470f6fb905 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af8321c6-06b8-4906-8877-bedb20524434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:21 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-ff88ba8e-921b-4547-b89a-2a470f6fb905 tempest-VolumesActionsTest-633054478 None] Volume volume-8681f019-a8a4-4b6a-bb2a-97ad6c2fa4a7 (8681f019-a8a4-4b6a-bb2a-97ad6c2fa4a7): created successfully Sep 28 17:28:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff88ba8e-921b-4547-b89a-2a470f6fb905 tempest-VolumesActionsTest-633054478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af8321c6-06b8-4906-8877-bedb20524434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff88ba8e-921b-4547-b89a-2a470f6fb905 tempest-VolumesActionsTest-633054478 None] Flow 'volume_create_manager' (8b8be018-ac2a-413e-9fd3-a269037df0eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:21 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-ff88ba8e-921b-4547-b89a-2a470f6fb905 tempest-VolumesActionsTest-633054478 None] Created volume successfully. Sep 28 17:28:21 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-54d2bc9f-4d1e-474b-8289-30914a012d1b tempest-VolumesActionsTest-633054478 None] Acquiring lock "cinder-8681f019-a8a4-4b6a-bb2a-97ad6c2fa4a7-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:21 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-54d2bc9f-4d1e-474b-8289-30914a012d1b tempest-VolumesActionsTest-633054478 None] Lock "cinder-8681f019-a8a4-4b6a-bb2a-97ad6c2fa4a7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:21 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-54d2bc9f-4d1e-474b-8289-30914a012d1b tempest-VolumesActionsTest-633054478 None] Acquiring lock "cinder-quobyte-8681f019-a8a4-4b6a-bb2a-97ad6c2fa4a7" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:21 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-54d2bc9f-4d1e-474b-8289-30914a012d1b tempest-VolumesActionsTest-633054478 None] Lock "cinder-quobyte-8681f019-a8a4-4b6a-bb2a-97ad6c2fa4a7" acquired by "delete_volume" :: waited 0.013s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:21 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c576ab-8ed8-4f7a-b01a-87f916ca077c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-54d2bc9f-4d1e-474b-8289-30914a012d1b tempest-VolumesActionsTest-633054478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8681f019-a8a4-4b6a-bb2a-97ad6c2fa4a7 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:22 devstack sudo[104340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8681f019-a8a4-4b6a-bb2a-97ad6c2fa4a7 Sep 28 17:28:22 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:22 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-54d2bc9f-4d1e-474b-8289-30914a012d1b tempest-VolumesActionsTest-633054478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8681f019-a8a4-4b6a-bb2a-97ad6c2fa4a7" returned: 0 in 0.344s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-54d2bc9f-4d1e-474b-8289-30914a012d1b tempest-VolumesActionsTest-633054478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8681f019-a8a4-4b6a-bb2a-97ad6c2fa4a7 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:22 devstack sudo[104345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8681f019-a8a4-4b6a-bb2a-97ad6c2fa4a7 Sep 28 17:28:22 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:22 devstack sudo[104345]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-54d2bc9f-4d1e-474b-8289-30914a012d1b tempest-VolumesActionsTest-633054478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8681f019-a8a4-4b6a-bb2a-97ad6c2fa4a7" returned: 0 in 0.262s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:22 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-54d2bc9f-4d1e-474b-8289-30914a012d1b tempest-VolumesActionsTest-633054478 None] Lock "cinder-quobyte-8681f019-a8a4-4b6a-bb2a-97ad6c2fa4a7" released by "delete_volume" :: held 0.642s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:22 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-54d2bc9f-4d1e-474b-8289-30914a012d1b tempest-VolumesActionsTest-633054478 None] Created reservations ['a3ed8160-c7a2-4b76-a890-621d9264d1ab', '8e6c1d3f-b1e6-4ecb-a071-d8c19ccabc43', '78c52594-3ec5-4ab5-a112-764c717db584', '212b0a2a-ff41-46dc-8a6a-ef306e5e3a55'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-54d2bc9f-4d1e-474b-8289-30914a012d1b tempest-VolumesActionsTest-633054478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-54d2bc9f-4d1e-474b-8289-30914a012d1b tempest-VolumesActionsTest-633054478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:22 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-54d2bc9f-4d1e-474b-8289-30914a012d1b tempest-VolumesActionsTest-633054478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:22 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-54d2bc9f-4d1e-474b-8289-30914a012d1b tempest-VolumesActionsTest-633054478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-54d2bc9f-4d1e-474b-8289-30914a012d1b tempest-VolumesActionsTest-633054478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-54d2bc9f-4d1e-474b-8289-30914a012d1b tempest-VolumesActionsTest-633054478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:22 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:28:22 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:22 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-54d2bc9f-4d1e-474b-8289-30914a012d1b tempest-VolumesActionsTest-633054478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.259s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:22 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-54d2bc9f-4d1e-474b-8289-30914a012d1b tempest-VolumesActionsTest-633054478 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:22 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-54d2bc9f-4d1e-474b-8289-30914a012d1b tempest-VolumesActionsTest-633054478 None] Deleted volume successfully. Sep 28 17:28:23 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-54d2bc9f-4d1e-474b-8289-30914a012d1b tempest-VolumesActionsTest-633054478 None] Lock "cinder-8681f019-a8a4-4b6a-bb2a-97ad6c2fa4a7-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:32 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:UPDATE=78,cinder:SELECT=46,cinder:DELETE=4,cinder:INSERT=10 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:28:32 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=54,cinder:INSERT=22,cinder:UPDATE=62,cinder:DELETE=8 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:28:35 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-93e601f9-e629-42b2-a052-9a577457d1a5 tempest-VolumesCloneNegativeTest-928632027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:35 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-93e601f9-e629-42b2-a052-9a577457d1a5 tempest-VolumesCloneNegativeTest-928632027 None] Flow 'volume_create_manager' (443d789f-becc-472f-aa8c-fc0641b2ae33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:35 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-93e601f9-e629-42b2-a052-9a577457d1a5 tempest-VolumesCloneNegativeTest-928632027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec95fc0e-ea2e-4ac6-8e71-eb3539a75224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:35 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-93e601f9-e629-42b2-a052-9a577457d1a5 tempest-VolumesCloneNegativeTest-928632027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec95fc0e-ea2e-4ac6-8e71-eb3539a75224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-843165131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ec17484-8e2e-4b07-987c-6bae62d67194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a72192c5bc94876a7541974d59e9ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:35Z,use_quota=True,user_id='1aa369ce44fb44408acd57b41c872ed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:35 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-93e601f9-e629-42b2-a052-9a577457d1a5 tempest-VolumesCloneNegativeTest-928632027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d66bb56f-6df9-414d-a8fe-4ca693cefb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:35 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-93e601f9-e629-42b2-a052-9a577457d1a5 tempest-VolumesCloneNegativeTest-928632027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d66bb56f-6df9-414d-a8fe-4ca693cefb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:35 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-93e601f9-e629-42b2-a052-9a577457d1a5 tempest-VolumesCloneNegativeTest-928632027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba7bf20f-c87d-4eb9-9b59-5f06cfcdaff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:35 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-93e601f9-e629-42b2-a052-9a577457d1a5 tempest-VolumesCloneNegativeTest-928632027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba7bf20f-c87d-4eb9-9b59-5f06cfcdaff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ec17484-8e2e-4b07-987c-6bae62d67194', 'volume_name': 'volume-2ec17484-8e2e-4b07-987c-6bae62d67194', 'volume_size': 2}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:35 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-93e601f9-e629-42b2-a052-9a577457d1a5 tempest-VolumesCloneNegativeTest-928632027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425cf3d9-0117-478a-a8b6-fc6c4328ceff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:35 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-93e601f9-e629-42b2-a052-9a577457d1a5 tempest-VolumesCloneNegativeTest-928632027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425cf3d9-0117-478a-a8b6-fc6c4328ceff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:35 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-93e601f9-e629-42b2-a052-9a577457d1a5 tempest-VolumesCloneNegativeTest-928632027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d326f7e7-b739-4485-ae46-d853cc415083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:35 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-93e601f9-e629-42b2-a052-9a577457d1a5 tempest-VolumesCloneNegativeTest-928632027 None] Volume 2ec17484-8e2e-4b07-987c-6bae62d67194: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ec17484-8e2e-4b07-987c-6bae62d67194', 'volume_size': 2} Sep 28 17:28:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-93e601f9-e629-42b2-a052-9a577457d1a5 tempest-VolumesCloneNegativeTest-928632027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-93e601f9-e629-42b2-a052-9a577457d1a5 tempest-VolumesCloneNegativeTest-928632027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:35 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-93e601f9-e629-42b2-a052-9a577457d1a5 tempest-VolumesCloneNegativeTest-928632027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-843165131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ec17484-8e2e-4b07-987c-6bae62d67194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a72192c5bc94876a7541974d59e9ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:35Z,use_quota=True,user_id='1aa369ce44fb44408acd57b41c872ed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:35 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-93e601f9-e629-42b2-a052-9a577457d1a5 tempest-VolumesCloneNegativeTest-928632027 None] Creating volume 2ec17484-8e2e-4b07-987c-6bae62d67194 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-93e601f9-e629-42b2-a052-9a577457d1a5 tempest-VolumesCloneNegativeTest-928632027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-93e601f9-e629-42b2-a052-9a577457d1a5 tempest-VolumesCloneNegativeTest-928632027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:35 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-93e601f9-e629-42b2-a052-9a577457d1a5 tempest-VolumesCloneNegativeTest-928632027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:35 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-93e601f9-e629-42b2-a052-9a577457d1a5 tempest-VolumesCloneNegativeTest-928632027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-93e601f9-e629-42b2-a052-9a577457d1a5 tempest-VolumesCloneNegativeTest-928632027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:35 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-93e601f9-e629-42b2-a052-9a577457d1a5 tempest-VolumesCloneNegativeTest-928632027 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:35 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-93e601f9-e629-42b2-a052-9a577457d1a5 tempest-VolumesCloneNegativeTest-928632027 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:28:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-93e601f9-e629-42b2-a052-9a577457d1a5 tempest-VolumesCloneNegativeTest-928632027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2ec17484-8e2e-4b07-987c-6bae62d67194 2147483648 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:35 devstack sudo[104395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2ec17484-8e2e-4b07-987c-6bae62d67194 2147483648 Sep 28 17:28:35 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:35 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-93e601f9-e629-42b2-a052-9a577457d1a5 tempest-VolumesCloneNegativeTest-928632027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2ec17484-8e2e-4b07-987c-6bae62d67194 2147483648" returned: 0 in 0.449s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-93e601f9-e629-42b2-a052-9a577457d1a5 tempest-VolumesCloneNegativeTest-928632027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2ec17484-8e2e-4b07-987c-6bae62d67194 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:35 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2ec17484-8e2e-4b07-987c-6bae62d67194 Sep 28 17:28:35 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:36 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-93e601f9-e629-42b2-a052-9a577457d1a5 tempest-VolumesCloneNegativeTest-928632027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2ec17484-8e2e-4b07-987c-6bae62d67194" returned: 0 in 0.233s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:36 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-93e601f9-e629-42b2-a052-9a577457d1a5 tempest-VolumesCloneNegativeTest-928632027 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-93e601f9-e629-42b2-a052-9a577457d1a5 tempest-VolumesCloneNegativeTest-928632027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-93e601f9-e629-42b2-a052-9a577457d1a5 tempest-VolumesCloneNegativeTest-928632027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d326f7e7-b739-4485-ae46-d853cc415083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ec17484-8e2e-4b07-987c-6bae62d67194', 'volume_size': 2}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-93e601f9-e629-42b2-a052-9a577457d1a5 tempest-VolumesCloneNegativeTest-928632027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee89cad2-8569-48b4-8854-01bfd6339c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:36 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-93e601f9-e629-42b2-a052-9a577457d1a5 tempest-VolumesCloneNegativeTest-928632027 None] Volume volume-2ec17484-8e2e-4b07-987c-6bae62d67194 (2ec17484-8e2e-4b07-987c-6bae62d67194): created successfully Sep 28 17:28:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-93e601f9-e629-42b2-a052-9a577457d1a5 tempest-VolumesCloneNegativeTest-928632027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee89cad2-8569-48b4-8854-01bfd6339c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:36 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-93e601f9-e629-42b2-a052-9a577457d1a5 tempest-VolumesCloneNegativeTest-928632027 None] Flow 'volume_create_manager' (443d789f-becc-472f-aa8c-fc0641b2ae33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:36 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-93e601f9-e629-42b2-a052-9a577457d1a5 tempest-VolumesCloneNegativeTest-928632027 None] Created volume successfully. Sep 28 17:28:36 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8ddf5613-c272-4ceb-aefe-5b876dc77c63 tempest-VolumesCloneNegativeTest-928632027 None] Acquiring lock "cinder-2ec17484-8e2e-4b07-987c-6bae62d67194-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:36 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8ddf5613-c272-4ceb-aefe-5b876dc77c63 tempest-VolumesCloneNegativeTest-928632027 None] Lock "cinder-2ec17484-8e2e-4b07-987c-6bae62d67194-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:36 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8ddf5613-c272-4ceb-aefe-5b876dc77c63 tempest-VolumesCloneNegativeTest-928632027 None] Acquiring lock "cinder-quobyte-2ec17484-8e2e-4b07-987c-6bae62d67194" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:36 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8ddf5613-c272-4ceb-aefe-5b876dc77c63 tempest-VolumesCloneNegativeTest-928632027 None] Lock "cinder-quobyte-2ec17484-8e2e-4b07-987c-6bae62d67194" acquired by "delete_volume" :: waited 0.013s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:36 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c57326-0700-49f4-aab6-f7aaa965ace2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8ddf5613-c272-4ceb-aefe-5b876dc77c63 tempest-VolumesCloneNegativeTest-928632027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2ec17484-8e2e-4b07-987c-6bae62d67194 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:36 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2ec17484-8e2e-4b07-987c-6bae62d67194 Sep 28 17:28:36 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:36 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8ddf5613-c272-4ceb-aefe-5b876dc77c63 tempest-VolumesCloneNegativeTest-928632027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2ec17484-8e2e-4b07-987c-6bae62d67194" returned: 0 in 0.342s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8ddf5613-c272-4ceb-aefe-5b876dc77c63 tempest-VolumesCloneNegativeTest-928632027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2ec17484-8e2e-4b07-987c-6bae62d67194 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:36 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2ec17484-8e2e-4b07-987c-6bae62d67194 Sep 28 17:28:36 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:37 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8ddf5613-c272-4ceb-aefe-5b876dc77c63 tempest-VolumesCloneNegativeTest-928632027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-2ec17484-8e2e-4b07-987c-6bae62d67194" returned: 0 in 0.241s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:37 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8ddf5613-c272-4ceb-aefe-5b876dc77c63 tempest-VolumesCloneNegativeTest-928632027 None] Lock "cinder-quobyte-2ec17484-8e2e-4b07-987c-6bae62d67194" released by "delete_volume" :: held 0.629s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:37 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-8ddf5613-c272-4ceb-aefe-5b876dc77c63 tempest-VolumesCloneNegativeTest-928632027 None] Created reservations ['40e56061-4272-41d0-ba4d-0bc8abe8c5ca', '597a4a42-3b74-430c-9877-348f6766d478', '0784c56a-143e-4272-a572-dac250b88fbe', 'b939ce71-2997-44b4-bff3-7c63f75791eb'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8ddf5613-c272-4ceb-aefe-5b876dc77c63 tempest-VolumesCloneNegativeTest-928632027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8ddf5613-c272-4ceb-aefe-5b876dc77c63 tempest-VolumesCloneNegativeTest-928632027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:37 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-8ddf5613-c272-4ceb-aefe-5b876dc77c63 tempest-VolumesCloneNegativeTest-928632027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:37 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-8ddf5613-c272-4ceb-aefe-5b876dc77c63 tempest-VolumesCloneNegativeTest-928632027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8ddf5613-c272-4ceb-aefe-5b876dc77c63 tempest-VolumesCloneNegativeTest-928632027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8ddf5613-c272-4ceb-aefe-5b876dc77c63 tempest-VolumesCloneNegativeTest-928632027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:37 devstack sudo[104411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:28:37 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:37 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8ddf5613-c272-4ceb-aefe-5b876dc77c63 tempest-VolumesCloneNegativeTest-928632027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.245s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:37 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-8ddf5613-c272-4ceb-aefe-5b876dc77c63 tempest-VolumesCloneNegativeTest-928632027 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:37 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-8ddf5613-c272-4ceb-aefe-5b876dc77c63 tempest-VolumesCloneNegativeTest-928632027 None] Deleted volume successfully. Sep 28 17:28:37 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8ddf5613-c272-4ceb-aefe-5b876dc77c63 tempest-VolumesCloneNegativeTest-928632027 None] Lock "cinder-2ec17484-8e2e-4b07-987c-6bae62d67194-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:40 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad81f2a4-1fad-4e5d-9924-4e4a1d621fb5 tempest-VolumesSnapshotListTestJSON-13474684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ad81f2a4-1fad-4e5d-9924-4e4a1d621fb5 tempest-VolumesSnapshotListTestJSON-13474684 None] Flow 'volume_create_manager' (045341ee-0e6e-4eb6-a845-bb3e1cb894a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ad81f2a4-1fad-4e5d-9924-4e4a1d621fb5 tempest-VolumesSnapshotListTestJSON-13474684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a6e0d22-fc1b-483b-9e00-9411335cbab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ad81f2a4-1fad-4e5d-9924-4e4a1d621fb5 tempest-VolumesSnapshotListTestJSON-13474684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a6e0d22-fc1b-483b-9e00-9411335cbab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-267781213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c240c350-5e88-47af-bd25-1a3a5e889bcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c88c2e2487184a25a5ee669392baaa7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:41Z,use_quota=True,user_id='70c934a5679e483c914957f5a07a2bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ad81f2a4-1fad-4e5d-9924-4e4a1d621fb5 tempest-VolumesSnapshotListTestJSON-13474684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16cc909c-c00d-41bf-aed1-018c33a591ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ad81f2a4-1fad-4e5d-9924-4e4a1d621fb5 tempest-VolumesSnapshotListTestJSON-13474684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16cc909c-c00d-41bf-aed1-018c33a591ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ad81f2a4-1fad-4e5d-9924-4e4a1d621fb5 tempest-VolumesSnapshotListTestJSON-13474684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65980fd9-40e1-4595-9b99-0fdf2720c803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ad81f2a4-1fad-4e5d-9924-4e4a1d621fb5 tempest-VolumesSnapshotListTestJSON-13474684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65980fd9-40e1-4595-9b99-0fdf2720c803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c240c350-5e88-47af-bd25-1a3a5e889bcb', 'volume_name': 'volume-c240c350-5e88-47af-bd25-1a3a5e889bcb', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ad81f2a4-1fad-4e5d-9924-4e4a1d621fb5 tempest-VolumesSnapshotListTestJSON-13474684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ec832dd-b70b-49af-bff9-52c5301691b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ad81f2a4-1fad-4e5d-9924-4e4a1d621fb5 tempest-VolumesSnapshotListTestJSON-13474684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ec832dd-b70b-49af-bff9-52c5301691b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ad81f2a4-1fad-4e5d-9924-4e4a1d621fb5 tempest-VolumesSnapshotListTestJSON-13474684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a18fd62-3d96-4ba7-8caa-093fa85df5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:40 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-ad81f2a4-1fad-4e5d-9924-4e4a1d621fb5 tempest-VolumesSnapshotListTestJSON-13474684 None] Volume c240c350-5e88-47af-bd25-1a3a5e889bcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c240c350-5e88-47af-bd25-1a3a5e889bcb', 'volume_size': 1} Sep 28 17:28:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ad81f2a4-1fad-4e5d-9924-4e4a1d621fb5 tempest-VolumesSnapshotListTestJSON-13474684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ad81f2a4-1fad-4e5d-9924-4e4a1d621fb5 tempest-VolumesSnapshotListTestJSON-13474684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:40 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ad81f2a4-1fad-4e5d-9924-4e4a1d621fb5 tempest-VolumesSnapshotListTestJSON-13474684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-267781213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c240c350-5e88-47af-bd25-1a3a5e889bcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c88c2e2487184a25a5ee669392baaa7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:41Z,use_quota=True,user_id='70c934a5679e483c914957f5a07a2bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:40 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-ad81f2a4-1fad-4e5d-9924-4e4a1d621fb5 tempest-VolumesSnapshotListTestJSON-13474684 None] Creating volume c240c350-5e88-47af-bd25-1a3a5e889bcb {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ad81f2a4-1fad-4e5d-9924-4e4a1d621fb5 tempest-VolumesSnapshotListTestJSON-13474684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ad81f2a4-1fad-4e5d-9924-4e4a1d621fb5 tempest-VolumesSnapshotListTestJSON-13474684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:40 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ad81f2a4-1fad-4e5d-9924-4e4a1d621fb5 tempest-VolumesSnapshotListTestJSON-13474684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:40 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ad81f2a4-1fad-4e5d-9924-4e4a1d621fb5 tempest-VolumesSnapshotListTestJSON-13474684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ad81f2a4-1fad-4e5d-9924-4e4a1d621fb5 tempest-VolumesSnapshotListTestJSON-13474684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:40 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ad81f2a4-1fad-4e5d-9924-4e4a1d621fb5 tempest-VolumesSnapshotListTestJSON-13474684 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:40 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-ad81f2a4-1fad-4e5d-9924-4e4a1d621fb5 tempest-VolumesSnapshotListTestJSON-13474684 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:28:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ad81f2a4-1fad-4e5d-9924-4e4a1d621fb5 tempest-VolumesSnapshotListTestJSON-13474684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:40 devstack sudo[104414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb 1073741824 Sep 28 17:28:40 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:41 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ad81f2a4-1fad-4e5d-9924-4e4a1d621fb5 tempest-VolumesSnapshotListTestJSON-13474684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb 1073741824" returned: 0 in 0.416s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ad81f2a4-1fad-4e5d-9924-4e4a1d621fb5 tempest-VolumesSnapshotListTestJSON-13474684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:41 devstack sudo[104420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb Sep 28 17:28:41 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:41 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ad81f2a4-1fad-4e5d-9924-4e4a1d621fb5 tempest-VolumesSnapshotListTestJSON-13474684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb" returned: 0 in 0.246s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:41 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ad81f2a4-1fad-4e5d-9924-4e4a1d621fb5 tempest-VolumesSnapshotListTestJSON-13474684 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ad81f2a4-1fad-4e5d-9924-4e4a1d621fb5 tempest-VolumesSnapshotListTestJSON-13474684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:41 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ad81f2a4-1fad-4e5d-9924-4e4a1d621fb5 tempest-VolumesSnapshotListTestJSON-13474684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a18fd62-3d96-4ba7-8caa-093fa85df5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c240c350-5e88-47af-bd25-1a3a5e889bcb', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:41 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ad81f2a4-1fad-4e5d-9924-4e4a1d621fb5 tempest-VolumesSnapshotListTestJSON-13474684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c4a595-b934-4b6f-b6c1-f51be678f872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:41 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-ad81f2a4-1fad-4e5d-9924-4e4a1d621fb5 tempest-VolumesSnapshotListTestJSON-13474684 None] Volume volume-c240c350-5e88-47af-bd25-1a3a5e889bcb (c240c350-5e88-47af-bd25-1a3a5e889bcb): created successfully Sep 28 17:28:41 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ad81f2a4-1fad-4e5d-9924-4e4a1d621fb5 tempest-VolumesSnapshotListTestJSON-13474684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c4a595-b934-4b6f-b6c1-f51be678f872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:41 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ad81f2a4-1fad-4e5d-9924-4e4a1d621fb5 tempest-VolumesSnapshotListTestJSON-13474684 None] Flow 'volume_create_manager' (045341ee-0e6e-4eb6-a845-bb3e1cb894a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:41 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-ad81f2a4-1fad-4e5d-9924-4e4a1d621fb5 tempest-VolumesSnapshotListTestJSON-13474684 None] Created volume successfully. Sep 28 17:28:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9e79b765-6d98-4e07-ae4d-7d7b028543ba tempest-VolumesSnapshotListTestJSON-13474684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9e79b765-6d98-4e07-ae4d-7d7b028543ba tempest-VolumesSnapshotListTestJSON-13474684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:42 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-9e79b765-6d98-4e07-ae4d-7d7b028543ba tempest-VolumesSnapshotListTestJSON-13474684 None] Creating offline snapshot 9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e of volume c240c350-5e88-47af-bd25-1a3a5e889bcb {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:28:42 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[66127f91-3dea-424d-b7c7-a9002b2d99a7]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9e79b765-6d98-4e07-ae4d-7d7b028543ba tempest-VolumesSnapshotListTestJSON-13474684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:42 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb Sep 28 17:28:42 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:42 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9e79b765-6d98-4e07-ae4d-7d7b028543ba tempest-VolumesSnapshotListTestJSON-13474684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb" returned: 0 in 0.338s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9e79b765-6d98-4e07-ae4d-7d7b028543ba tempest-VolumesSnapshotListTestJSON-13474684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:42 devstack sudo[104428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e 1G Sep 28 17:28:42 devstack sudo[104428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:42 devstack sudo[104428]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9e79b765-6d98-4e07-ae4d-7d7b028543ba tempest-VolumesSnapshotListTestJSON-13474684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e 1G" returned: 0 in 0.385s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9e79b765-6d98-4e07-ae4d-7d7b028543ba tempest-VolumesSnapshotListTestJSON-13474684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c240c350-5e88-47af-bd25-1a3a5e889bcb -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:42 devstack sudo[104433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c240c350-5e88-47af-bd25-1a3a5e889bcb -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e Sep 28 17:28:42 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:43 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9e79b765-6d98-4e07-ae4d-7d7b028543ba tempest-VolumesSnapshotListTestJSON-13474684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c240c350-5e88-47af-bd25-1a3a5e889bcb -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e" returned: 0 in 0.276s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:43 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-9e79b765-6d98-4e07-ae4d-7d7b028543ba tempest-VolumesSnapshotListTestJSON-13474684 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e is being set with open permissions: ugo+rw Sep 28 17:28:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9e79b765-6d98-4e07-ae4d-7d7b028543ba tempest-VolumesSnapshotListTestJSON-13474684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:43 devstack sudo[104439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e Sep 28 17:28:43 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:43 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9e79b765-6d98-4e07-ae4d-7d7b028543ba tempest-VolumesSnapshotListTestJSON-13474684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e" returned: 0 in 0.232s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9e79b765-6d98-4e07-ae4d-7d7b028543ba tempest-VolumesSnapshotListTestJSON-13474684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:43 devstack sudo[104443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.info Sep 28 17:28:43 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:43 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9e79b765-6d98-4e07-ae4d-7d7b028543ba tempest-VolumesSnapshotListTestJSON-13474684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.info" returned: 0 in 0.259s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:43 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-9e79b765-6d98-4e07-ae4d-7d7b028543ba tempest-VolumesSnapshotListTestJSON-13474684 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.info is being set with open permissions: ugo+rw Sep 28 17:28:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9e79b765-6d98-4e07-ae4d-7d7b028543ba tempest-VolumesSnapshotListTestJSON-13474684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:43 devstack sudo[104446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.info Sep 28 17:28:43 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:43 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9e79b765-6d98-4e07-ae4d-7d7b028543ba tempest-VolumesSnapshotListTestJSON-13474684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.info" returned: 0 in 0.242s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9e79b765-6d98-4e07-ae4d-7d7b028543ba tempest-VolumesSnapshotListTestJSON-13474684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.825s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:43 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-9e79b765-6d98-4e07-ae4d-7d7b028543ba tempest-VolumesSnapshotListTestJSON-13474684 None] Create snapshot completed successfully Sep 28 17:28:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d4c501e6-8130-4c63-b081-c64d79771da6 tempest-VolumesSnapshotListTestJSON-13474684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d4c501e6-8130-4c63-b081-c64d79771da6 tempest-VolumesSnapshotListTestJSON-13474684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:44 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-d4c501e6-8130-4c63-b081-c64d79771da6 tempest-VolumesSnapshotListTestJSON-13474684 None] Creating offline snapshot d9bfcaeb-ba63-4093-aecc-35ebe0a4b824 of volume c240c350-5e88-47af-bd25-1a3a5e889bcb {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:28:44 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2e19d8-eb73-497f-a675-e72a5ab59403]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d4c501e6-8130-4c63-b081-c64d79771da6 tempest-VolumesSnapshotListTestJSON-13474684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:44 devstack sudo[104449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e Sep 28 17:28:44 devstack sudo[104449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:44 devstack sudo[104449]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d4c501e6-8130-4c63-b081-c64d79771da6 tempest-VolumesSnapshotListTestJSON-13474684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e" returned: 0 in 0.344s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:44 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-d4c501e6-8130-4c63-b081-c64d79771da6 tempest-VolumesSnapshotListTestJSON-13474684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c240c350-5e88-47af-bd25-1a3a5e889bcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:28:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d4c501e6-8130-4c63-b081-c64d79771da6 tempest-VolumesSnapshotListTestJSON-13474684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.d9bfcaeb-ba63-4093-aecc-35ebe0a4b824 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:44 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.d9bfcaeb-ba63-4093-aecc-35ebe0a4b824 1G Sep 28 17:28:44 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:45 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d4c501e6-8130-4c63-b081-c64d79771da6 tempest-VolumesSnapshotListTestJSON-13474684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.d9bfcaeb-ba63-4093-aecc-35ebe0a4b824 1G" returned: 0 in 0.405s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d4c501e6-8130-4c63-b081-c64d79771da6 tempest-VolumesSnapshotListTestJSON-13474684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.d9bfcaeb-ba63-4093-aecc-35ebe0a4b824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:45 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.d9bfcaeb-ba63-4093-aecc-35ebe0a4b824 Sep 28 17:28:45 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:45 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d4c501e6-8130-4c63-b081-c64d79771da6 tempest-VolumesSnapshotListTestJSON-13474684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.d9bfcaeb-ba63-4093-aecc-35ebe0a4b824" returned: 0 in 0.288s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:45 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-d4c501e6-8130-4c63-b081-c64d79771da6 tempest-VolumesSnapshotListTestJSON-13474684 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.d9bfcaeb-ba63-4093-aecc-35ebe0a4b824 is being set with open permissions: ugo+rw Sep 28 17:28:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d4c501e6-8130-4c63-b081-c64d79771da6 tempest-VolumesSnapshotListTestJSON-13474684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.d9bfcaeb-ba63-4093-aecc-35ebe0a4b824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:45 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.d9bfcaeb-ba63-4093-aecc-35ebe0a4b824 Sep 28 17:28:45 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:45 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d4c501e6-8130-4c63-b081-c64d79771da6 tempest-VolumesSnapshotListTestJSON-13474684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.d9bfcaeb-ba63-4093-aecc-35ebe0a4b824" returned: 0 in 0.225s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d4c501e6-8130-4c63-b081-c64d79771da6 tempest-VolumesSnapshotListTestJSON-13474684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.351s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:45 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-d4c501e6-8130-4c63-b081-c64d79771da6 tempest-VolumesSnapshotListTestJSON-13474684 None] Create snapshot completed successfully Sep 28 17:28:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7fbc66a9-facb-4fca-99e3-194d9238e205 tempest-VolumesSnapshotListTestJSON-13474684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7fbc66a9-facb-4fca-99e3-194d9238e205 tempest-VolumesSnapshotListTestJSON-13474684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:46 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-7fbc66a9-facb-4fca-99e3-194d9238e205 tempest-VolumesSnapshotListTestJSON-13474684 None] Creating offline snapshot 0eeb30bf-28ee-4d20-9db7-3592333ace35 of volume c240c350-5e88-47af-bd25-1a3a5e889bcb {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:28:46 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00abd40-eaf5-4298-84de-ad5c430d5647]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7fbc66a9-facb-4fca-99e3-194d9238e205 tempest-VolumesSnapshotListTestJSON-13474684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.d9bfcaeb-ba63-4093-aecc-35ebe0a4b824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:46 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.d9bfcaeb-ba63-4093-aecc-35ebe0a4b824 Sep 28 17:28:46 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:46 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7fbc66a9-facb-4fca-99e3-194d9238e205 tempest-VolumesSnapshotListTestJSON-13474684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.d9bfcaeb-ba63-4093-aecc-35ebe0a4b824" returned: 0 in 0.351s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:46 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-7fbc66a9-facb-4fca-99e3-194d9238e205 tempest-VolumesSnapshotListTestJSON-13474684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c240c350-5e88-47af-bd25-1a3a5e889bcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:28:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7fbc66a9-facb-4fca-99e3-194d9238e205 tempest-VolumesSnapshotListTestJSON-13474684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.d9bfcaeb-ba63-4093-aecc-35ebe0a4b824,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.0eeb30bf-28ee-4d20-9db7-3592333ace35 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:47 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.d9bfcaeb-ba63-4093-aecc-35ebe0a4b824,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.0eeb30bf-28ee-4d20-9db7-3592333ace35 1G Sep 28 17:28:47 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:47 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7fbc66a9-facb-4fca-99e3-194d9238e205 tempest-VolumesSnapshotListTestJSON-13474684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.d9bfcaeb-ba63-4093-aecc-35ebe0a4b824,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.0eeb30bf-28ee-4d20-9db7-3592333ace35 1G" returned: 0 in 0.453s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7fbc66a9-facb-4fca-99e3-194d9238e205 tempest-VolumesSnapshotListTestJSON-13474684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.d9bfcaeb-ba63-4093-aecc-35ebe0a4b824 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.0eeb30bf-28ee-4d20-9db7-3592333ace35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:47 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.d9bfcaeb-ba63-4093-aecc-35ebe0a4b824 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.0eeb30bf-28ee-4d20-9db7-3592333ace35 Sep 28 17:28:47 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:47 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7fbc66a9-facb-4fca-99e3-194d9238e205 tempest-VolumesSnapshotListTestJSON-13474684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.d9bfcaeb-ba63-4093-aecc-35ebe0a4b824 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.0eeb30bf-28ee-4d20-9db7-3592333ace35" returned: 0 in 0.294s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:47 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-7fbc66a9-facb-4fca-99e3-194d9238e205 tempest-VolumesSnapshotListTestJSON-13474684 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.0eeb30bf-28ee-4d20-9db7-3592333ace35 is being set with open permissions: ugo+rw Sep 28 17:28:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7fbc66a9-facb-4fca-99e3-194d9238e205 tempest-VolumesSnapshotListTestJSON-13474684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.0eeb30bf-28ee-4d20-9db7-3592333ace35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:47 devstack sudo[104486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.0eeb30bf-28ee-4d20-9db7-3592333ace35 Sep 28 17:28:47 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:47 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7fbc66a9-facb-4fca-99e3-194d9238e205 tempest-VolumesSnapshotListTestJSON-13474684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.0eeb30bf-28ee-4d20-9db7-3592333ace35" returned: 0 in 0.231s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7fbc66a9-facb-4fca-99e3-194d9238e205 tempest-VolumesSnapshotListTestJSON-13474684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.423s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:48 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-7fbc66a9-facb-4fca-99e3-194d9238e205 tempest-VolumesSnapshotListTestJSON-13474684 None] Create snapshot completed successfully Sep 28 17:28:49 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6a0c3774-dd64-494c-8347-95e0104220f1 tempest-VolumesSnapshotListTestJSON-13474684 None] Acquiring lock "cinder-0eeb30bf-28ee-4d20-9db7-3592333ace35-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:49 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6a0c3774-dd64-494c-8347-95e0104220f1 tempest-VolumesSnapshotListTestJSON-13474684 None] Lock "cinder-0eeb30bf-28ee-4d20-9db7-3592333ace35-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:49 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6a0c3774-dd64-494c-8347-95e0104220f1 tempest-VolumesSnapshotListTestJSON-13474684 None] Acquiring lock "cinder-quobyte-c240c350-5e88-47af-bd25-1a3a5e889bcb" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:49 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6a0c3774-dd64-494c-8347-95e0104220f1 tempest-VolumesSnapshotListTestJSON-13474684 None] Lock "cinder-quobyte-c240c350-5e88-47af-bd25-1a3a5e889bcb" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:49 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6a0c3774-dd64-494c-8347-95e0104220f1 tempest-VolumesSnapshotListTestJSON-13474684 None] Acquiring lock "cinder-quobyte-0eeb30bf-28ee-4d20-9db7-3592333ace35" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:28:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:49 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6a0c3774-dd64-494c-8347-95e0104220f1 tempest-VolumesSnapshotListTestJSON-13474684 None] Lock "cinder-quobyte-0eeb30bf-28ee-4d20-9db7-3592333ace35" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:49 devstack sudo[104489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:28:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-6a0c3774-dd64-494c-8347-95e0104220f1 tempest-VolumesSnapshotListTestJSON-13474684 None] Deleting offline snapshot 0eeb30bf-28ee-4d20-9db7-3592333ace35 of volume c240c350-5e88-47af-bd25-1a3a5e889bcb {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:28:49 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-6a0c3774-dd64-494c-8347-95e0104220f1 tempest-VolumesSnapshotListTestJSON-13474684 None] snapshot_file for this snap is: volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.0eeb30bf-28ee-4d20-9db7-3592333ace35 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:28:49 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9830fe8-c5be-43c0-8bb8-8f196ef9c4dc]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6a0c3774-dd64-494c-8347-95e0104220f1 tempest-VolumesSnapshotListTestJSON-13474684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.0eeb30bf-28ee-4d20-9db7-3592333ace35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:49 devstack sudo[104491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.0eeb30bf-28ee-4d20-9db7-3592333ace35 Sep 28 17:28:49 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:49 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.251s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:49 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager._thread_info {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:28:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread count: 28 {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:28:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread info: [<_MainThread(MainThread, started 132915553284224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:28:49 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6a0c3774-dd64-494c-8347-95e0104220f1 tempest-VolumesSnapshotListTestJSON-13474684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.0eeb30bf-28ee-4d20-9db7-3592333ace35" returned: 0 in 0.379s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-6a0c3774-dd64-494c-8347-95e0104220f1 tempest-VolumesSnapshotListTestJSON-13474684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c240c350-5e88-47af-bd25-1a3a5e889bcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:28:49 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f3eb31-34d6-434d-99b4-36e522fa5845]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6a0c3774-dd64-494c-8347-95e0104220f1 tempest-VolumesSnapshotListTestJSON-13474684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.d9bfcaeb-ba63-4093-aecc-35ebe0a4b824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:50 devstack sudo[104497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.d9bfcaeb-ba63-4093-aecc-35ebe0a4b824 Sep 28 17:28:50 devstack sudo[104497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:50 devstack sudo[104497]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6a0c3774-dd64-494c-8347-95e0104220f1 tempest-VolumesSnapshotListTestJSON-13474684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.d9bfcaeb-ba63-4093-aecc-35ebe0a4b824" returned: 0 in 0.361s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:50 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-6a0c3774-dd64-494c-8347-95e0104220f1 tempest-VolumesSnapshotListTestJSON-13474684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c240c350-5e88-47af-bd25-1a3a5e889bcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:28:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6a0c3774-dd64-494c-8347-95e0104220f1 tempest-VolumesSnapshotListTestJSON-13474684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.0eeb30bf-28ee-4d20-9db7-3592333ace35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:50 devstack sudo[104502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.0eeb30bf-28ee-4d20-9db7-3592333ace35 Sep 28 17:28:50 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:50 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6a0c3774-dd64-494c-8347-95e0104220f1 tempest-VolumesSnapshotListTestJSON-13474684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.0eeb30bf-28ee-4d20-9db7-3592333ace35" returned: 0 in 0.429s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6a0c3774-dd64-494c-8347-95e0104220f1 tempest-VolumesSnapshotListTestJSON-13474684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.0eeb30bf-28ee-4d20-9db7-3592333ace35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:50 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.0eeb30bf-28ee-4d20-9db7-3592333ace35 Sep 28 17:28:50 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:51 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6a0c3774-dd64-494c-8347-95e0104220f1 tempest-VolumesSnapshotListTestJSON-13474684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.0eeb30bf-28ee-4d20-9db7-3592333ace35" returned: 0 in 0.249s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:51 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6a0c3774-dd64-494c-8347-95e0104220f1 tempest-VolumesSnapshotListTestJSON-13474684 None] Lock "cinder-quobyte-0eeb30bf-28ee-4d20-9db7-3592333ace35" released by "_delete_snapshot" :: held 1.536s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:51 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6a0c3774-dd64-494c-8347-95e0104220f1 tempest-VolumesSnapshotListTestJSON-13474684 None] Lock "cinder-quobyte-c240c350-5e88-47af-bd25-1a3a5e889bcb" released by "delete_snapshot" :: held 1.579s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:51 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-6a0c3774-dd64-494c-8347-95e0104220f1 tempest-VolumesSnapshotListTestJSON-13474684 None] Created reservations ['b09a73c8-be59-40ac-a660-e9bbcaced6be', 'ba40b3e4-bea5-4929-b938-70ce1da65126', '580970c2-914c-43f7-ba73-8f6505b68cc3', 'a6f36a77-5baf-484a-bc01-de4ecac5c255'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:51 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-6a0c3774-dd64-494c-8347-95e0104220f1 tempest-VolumesSnapshotListTestJSON-13474684 None] Delete snapshot completed successfully. Sep 28 17:28:51 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6a0c3774-dd64-494c-8347-95e0104220f1 tempest-VolumesSnapshotListTestJSON-13474684 None] Lock "cinder-0eeb30bf-28ee-4d20-9db7-3592333ace35-delete_snapshot" released by "delete_snapshot" :: held 1.743s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:51 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8f791ad1-f270-4121-a642-69788b306ae1 tempest-VolumesSnapshotListTestJSON-13474684 None] Acquiring lock "cinder-d9bfcaeb-ba63-4093-aecc-35ebe0a4b824-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:51 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8f791ad1-f270-4121-a642-69788b306ae1 tempest-VolumesSnapshotListTestJSON-13474684 None] Lock "cinder-d9bfcaeb-ba63-4093-aecc-35ebe0a4b824-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:51 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8f791ad1-f270-4121-a642-69788b306ae1 tempest-VolumesSnapshotListTestJSON-13474684 None] Acquiring lock "cinder-quobyte-c240c350-5e88-47af-bd25-1a3a5e889bcb" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:51 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8f791ad1-f270-4121-a642-69788b306ae1 tempest-VolumesSnapshotListTestJSON-13474684 None] Lock "cinder-quobyte-c240c350-5e88-47af-bd25-1a3a5e889bcb" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:51 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8f791ad1-f270-4121-a642-69788b306ae1 tempest-VolumesSnapshotListTestJSON-13474684 None] Acquiring lock "cinder-quobyte-d9bfcaeb-ba63-4093-aecc-35ebe0a4b824" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:51 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8f791ad1-f270-4121-a642-69788b306ae1 tempest-VolumesSnapshotListTestJSON-13474684 None] Lock "cinder-quobyte-d9bfcaeb-ba63-4093-aecc-35ebe0a4b824" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:51 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-8f791ad1-f270-4121-a642-69788b306ae1 tempest-VolumesSnapshotListTestJSON-13474684 None] Deleting offline snapshot d9bfcaeb-ba63-4093-aecc-35ebe0a4b824 of volume c240c350-5e88-47af-bd25-1a3a5e889bcb {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:28:51 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-8f791ad1-f270-4121-a642-69788b306ae1 tempest-VolumesSnapshotListTestJSON-13474684 None] snapshot_file for this snap is: volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.d9bfcaeb-ba63-4093-aecc-35ebe0a4b824 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:28:51 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6249ab7b-9e40-4e24-8eca-82bacb5c73ac]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8f791ad1-f270-4121-a642-69788b306ae1 tempest-VolumesSnapshotListTestJSON-13474684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.d9bfcaeb-ba63-4093-aecc-35ebe0a4b824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:51 devstack sudo[104511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.d9bfcaeb-ba63-4093-aecc-35ebe0a4b824 Sep 28 17:28:51 devstack sudo[104511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:52 devstack sudo[104511]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8f791ad1-f270-4121-a642-69788b306ae1 tempest-VolumesSnapshotListTestJSON-13474684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.d9bfcaeb-ba63-4093-aecc-35ebe0a4b824" returned: 0 in 0.350s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-8f791ad1-f270-4121-a642-69788b306ae1 tempest-VolumesSnapshotListTestJSON-13474684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c240c350-5e88-47af-bd25-1a3a5e889bcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:28:52 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d6c629-5a3b-4f7b-bd73-4baf34640861]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8f791ad1-f270-4121-a642-69788b306ae1 tempest-VolumesSnapshotListTestJSON-13474684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:52 devstack sudo[104516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e Sep 28 17:28:52 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:52 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8f791ad1-f270-4121-a642-69788b306ae1 tempest-VolumesSnapshotListTestJSON-13474684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e" returned: 0 in 0.340s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-8f791ad1-f270-4121-a642-69788b306ae1 tempest-VolumesSnapshotListTestJSON-13474684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c240c350-5e88-47af-bd25-1a3a5e889bcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:28:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8f791ad1-f270-4121-a642-69788b306ae1 tempest-VolumesSnapshotListTestJSON-13474684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.d9bfcaeb-ba63-4093-aecc-35ebe0a4b824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:52 devstack sudo[104521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.d9bfcaeb-ba63-4093-aecc-35ebe0a4b824 Sep 28 17:28:52 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:52 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8f791ad1-f270-4121-a642-69788b306ae1 tempest-VolumesSnapshotListTestJSON-13474684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.d9bfcaeb-ba63-4093-aecc-35ebe0a4b824" returned: 0 in 0.346s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8f791ad1-f270-4121-a642-69788b306ae1 tempest-VolumesSnapshotListTestJSON-13474684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.d9bfcaeb-ba63-4093-aecc-35ebe0a4b824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:52 devstack sudo[104527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.d9bfcaeb-ba63-4093-aecc-35ebe0a4b824 Sep 28 17:28:52 devstack sudo[104527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:52 devstack sudo[104527]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8f791ad1-f270-4121-a642-69788b306ae1 tempest-VolumesSnapshotListTestJSON-13474684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.d9bfcaeb-ba63-4093-aecc-35ebe0a4b824" returned: 0 in 0.239s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:53 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8f791ad1-f270-4121-a642-69788b306ae1 tempest-VolumesSnapshotListTestJSON-13474684 None] Lock "cinder-quobyte-d9bfcaeb-ba63-4093-aecc-35ebe0a4b824" released by "_delete_snapshot" :: held 1.375s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:53 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8f791ad1-f270-4121-a642-69788b306ae1 tempest-VolumesSnapshotListTestJSON-13474684 None] Lock "cinder-quobyte-c240c350-5e88-47af-bd25-1a3a5e889bcb" released by "delete_snapshot" :: held 1.396s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:53 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-8f791ad1-f270-4121-a642-69788b306ae1 tempest-VolumesSnapshotListTestJSON-13474684 None] Created reservations ['7b13e558-ff1d-42ba-a6b2-035f91054d8a', '7a0009af-a307-47bf-9460-ffaf9bc2daed', '43649b9a-0d1e-43a7-9f0b-6a1793d7c92c', 'cbc110e8-752e-4316-a0d7-0323a3c18cd2'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:53 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-8f791ad1-f270-4121-a642-69788b306ae1 tempest-VolumesSnapshotListTestJSON-13474684 None] Delete snapshot completed successfully. Sep 28 17:28:53 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8f791ad1-f270-4121-a642-69788b306ae1 tempest-VolumesSnapshotListTestJSON-13474684 None] Lock "cinder-d9bfcaeb-ba63-4093-aecc-35ebe0a4b824-delete_snapshot" released by "delete_snapshot" :: held 1.529s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:53 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-49ad9029-a929-4966-862e-a5c085ea839e tempest-VolumesSnapshotListTestJSON-13474684 None] Acquiring lock "cinder-9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:53 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-49ad9029-a929-4966-862e-a5c085ea839e tempest-VolumesSnapshotListTestJSON-13474684 None] Lock "cinder-9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:53 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-49ad9029-a929-4966-862e-a5c085ea839e tempest-VolumesSnapshotListTestJSON-13474684 None] Acquiring lock "cinder-quobyte-c240c350-5e88-47af-bd25-1a3a5e889bcb" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:53 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-49ad9029-a929-4966-862e-a5c085ea839e tempest-VolumesSnapshotListTestJSON-13474684 None] Lock "cinder-quobyte-c240c350-5e88-47af-bd25-1a3a5e889bcb" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:53 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-49ad9029-a929-4966-862e-a5c085ea839e tempest-VolumesSnapshotListTestJSON-13474684 None] Acquiring lock "cinder-quobyte-9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:53 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-49ad9029-a929-4966-862e-a5c085ea839e tempest-VolumesSnapshotListTestJSON-13474684 None] Lock "cinder-quobyte-9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:53 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-49ad9029-a929-4966-862e-a5c085ea839e tempest-VolumesSnapshotListTestJSON-13474684 None] Deleting offline snapshot 9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e of volume c240c350-5e88-47af-bd25-1a3a5e889bcb {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:28:53 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-49ad9029-a929-4966-862e-a5c085ea839e tempest-VolumesSnapshotListTestJSON-13474684 None] snapshot_file for this snap is: volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:28:53 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[630b0e12-282b-4459-a2bc-16496eed4b1c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-49ad9029-a929-4966-862e-a5c085ea839e tempest-VolumesSnapshotListTestJSON-13474684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:53 devstack sudo[104530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e Sep 28 17:28:53 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:54 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-49ad9029-a929-4966-862e-a5c085ea839e tempest-VolumesSnapshotListTestJSON-13474684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e" returned: 0 in 0.347s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:54 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-49ad9029-a929-4966-862e-a5c085ea839e tempest-VolumesSnapshotListTestJSON-13474684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c240c350-5e88-47af-bd25-1a3a5e889bcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:28:54 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[644e0c09-68cc-469a-b46b-a94d5357294e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-49ad9029-a929-4966-862e-a5c085ea839e tempest-VolumesSnapshotListTestJSON-13474684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:54 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb Sep 28 17:28:54 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:54 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-49ad9029-a929-4966-862e-a5c085ea839e tempest-VolumesSnapshotListTestJSON-13474684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb" returned: 0 in 0.346s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-49ad9029-a929-4966-862e-a5c085ea839e tempest-VolumesSnapshotListTestJSON-13474684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:54 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e Sep 28 17:28:54 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:54 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-49ad9029-a929-4966-862e-a5c085ea839e tempest-VolumesSnapshotListTestJSON-13474684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e" returned: 0 in 0.319s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-49ad9029-a929-4966-862e-a5c085ea839e tempest-VolumesSnapshotListTestJSON-13474684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:54 devstack sudo[104545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e Sep 28 17:28:54 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:55 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-49ad9029-a929-4966-862e-a5c085ea839e tempest-VolumesSnapshotListTestJSON-13474684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb.9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e" returned: 0 in 0.243s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:55 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-49ad9029-a929-4966-862e-a5c085ea839e tempest-VolumesSnapshotListTestJSON-13474684 None] Lock "cinder-quobyte-9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e" released by "_delete_snapshot" :: held 1.356s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:55 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-49ad9029-a929-4966-862e-a5c085ea839e tempest-VolumesSnapshotListTestJSON-13474684 None] Lock "cinder-quobyte-c240c350-5e88-47af-bd25-1a3a5e889bcb" released by "delete_snapshot" :: held 1.375s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:55 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-49ad9029-a929-4966-862e-a5c085ea839e tempest-VolumesSnapshotListTestJSON-13474684 None] Created reservations ['da9e0f6b-9b25-4e67-a879-eb8a9482b888', '334cb206-0cac-495e-b5b3-0641b8314a73', '16b38058-7194-443f-aa78-41e14d3a5771', '6c5eba94-aa6c-4353-98cc-cdc006a1f803'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:55 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-49ad9029-a929-4966-862e-a5c085ea839e tempest-VolumesSnapshotListTestJSON-13474684 None] Delete snapshot completed successfully. Sep 28 17:28:55 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-49ad9029-a929-4966-862e-a5c085ea839e tempest-VolumesSnapshotListTestJSON-13474684 None] Lock "cinder-9ef17d44-ed4f-4e88-9103-7ecdde7fdb1e-delete_snapshot" released by "delete_snapshot" :: held 1.512s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:55 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-23cfdbf8-bf44-48e6-94f5-45bef0d82777 tempest-VolumesSnapshotListTestJSON-13474684 None] Acquiring lock "cinder-c240c350-5e88-47af-bd25-1a3a5e889bcb-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:55 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-23cfdbf8-bf44-48e6-94f5-45bef0d82777 tempest-VolumesSnapshotListTestJSON-13474684 None] Lock "cinder-c240c350-5e88-47af-bd25-1a3a5e889bcb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:56 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-23cfdbf8-bf44-48e6-94f5-45bef0d82777 tempest-VolumesSnapshotListTestJSON-13474684 None] Acquiring lock "cinder-quobyte-c240c350-5e88-47af-bd25-1a3a5e889bcb" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:56 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-23cfdbf8-bf44-48e6-94f5-45bef0d82777 tempest-VolumesSnapshotListTestJSON-13474684 None] Lock "cinder-quobyte-c240c350-5e88-47af-bd25-1a3a5e889bcb" acquired by "delete_volume" :: waited 0.016s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:56 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8758baab-423d-411b-9a43-8ee2d6a5fb91]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-23cfdbf8-bf44-48e6-94f5-45bef0d82777 tempest-VolumesSnapshotListTestJSON-13474684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:56 devstack sudo[104548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb Sep 28 17:28:56 devstack sudo[104548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:56 devstack sudo[104548]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-23cfdbf8-bf44-48e6-94f5-45bef0d82777 tempest-VolumesSnapshotListTestJSON-13474684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb" returned: 0 in 0.335s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-23cfdbf8-bf44-48e6-94f5-45bef0d82777 tempest-VolumesSnapshotListTestJSON-13474684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:56 devstack sudo[104553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb Sep 28 17:28:56 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:56 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-23cfdbf8-bf44-48e6-94f5-45bef0d82777 tempest-VolumesSnapshotListTestJSON-13474684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c240c350-5e88-47af-bd25-1a3a5e889bcb" returned: 0 in 0.249s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:56 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-23cfdbf8-bf44-48e6-94f5-45bef0d82777 tempest-VolumesSnapshotListTestJSON-13474684 None] Lock "cinder-quobyte-c240c350-5e88-47af-bd25-1a3a5e889bcb" released by "delete_volume" :: held 0.649s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:56 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-23cfdbf8-bf44-48e6-94f5-45bef0d82777 tempest-VolumesSnapshotListTestJSON-13474684 None] Created reservations ['704fb578-b725-4ac8-8a06-90c3224feeb9', '3ebadb5b-c68a-455c-b102-89cffbd5fb8e', 'ccec6508-73a2-4d6d-b9ff-49362404cca9', '6e517bac-521f-43d7-9e16-0dac452ec4ca'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-23cfdbf8-bf44-48e6-94f5-45bef0d82777 tempest-VolumesSnapshotListTestJSON-13474684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-23cfdbf8-bf44-48e6-94f5-45bef0d82777 tempest-VolumesSnapshotListTestJSON-13474684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:56 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-23cfdbf8-bf44-48e6-94f5-45bef0d82777 tempest-VolumesSnapshotListTestJSON-13474684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:56 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-23cfdbf8-bf44-48e6-94f5-45bef0d82777 tempest-VolumesSnapshotListTestJSON-13474684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-23cfdbf8-bf44-48e6-94f5-45bef0d82777 tempest-VolumesSnapshotListTestJSON-13474684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-23cfdbf8-bf44-48e6-94f5-45bef0d82777 tempest-VolumesSnapshotListTestJSON-13474684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:56 devstack sudo[104556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:28:56 devstack sudo[104556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:57 devstack sudo[104556]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-23cfdbf8-bf44-48e6-94f5-45bef0d82777 tempest-VolumesSnapshotListTestJSON-13474684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.255s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:57 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-23cfdbf8-bf44-48e6-94f5-45bef0d82777 tempest-VolumesSnapshotListTestJSON-13474684 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:57 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-23cfdbf8-bf44-48e6-94f5-45bef0d82777 tempest-VolumesSnapshotListTestJSON-13474684 None] Deleted volume successfully. Sep 28 17:28:57 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-23cfdbf8-bf44-48e6-94f5-45bef0d82777 tempest-VolumesSnapshotListTestJSON-13474684 None] Lock "cinder-c240c350-5e88-47af-bd25-1a3a5e889bcb-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:06 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=40,cinder:UPDATE=44,cinder:INSERT=9,cinder:DELETE=1 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:29:07 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=34,cinder:UPDATE=40,cinder:DELETE=6,cinder:INSERT=14 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:29:19 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd0fdbbc-2ca6-4faf-93f7-813723fe9206 tempest-TestInstancesWithCinderVolumes-872796781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:29:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cd0fdbbc-2ca6-4faf-93f7-813723fe9206 tempest-TestInstancesWithCinderVolumes-872796781 None] Flow 'volume_create_manager' (c14c111c-8912-4d9d-aa01-61951ed7108e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cd0fdbbc-2ca6-4faf-93f7-813723fe9206 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04342dbf-8166-47a4-b977-e627cde4471d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cd0fdbbc-2ca6-4faf-93f7-813723fe9206 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04342dbf-8166-47a4-b977-e627cde4471d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-216393531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b0203d6-4d55-4213-9b59-48035e05275b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb21676c0c164193af610c843e880e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:20Z,use_quota=True,user_id='757857fe80e845c5bb7b50ff4d0dc82f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd2d91db-408f-4657-9516-f4c828025da8),volume_type_id=fd2d91db-408f-4657-9516-f4c828025da8)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cd0fdbbc-2ca6-4faf-93f7-813723fe9206 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8636ba84-8421-4146-bd19-74e5ec01a890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cd0fdbbc-2ca6-4faf-93f7-813723fe9206 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8636ba84-8421-4146-bd19-74e5ec01a890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cd0fdbbc-2ca6-4faf-93f7-813723fe9206 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (100116a2-aa34-49eb-89a5-9e45fb7a0904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cd0fdbbc-2ca6-4faf-93f7-813723fe9206 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (100116a2-aa34-49eb-89a5-9e45fb7a0904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b0203d6-4d55-4213-9b59-48035e05275b', 'volume_name': 'volume-8b0203d6-4d55-4213-9b59-48035e05275b', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cd0fdbbc-2ca6-4faf-93f7-813723fe9206 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb309f47-4487-47ef-976d-1f00b931a5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cd0fdbbc-2ca6-4faf-93f7-813723fe9206 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb309f47-4487-47ef-976d-1f00b931a5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cd0fdbbc-2ca6-4faf-93f7-813723fe9206 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19952d31-c2b7-4296-9542-e2c87ae98c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:20 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-cd0fdbbc-2ca6-4faf-93f7-813723fe9206 tempest-TestInstancesWithCinderVolumes-872796781 None] Volume 8b0203d6-4d55-4213-9b59-48035e05275b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b0203d6-4d55-4213-9b59-48035e05275b', 'volume_size': 1} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-cd0fdbbc-2ca6-4faf-93f7-813723fe9206 tempest-TestInstancesWithCinderVolumes-872796781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-cd0fdbbc-2ca6-4faf-93f7-813723fe9206 tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-cd0fdbbc-2ca6-4faf-93f7-813723fe9206 tempest-TestInstancesWithCinderVolumes-872796781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-216393531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b0203d6-4d55-4213-9b59-48035e05275b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb21676c0c164193af610c843e880e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:20Z,use_quota=True,user_id='757857fe80e845c5bb7b50ff4d0dc82f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd2d91db-408f-4657-9516-f4c828025da8),volume_type_id=fd2d91db-408f-4657-9516-f4c828025da8)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-cd0fdbbc-2ca6-4faf-93f7-813723fe9206 tempest-TestInstancesWithCinderVolumes-872796781 None] Creating volume 8b0203d6-4d55-4213-9b59-48035e05275b {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-cd0fdbbc-2ca6-4faf-93f7-813723fe9206 tempest-TestInstancesWithCinderVolumes-872796781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-cd0fdbbc-2ca6-4faf-93f7-813723fe9206 tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-cd0fdbbc-2ca6-4faf-93f7-813723fe9206 tempest-TestInstancesWithCinderVolumes-872796781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-cd0fdbbc-2ca6-4faf-93f7-813723fe9206 tempest-TestInstancesWithCinderVolumes-872796781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-cd0fdbbc-2ca6-4faf-93f7-813723fe9206 tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-cd0fdbbc-2ca6-4faf-93f7-813723fe9206 tempest-TestInstancesWithCinderVolumes-872796781 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:29:20 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-cd0fdbbc-2ca6-4faf-93f7-813723fe9206 tempest-TestInstancesWithCinderVolumes-872796781 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-cd0fdbbc-2ca6-4faf-93f7-813723fe9206 tempest-TestInstancesWithCinderVolumes-872796781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8b0203d6-4d55-4213-9b59-48035e05275b 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:20 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8b0203d6-4d55-4213-9b59-48035e05275b 1073741824 Sep 28 17:29:20 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ee0acb4-c00b-448c-b52f-cb1b08562288 tempest-TestInstancesWithCinderVolumes-872796781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2ee0acb4-c00b-448c-b52f-cb1b08562288 tempest-TestInstancesWithCinderVolumes-872796781 None] Flow 'volume_create_manager' (ce5408b6-fe09-499c-b460-b6303713fe59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2ee0acb4-c00b-448c-b52f-cb1b08562288 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7b7acc-4a74-44ce-876d-9ce71662cfed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2ee0acb4-c00b-448c-b52f-cb1b08562288 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7b7acc-4a74-44ce-876d-9ce71662cfed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-609857262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c9741d-9462-4393-8431-42faee41d9f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb21676c0c164193af610c843e880e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:20Z,use_quota=True,user_id='757857fe80e845c5bb7b50ff4d0dc82f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8754317-2f5f-4191-87a0-f9c7bb57bee6),volume_type_id=c8754317-2f5f-4191-87a0-f9c7bb57bee6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2ee0acb4-c00b-448c-b52f-cb1b08562288 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb326327-cd0c-4e37-9c8f-5fa0534630a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2ee0acb4-c00b-448c-b52f-cb1b08562288 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb326327-cd0c-4e37-9c8f-5fa0534630a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2ee0acb4-c00b-448c-b52f-cb1b08562288 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55fb33c-0c11-444e-9616-ac366525e821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2ee0acb4-c00b-448c-b52f-cb1b08562288 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55fb33c-0c11-444e-9616-ac366525e821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70c9741d-9462-4393-8431-42faee41d9f4', 'volume_name': 'volume-70c9741d-9462-4393-8431-42faee41d9f4', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2ee0acb4-c00b-448c-b52f-cb1b08562288 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e3423fd-aa6e-42db-b909-8d2e7ad7ab3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2ee0acb4-c00b-448c-b52f-cb1b08562288 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e3423fd-aa6e-42db-b909-8d2e7ad7ab3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2ee0acb4-c00b-448c-b52f-cb1b08562288 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8e0658-4654-4e85-b846-fefc645fb934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:20 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-2ee0acb4-c00b-448c-b52f-cb1b08562288 tempest-TestInstancesWithCinderVolumes-872796781 None] Volume 70c9741d-9462-4393-8431-42faee41d9f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70c9741d-9462-4393-8431-42faee41d9f4', 'volume_size': 1} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2ee0acb4-c00b-448c-b52f-cb1b08562288 tempest-TestInstancesWithCinderVolumes-872796781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:20 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-cd0fdbbc-2ca6-4faf-93f7-813723fe9206 tempest-TestInstancesWithCinderVolumes-872796781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8b0203d6-4d55-4213-9b59-48035e05275b 1073741824" returned: 0 in 0.482s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-cd0fdbbc-2ca6-4faf-93f7-813723fe9206 tempest-TestInstancesWithCinderVolumes-872796781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8b0203d6-4d55-4213-9b59-48035e05275b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:20 devstack sudo[104573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8b0203d6-4d55-4213-9b59-48035e05275b Sep 28 17:29:20 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:20 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-cd0fdbbc-2ca6-4faf-93f7-813723fe9206 tempest-TestInstancesWithCinderVolumes-872796781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8b0203d6-4d55-4213-9b59-48035e05275b" returned: 0 in 0.252s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-cd0fdbbc-2ca6-4faf-93f7-813723fe9206 tempest-TestInstancesWithCinderVolumes-872796781 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-cd0fdbbc-2ca6-4faf-93f7-813723fe9206 tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2ee0acb4-c00b-448c-b52f-cb1b08562288 tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.368s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-2ee0acb4-c00b-448c-b52f-cb1b08562288 tempest-TestInstancesWithCinderVolumes-872796781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-609857262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c9741d-9462-4393-8431-42faee41d9f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb21676c0c164193af610c843e880e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:20Z,use_quota=True,user_id='757857fe80e845c5bb7b50ff4d0dc82f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8754317-2f5f-4191-87a0-f9c7bb57bee6),volume_type_id=c8754317-2f5f-4191-87a0-f9c7bb57bee6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-2ee0acb4-c00b-448c-b52f-cb1b08562288 tempest-TestInstancesWithCinderVolumes-872796781 None] Creating volume 70c9741d-9462-4393-8431-42faee41d9f4 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2ee0acb4-c00b-448c-b52f-cb1b08562288 tempest-TestInstancesWithCinderVolumes-872796781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2ee0acb4-c00b-448c-b52f-cb1b08562288 tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-2ee0acb4-c00b-448c-b52f-cb1b08562288 tempest-TestInstancesWithCinderVolumes-872796781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-2ee0acb4-c00b-448c-b52f-cb1b08562288 tempest-TestInstancesWithCinderVolumes-872796781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2ee0acb4-c00b-448c-b52f-cb1b08562288 tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-2ee0acb4-c00b-448c-b52f-cb1b08562288 tempest-TestInstancesWithCinderVolumes-872796781 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:29:20 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-2ee0acb4-c00b-448c-b52f-cb1b08562288 tempest-TestInstancesWithCinderVolumes-872796781 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2ee0acb4-c00b-448c-b52f-cb1b08562288 tempest-TestInstancesWithCinderVolumes-872796781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-70c9741d-9462-4393-8431-42faee41d9f4 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cd0fdbbc-2ca6-4faf-93f7-813723fe9206 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19952d31-c2b7-4296-9542-e2c87ae98c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b0203d6-4d55-4213-9b59-48035e05275b', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cd0fdbbc-2ca6-4faf-93f7-813723fe9206 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d1fbc71-8543-424e-afa7-d5f66b540d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:20 devstack sudo[104576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-70c9741d-9462-4393-8431-42faee41d9f4 1073741824 Sep 28 17:29:20 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:20 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-cd0fdbbc-2ca6-4faf-93f7-813723fe9206 tempest-TestInstancesWithCinderVolumes-872796781 None] Volume volume-8b0203d6-4d55-4213-9b59-48035e05275b (8b0203d6-4d55-4213-9b59-48035e05275b): created successfully Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cd0fdbbc-2ca6-4faf-93f7-813723fe9206 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d1fbc71-8543-424e-afa7-d5f66b540d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-cd0fdbbc-2ca6-4faf-93f7-813723fe9206 tempest-TestInstancesWithCinderVolumes-872796781 None] Flow 'volume_create_manager' (c14c111c-8912-4d9d-aa01-61951ed7108e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:20 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-cd0fdbbc-2ca6-4faf-93f7-813723fe9206 tempest-TestInstancesWithCinderVolumes-872796781 None] Created volume successfully. Sep 28 17:29:21 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:29:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Flow 'volume_create_manager' (efe289ad-f594-4963-baa4-342c9538d650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53248cbf-aa70-42a0-822c-af006c16952d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53248cbf-aa70-42a0-822c-af006c16952d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1458183706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90f04ff3-e99f-4fa5-8061-330e7989fe49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb21676c0c164193af610c843e880e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:21Z,use_quota=True,user_id='757857fe80e845c5bb7b50ff4d0dc82f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa1c5e49-1f21-45de-b5eb-8c8e80569513),volume_type_id=fa1c5e49-1f21-45de-b5eb-8c8e80569513)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d8d7340-6b8f-4e2b-a564-d036c057c958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d8d7340-6b8f-4e2b-a564-d036c057c958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40f61ad1-abbe-4065-ad45-20675c6d7eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:21 devstack cinder-volume[86917]: DEBUG cinder.image.glance [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Creating Keystone auth plugin from conf {{(pid=86917) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:29:21 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2ee0acb4-c00b-448c-b52f-cb1b08562288 tempest-TestInstancesWithCinderVolumes-872796781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-70c9741d-9462-4393-8431-42faee41d9f4 1073741824" returned: 0 in 0.534s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2ee0acb4-c00b-448c-b52f-cb1b08562288 tempest-TestInstancesWithCinderVolumes-872796781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-70c9741d-9462-4393-8431-42faee41d9f4 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:21 devstack sudo[104584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-70c9741d-9462-4393-8431-42faee41d9f4 Sep 28 17:29:21 devstack sudo[104584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40f61ad1-abbe-4065-ad45-20675c6d7eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '90f04ff3-e99f-4fa5-8061-330e7989fe49', 'volume_name': 'volume-90f04ff3-e99f-4fa5-8061-330e7989fe49', 'volume_size': 1, 'image_id': 'bd6c98d3-3398-4c6f-936e-0361e488e164', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bd6c98d3-3398-4c6f-936e-0361e488e164', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--469566223', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb21676c0c164193af610c843e880e64', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bd6c98d3-3398-4c6f-936e-0361e488e164', 'created_at': datetime.datetime(2026, 9, 28, 15, 29, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 29, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bd6c98d3-3398-4c6f-936e-0361e488e164/file', 'properties': {}}, 'image_service': }' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59fe2935-c0d3-47c2-97fa-ec4e3b45515c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59fe2935-c0d3-47c2-97fa-ec4e3b45515c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f3de5f8-3960-4017-bbcf-278b69c48da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:21 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Volume 90f04ff3-e99f-4fa5-8061-330e7989fe49: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-90f04ff3-e99f-4fa5-8061-330e7989fe49', 'volume_size': 1, 'image_id': 'bd6c98d3-3398-4c6f-936e-0361e488e164', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bd6c98d3-3398-4c6f-936e-0361e488e164', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--469566223', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb21676c0c164193af610c843e880e64', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bd6c98d3-3398-4c6f-936e-0361e488e164', 'created_at': datetime.datetime(2026, 9, 28, 15, 29, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 29, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bd6c98d3-3398-4c6f-936e-0361e488e164/file', 'properties': {}}, 'image_service': } Sep 28 17:29:21 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Trying to clone 90f04ff3-e99f-4fa5-8061-330e7989fe49 from image bd6c98d3-3398-4c6f-936e-0361e488e164 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bd6c98d3-3398-4c6f-936e-0361e488e164', 'metadata': {}}]). {{(pid=86917) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:29:21 devstack sudo[104584]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2ee0acb4-c00b-448c-b52f-cb1b08562288 tempest-TestInstancesWithCinderVolumes-872796781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-70c9741d-9462-4393-8431-42faee41d9f4" returned: 0 in 0.260s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:21 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-2ee0acb4-c00b-448c-b52f-cb1b08562288 tempest-TestInstancesWithCinderVolumes-872796781 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:29:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2ee0acb4-c00b-448c-b52f-cb1b08562288 tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2ee0acb4-c00b-448c-b52f-cb1b08562288 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8e0658-4654-4e85-b846-fefc645fb934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70c9741d-9462-4393-8431-42faee41d9f4', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2ee0acb4-c00b-448c-b52f-cb1b08562288 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6520eb44-2647-4716-954b-d4e292f64d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:21 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-2ee0acb4-c00b-448c-b52f-cb1b08562288 tempest-TestInstancesWithCinderVolumes-872796781 None] Volume volume-70c9741d-9462-4393-8431-42faee41d9f4 (70c9741d-9462-4393-8431-42faee41d9f4): created successfully Sep 28 17:29:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2ee0acb4-c00b-448c-b52f-cb1b08562288 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6520eb44-2647-4716-954b-d4e292f64d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-2ee0acb4-c00b-448c-b52f-cb1b08562288 tempest-TestInstancesWithCinderVolumes-872796781 None] Flow 'volume_create_manager' (ce5408b6-fe09-499c-b460-b6303713fe59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:21 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-2ee0acb4-c00b-448c-b52f-cb1b08562288 tempest-TestInstancesWithCinderVolumes-872796781 None] Created volume successfully. Sep 28 17:29:24 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bd6c98d3-3398-4c6f-936e-0361e488e164_0p4lmwiodevstack@QuobyteHD, size 20.69 MB, duration 2.80 sec {{(pid=86917) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:29:24 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Image download 20.69 MB at 7.39 MB/s Sep 28 17:29:24 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf96002-09ea-4f2f-bab7-f9da9773e8ff]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bd6c98d3-3398-4c6f-936e-0361e488e164_0p4lmwiodevstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:24 devstack sudo[104587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bd6c98d3-3398-4c6f-936e-0361e488e164_0p4lmwiodevstack@QuobyteHD Sep 28 17:29:24 devstack sudo[104587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:24 devstack sudo[104587]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bd6c98d3-3398-4c6f-936e-0361e488e164_0p4lmwiodevstack@QuobyteHD" returned: 0 in 0.336s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:24 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Temporary image bd6c98d3-3398-4c6f-936e-0361e488e164 is fetched for user 757857fe80e845c5bb7b50ff4d0dc82f. {{(pid=86917) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:29:24 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc19ae2-1391-454a-9418-b5d33e1e51d7]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bd6c98d3-3398-4c6f-936e-0361e488e164_0p4lmwiodevstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:24 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bd6c98d3-3398-4c6f-936e-0361e488e164_0p4lmwiodevstack@QuobyteHD Sep 28 17:29:24 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:25 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bd6c98d3-3398-4c6f-936e-0361e488e164_0p4lmwiodevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:25 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1458183706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90f04ff3-e99f-4fa5-8061-330e7989fe49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb21676c0c164193af610c843e880e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:21Z,use_quota=True,user_id='757857fe80e845c5bb7b50ff4d0dc82f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa1c5e49-1f21-45de-b5eb-8c8e80569513),volume_type_id=fa1c5e49-1f21-45de-b5eb-8c8e80569513)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:29:25 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Creating volume 90f04ff3-e99f-4fa5-8061-330e7989fe49 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:29:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:25 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:25 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:25 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:29:25 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:29:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-90f04ff3-e99f-4fa5-8061-330e7989fe49 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:25 devstack sudo[104597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-90f04ff3-e99f-4fa5-8061-330e7989fe49 1073741824 Sep 28 17:29:25 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:25 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-90f04ff3-e99f-4fa5-8061-330e7989fe49 1073741824" returned: 0 in 0.459s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-90f04ff3-e99f-4fa5-8061-330e7989fe49 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:25 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-90f04ff3-e99f-4fa5-8061-330e7989fe49 Sep 28 17:29:25 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:25 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-90f04ff3-e99f-4fa5-8061-330e7989fe49" returned: 0 in 0.244s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:25 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:29:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:25 devstack cinder-volume[86917]: DEBUG cinder.volume.volume_utils [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Attempting download of bd6c98d3-3398-4c6f-936e-0361e488e164 ((None, [{'url': 'file:///opt/stack/data/glance/images/bd6c98d3-3398-4c6f-936e-0361e488e164', 'metadata': {}}])) to volume 90f04ff3-e99f-4fa5-8061-330e7989fe49. {{(pid=86917) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:29:26 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9593b07-6bf0-47f9-8a50-90b31d1e9d12]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bd6c98d3-3398-4c6f-936e-0361e488e164_dm8baesh {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:26 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bd6c98d3-3398-4c6f-936e-0361e488e164_dm8baesh Sep 28 17:29:26 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:26 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bd6c98d3-3398-4c6f-936e-0361e488e164_dm8baesh" returned: 0 in 0.352s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bd6c98d3-3398-4c6f-936e-0361e488e164_dm8baesh {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:26 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bd6c98d3-3398-4c6f-936e-0361e488e164_dm8baesh Sep 28 17:29:26 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:26 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bd6c98d3-3398-4c6f-936e-0361e488e164_dm8baesh" returned: 1 in 0.346s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bd6c98d3-3398-4c6f-936e-0361e488e164_dm8baesh' failed. Not Retrying. {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:29:26 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b48be32-a8b1-4639-b921-b047253bc3c0]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bd6c98d3-3398-4c6f-936e-0361e488e164_0p4lmwiodevstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:26 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bd6c98d3-3398-4c6f-936e-0361e488e164_0p4lmwiodevstack@QuobyteHD Sep 28 17:29:26 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:27 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bd6c98d3-3398-4c6f-936e-0361e488e164_0p4lmwiodevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:27 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] bd6c98d3-3398-4c6f-936e-0361e488e164 was qcow2, converting to qcow2 {{(pid=86917) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:29:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bd6c98d3-3398-4c6f-936e-0361e488e164_0p4lmwiodevstack@QuobyteHD /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-90f04ff3-e99f-4fa5-8061-330e7989fe49 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:27 devstack sudo[104619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bd6c98d3-3398-4c6f-936e-0361e488e164_0p4lmwiodevstack@QuobyteHD /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-90f04ff3-e99f-4fa5-8061-330e7989fe49 Sep 28 17:29:27 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:28 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bd6c98d3-3398-4c6f-936e-0361e488e164_0p4lmwiodevstack@QuobyteHD /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-90f04ff3-e99f-4fa5-8061-330e7989fe49" returned: 0 in 1.912s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:28 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bd6c98d3-3398-4c6f-936e-0361e488e164_0p4lmwiodevstack@QuobyteHD, size 112.00 MB, duration 1.91 sec, destination /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-90f04ff3-e99f-4fa5-8061-330e7989fe49 {{(pid=86917) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:29:28 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Converted 112.00 MB image at 58.53 MB/s Sep 28 17:29:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-90f04ff3-e99f-4fa5-8061-330e7989fe49 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:28 devstack sudo[104645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-90f04ff3-e99f-4fa5-8061-330e7989fe49 1G Sep 28 17:29:29 devstack sudo[104645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:29 devstack sudo[104645]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-90f04ff3-e99f-4fa5-8061-330e7989fe49 1G" returned: 0 in 0.353s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:29 devstack cinder-volume[86917]: DEBUG cinder.volume.volume_utils [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Downloaded image bd6c98d3-3398-4c6f-936e-0361e488e164 ((None, [{'url': 'file:///opt/stack/data/glance/images/bd6c98d3-3398-4c6f-936e-0361e488e164', 'metadata': {}}])) to volume 90f04ff3-e99f-4fa5-8061-330e7989fe49 successfully. {{(pid=86917) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:29:29 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Temporary image bd6c98d3-3398-4c6f-936e-0361e488e164 for user 757857fe80e845c5bb7b50ff4d0dc82f is deleted. {{(pid=86917) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:29:29 devstack cinder-volume[86917]: DEBUG cinder.volume.volume_utils [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Marking volume 90f04ff3-e99f-4fa5-8061-330e7989fe49 as bootable. {{(pid=86917) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:29:29 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Copying metadata from image bd6c98d3-3398-4c6f-936e-0361e488e164 to 90f04ff3-e99f-4fa5-8061-330e7989fe49. {{(pid=86917) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:29:29 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Creating volume glance metadata for volume 90f04ff3-e99f-4fa5-8061-330e7989fe49 backed by image bd6c98d3-3398-4c6f-936e-0361e488e164 with: {'image_id': 'bd6c98d3-3398-4c6f-936e-0361e488e164', 'image_name': 'tempest-scenario-img--469566223', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86917) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:29:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f3de5f8-3960-4017-bbcf-278b69c48da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90f04ff3-e99f-4fa5-8061-330e7989fe49', 'volume_size': 1, 'image_id': 'bd6c98d3-3398-4c6f-936e-0361e488e164', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bd6c98d3-3398-4c6f-936e-0361e488e164', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--469566223', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cb21676c0c164193af610c843e880e64', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bd6c98d3-3398-4c6f-936e-0361e488e164', 'created_at': datetime.datetime(2026, 9, 28, 15, 29, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 29, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bd6c98d3-3398-4c6f-936e-0361e488e164/file', 'properties': {}}, 'image_service': }' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (697028e4-faa2-4682-ae78-583829327d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:29 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Volume volume-90f04ff3-e99f-4fa5-8061-330e7989fe49 (90f04ff3-e99f-4fa5-8061-330e7989fe49): created successfully Sep 28 17:29:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (697028e4-faa2-4682-ae78-583829327d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Flow 'volume_create_manager' (efe289ad-f594-4963-baa4-342c9538d650) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:29 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-7983a5aa-d4ad-498b-a716-b559c7447415 tempest-TestInstancesWithCinderVolumes-872796781 None] Created volume successfully. Sep 28 17:29:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-d5ce4e37-62c5-4dfe-897f-e50160d93370 req-ee4162e9-41f4-486b-9006-4e6cf881b723 tempest-TestInstancesWithCinderVolumes-872796781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-d5ce4e37-62c5-4dfe-897f-e50160d93370 req-ee4162e9-41f4-486b-9006-4e6cf881b723 tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-d5ce4e37-62c5-4dfe-897f-e50160d93370 req-ee4162e9-41f4-486b-9006-4e6cf881b723 tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:33 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-d5ce4e37-62c5-4dfe-897f-e50160d93370 req-ee4162e9-41f4-486b-9006-4e6cf881b723 tempest-TestInstancesWithCinderVolumes-872796781 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069', 'name': 'volume-90f04ff3-e99f-4fa5-8061-330e7989fe49', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1741ceb1-affc-47fd-bb58-df698aac3e4a', 'enforce_multipath': True} {{(pid=86917) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:29:33 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-d5ce4e37-62c5-4dfe-897f-e50160d93370 req-ee4162e9-41f4-486b-9006-4e6cf881b723 tempest-TestInstancesWithCinderVolumes-872796781 None] attachment_update completed successfully. Sep 28 17:29:43 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:UPDATE=16,cinder:SELECT=16,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:29:43 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=20,cinder:UPDATE=8,cinder:INSERT=9,cinder:DELETE=2 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:29:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:29:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:49 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:29:49 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:49 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.255s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:49 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager._thread_info {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:29:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread count: 28 {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:29:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread info: [<_MainThread(MainThread, started 132915553284224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:30:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-a7b93ac7-6ddd-4fd2-8372-fb813b37aa70 req-86c01c27-db0e-4e8d-ac9e-f90279653e41 tempest-TestInstancesWithCinderVolumes-872796781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-a7b93ac7-6ddd-4fd2-8372-fb813b37aa70 req-86c01c27-db0e-4e8d-ac9e-f90279653e41 tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-a7b93ac7-6ddd-4fd2-8372-fb813b37aa70 req-86c01c27-db0e-4e8d-ac9e-f90279653e41 tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:06 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-a7b93ac7-6ddd-4fd2-8372-fb813b37aa70 req-86c01c27-db0e-4e8d-ac9e-f90279653e41 tempest-TestInstancesWithCinderVolumes-872796781 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069', 'name': 'volume-8b0203d6-4d55-4213-9b59-48035e05275b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'da22ca53-a33d-428e-a1dd-31cec3c19a1c', 'enforce_multipath': True} {{(pid=86917) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:30:06 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-a7b93ac7-6ddd-4fd2-8372-fb813b37aa70 req-86c01c27-db0e-4e8d-ac9e-f90279653e41 tempest-TestInstancesWithCinderVolumes-872796781 None] attachment_update completed successfully. Sep 28 17:30:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-6d2d0dad-cb4c-4230-b4ce-b39e202d481a req-ed381964-0a16-4506-8e7a-d21cba2b3ac9 tempest-TestInstancesWithCinderVolumes-872796781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-6d2d0dad-cb4c-4230-b4ce-b39e202d481a req-ed381964-0a16-4506-8e7a-d21cba2b3ac9 tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-6d2d0dad-cb4c-4230-b4ce-b39e202d481a req-ed381964-0a16-4506-8e7a-d21cba2b3ac9 tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:08 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-6d2d0dad-cb4c-4230-b4ce-b39e202d481a req-ed381964-0a16-4506-8e7a-d21cba2b3ac9 tempest-TestInstancesWithCinderVolumes-872796781 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069', 'name': 'volume-70c9741d-9462-4393-8431-42faee41d9f4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '75f282d2-0e7b-45db-a072-bde6b34ac350', 'enforce_multipath': True} {{(pid=86917) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:30:08 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-6d2d0dad-cb4c-4230-b4ce-b39e202d481a req-ed381964-0a16-4506-8e7a-d21cba2b3ac9 tempest-TestInstancesWithCinderVolumes-872796781 None] attachment_update completed successfully. Sep 28 17:30:13 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-f31bed7a-d331-4713-9d50-002ad302817c req-6c63fbe3-f0a4-47f8-bdc5-2874b27d70bd tempest-TestInstancesWithCinderVolumes-872796781 None] Terminate volume connection completed successfully. Sep 28 17:30:13 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-f31bed7a-d331-4713-9d50-002ad302817c req-6c63fbe3-f0a4-47f8-bdc5-2874b27d70bd tempest-TestInstancesWithCinderVolumes-872796781 None] Deleting attachment da22ca53-a33d-428e-a1dd-31cec3c19a1c. {{(pid=86917) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:30:13 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-97409b7d-08f3-469d-8e30-deb9e704ec60 tempest-TestInstancesWithCinderVolumes-872796781 None] Acquiring lock "cinder-8b0203d6-4d55-4213-9b59-48035e05275b-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:13 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-97409b7d-08f3-469d-8e30-deb9e704ec60 tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "cinder-8b0203d6-4d55-4213-9b59-48035e05275b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:13 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-97409b7d-08f3-469d-8e30-deb9e704ec60 tempest-TestInstancesWithCinderVolumes-872796781 None] Acquiring lock "cinder-quobyte-8b0203d6-4d55-4213-9b59-48035e05275b" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:13 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-97409b7d-08f3-469d-8e30-deb9e704ec60 tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "cinder-quobyte-8b0203d6-4d55-4213-9b59-48035e05275b" acquired by "delete_volume" :: waited 0.014s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:13 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b994c63c-dd20-4769-b5e5-a03e0402eef0]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-97409b7d-08f3-469d-8e30-deb9e704ec60 tempest-TestInstancesWithCinderVolumes-872796781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8b0203d6-4d55-4213-9b59-48035e05275b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:14 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8b0203d6-4d55-4213-9b59-48035e05275b Sep 28 17:30:14 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:14 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-97409b7d-08f3-469d-8e30-deb9e704ec60 tempest-TestInstancesWithCinderVolumes-872796781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8b0203d6-4d55-4213-9b59-48035e05275b" returned: 0 in 0.425s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-97409b7d-08f3-469d-8e30-deb9e704ec60 tempest-TestInstancesWithCinderVolumes-872796781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8b0203d6-4d55-4213-9b59-48035e05275b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:14 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8b0203d6-4d55-4213-9b59-48035e05275b Sep 28 17:30:14 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:14 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-97409b7d-08f3-469d-8e30-deb9e704ec60 tempest-TestInstancesWithCinderVolumes-872796781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8b0203d6-4d55-4213-9b59-48035e05275b" returned: 0 in 0.252s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:14 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-97409b7d-08f3-469d-8e30-deb9e704ec60 tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "cinder-quobyte-8b0203d6-4d55-4213-9b59-48035e05275b" released by "delete_volume" :: held 0.717s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:14 devstack cinder-volume[86917]: WARNING cinder.quota [None req-97409b7d-08f3-469d-8e30-deb9e704ec60 tempest-TestInstancesWithCinderVolumes-872796781 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-469894733-21873536 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-469894733-21873536, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:30:14 devstack cinder-volume[86917]: WARNING cinder.quota [None req-97409b7d-08f3-469d-8e30-deb9e704ec60 tempest-TestInstancesWithCinderVolumes-872796781 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-469894733-21873536 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-469894733-21873536, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:30:14 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-97409b7d-08f3-469d-8e30-deb9e704ec60 tempest-TestInstancesWithCinderVolumes-872796781 None] Created reservations ['ebeccbf8-66b4-48bb-abdc-2c288611eae5', '762b3b46-e4ee-4fd5-9f9c-f1c734a594a7', '4478d667-8928-41a9-b9f8-73fb830536dc', 'd9c2609c-6e8e-4eed-b78b-d568bc6740eb'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:30:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-97409b7d-08f3-469d-8e30-deb9e704ec60 tempest-TestInstancesWithCinderVolumes-872796781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-97409b7d-08f3-469d-8e30-deb9e704ec60 tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:14 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-97409b7d-08f3-469d-8e30-deb9e704ec60 tempest-TestInstancesWithCinderVolumes-872796781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:30:14 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-97409b7d-08f3-469d-8e30-deb9e704ec60 tempest-TestInstancesWithCinderVolumes-872796781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:30:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-97409b7d-08f3-469d-8e30-deb9e704ec60 tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-97409b7d-08f3-469d-8e30-deb9e704ec60 tempest-TestInstancesWithCinderVolumes-872796781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:14 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:30:14 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:15 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-97409b7d-08f3-469d-8e30-deb9e704ec60 tempest-TestInstancesWithCinderVolumes-872796781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.263s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:15 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-97409b7d-08f3-469d-8e30-deb9e704ec60 tempest-TestInstancesWithCinderVolumes-872796781 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:30:15 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-97409b7d-08f3-469d-8e30-deb9e704ec60 tempest-TestInstancesWithCinderVolumes-872796781 None] Deleted volume successfully. Sep 28 17:30:15 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-97409b7d-08f3-469d-8e30-deb9e704ec60 tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "cinder-8b0203d6-4d55-4213-9b59-48035e05275b-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:17 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-133bb5c2-bc7c-4439-9c0e-1a593f6c3f2a req-907f877d-3482-40af-a427-4622d55ea2cf tempest-TestInstancesWithCinderVolumes-872796781 None] Terminate volume connection completed successfully. Sep 28 17:30:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-133bb5c2-bc7c-4439-9c0e-1a593f6c3f2a req-907f877d-3482-40af-a427-4622d55ea2cf tempest-TestInstancesWithCinderVolumes-872796781 None] Deleting attachment 75f282d2-0e7b-45db-a072-bde6b34ac350. {{(pid=86917) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:30:18 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6ca665b3-7fa9-4a52-a59f-6142879b493f tempest-TestInstancesWithCinderVolumes-872796781 None] Acquiring lock "cinder-70c9741d-9462-4393-8431-42faee41d9f4-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:18 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6ca665b3-7fa9-4a52-a59f-6142879b493f tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "cinder-70c9741d-9462-4393-8431-42faee41d9f4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:18 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6ca665b3-7fa9-4a52-a59f-6142879b493f tempest-TestInstancesWithCinderVolumes-872796781 None] Acquiring lock "cinder-quobyte-70c9741d-9462-4393-8431-42faee41d9f4" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:18 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6ca665b3-7fa9-4a52-a59f-6142879b493f tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "cinder-quobyte-70c9741d-9462-4393-8431-42faee41d9f4" acquired by "delete_volume" :: waited 0.018s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:18 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[103c212f-3ed2-4c21-9578-2fd141972a78]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6ca665b3-7fa9-4a52-a59f-6142879b493f tempest-TestInstancesWithCinderVolumes-872796781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-70c9741d-9462-4393-8431-42faee41d9f4 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:18 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-70c9741d-9462-4393-8431-42faee41d9f4 Sep 28 17:30:18 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:18 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6ca665b3-7fa9-4a52-a59f-6142879b493f tempest-TestInstancesWithCinderVolumes-872796781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-70c9741d-9462-4393-8431-42faee41d9f4" returned: 0 in 0.424s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6ca665b3-7fa9-4a52-a59f-6142879b493f tempest-TestInstancesWithCinderVolumes-872796781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-70c9741d-9462-4393-8431-42faee41d9f4 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:18 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-70c9741d-9462-4393-8431-42faee41d9f4 Sep 28 17:30:18 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:18 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6ca665b3-7fa9-4a52-a59f-6142879b493f tempest-TestInstancesWithCinderVolumes-872796781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-70c9741d-9462-4393-8431-42faee41d9f4" returned: 0 in 0.266s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:18 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6ca665b3-7fa9-4a52-a59f-6142879b493f tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "cinder-quobyte-70c9741d-9462-4393-8431-42faee41d9f4" released by "delete_volume" :: held 0.742s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:19 devstack cinder-volume[86917]: WARNING cinder.quota [None req-6ca665b3-7fa9-4a52-a59f-6142879b493f tempest-TestInstancesWithCinderVolumes-872796781 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1399147387-939824874 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1399147387-939824874, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:30:19 devstack cinder-volume[86917]: WARNING cinder.quota [None req-6ca665b3-7fa9-4a52-a59f-6142879b493f tempest-TestInstancesWithCinderVolumes-872796781 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1399147387-939824874 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1399147387-939824874, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:30:19 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-6ca665b3-7fa9-4a52-a59f-6142879b493f tempest-TestInstancesWithCinderVolumes-872796781 None] Created reservations ['0299761c-47a4-4735-bb23-661bef8b985a', '7fd6ceb8-99b1-4d4a-af8e-f145666c041f', '5bc5b575-559a-4fc7-89f8-aef5e2d1c758', '32e19150-8445-43bc-875a-e582db1c329a'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:30:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6ca665b3-7fa9-4a52-a59f-6142879b493f tempest-TestInstancesWithCinderVolumes-872796781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6ca665b3-7fa9-4a52-a59f-6142879b493f tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6ca665b3-7fa9-4a52-a59f-6142879b493f tempest-TestInstancesWithCinderVolumes-872796781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:30:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6ca665b3-7fa9-4a52-a59f-6142879b493f tempest-TestInstancesWithCinderVolumes-872796781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:30:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6ca665b3-7fa9-4a52-a59f-6142879b493f tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6ca665b3-7fa9-4a52-a59f-6142879b493f tempest-TestInstancesWithCinderVolumes-872796781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:19 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:30:19 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:19 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6ca665b3-7fa9-4a52-a59f-6142879b493f tempest-TestInstancesWithCinderVolumes-872796781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.311s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:19 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-6ca665b3-7fa9-4a52-a59f-6142879b493f tempest-TestInstancesWithCinderVolumes-872796781 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:30:19 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-6ca665b3-7fa9-4a52-a59f-6142879b493f tempest-TestInstancesWithCinderVolumes-872796781 None] Deleted volume successfully. Sep 28 17:30:19 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6ca665b3-7fa9-4a52-a59f-6142879b493f tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "cinder-70c9741d-9462-4393-8431-42faee41d9f4-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:22 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-da4cf36e-ec60-441e-be57-b56d9fbbeb9b req-7a45ff61-b851-45fa-8356-c43b029a1295 tempest-TestInstancesWithCinderVolumes-872796781 None] Terminate volume connection completed successfully. Sep 28 17:30:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-da4cf36e-ec60-441e-be57-b56d9fbbeb9b req-7a45ff61-b851-45fa-8356-c43b029a1295 tempest-TestInstancesWithCinderVolumes-872796781 None] Deleting attachment 1741ceb1-affc-47fd-bb58-df698aac3e4a. {{(pid=86917) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:30:23 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ec717256-6604-4e82-b311-905a447105a4 tempest-TestInstancesWithCinderVolumes-872796781 None] Acquiring lock "cinder-90f04ff3-e99f-4fa5-8061-330e7989fe49-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:23 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ec717256-6604-4e82-b311-905a447105a4 tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "cinder-90f04ff3-e99f-4fa5-8061-330e7989fe49-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:23 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ec717256-6604-4e82-b311-905a447105a4 tempest-TestInstancesWithCinderVolumes-872796781 None] Acquiring lock "cinder-quobyte-90f04ff3-e99f-4fa5-8061-330e7989fe49" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:23 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ec717256-6604-4e82-b311-905a447105a4 tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "cinder-quobyte-90f04ff3-e99f-4fa5-8061-330e7989fe49" acquired by "delete_volume" :: waited 0.017s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:23 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9200ff0-3cdb-4a56-a74e-de08959ec716]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ec717256-6604-4e82-b311-905a447105a4 tempest-TestInstancesWithCinderVolumes-872796781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-90f04ff3-e99f-4fa5-8061-330e7989fe49 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:23 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-90f04ff3-e99f-4fa5-8061-330e7989fe49 Sep 28 17:30:23 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:23 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ec717256-6604-4e82-b311-905a447105a4 tempest-TestInstancesWithCinderVolumes-872796781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-90f04ff3-e99f-4fa5-8061-330e7989fe49" returned: 0 in 0.409s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ec717256-6604-4e82-b311-905a447105a4 tempest-TestInstancesWithCinderVolumes-872796781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-90f04ff3-e99f-4fa5-8061-330e7989fe49 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:23 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-90f04ff3-e99f-4fa5-8061-330e7989fe49 Sep 28 17:30:23 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:24 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ec717256-6604-4e82-b311-905a447105a4 tempest-TestInstancesWithCinderVolumes-872796781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-90f04ff3-e99f-4fa5-8061-330e7989fe49" returned: 0 in 0.256s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ec717256-6604-4e82-b311-905a447105a4 tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "cinder-quobyte-90f04ff3-e99f-4fa5-8061-330e7989fe49" released by "delete_volume" :: held 0.712s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:24 devstack cinder-volume[86917]: WARNING cinder.quota [None req-ec717256-6604-4e82-b311-905a447105a4 tempest-TestInstancesWithCinderVolumes-872796781 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-402773865-1058027219 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-402773865-1058027219, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:30:24 devstack cinder-volume[86917]: WARNING cinder.quota [None req-ec717256-6604-4e82-b311-905a447105a4 tempest-TestInstancesWithCinderVolumes-872796781 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-402773865-1058027219 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-402773865-1058027219, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:30:24 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-ec717256-6604-4e82-b311-905a447105a4 tempest-TestInstancesWithCinderVolumes-872796781 None] Created reservations ['bac2b76d-c216-46e1-95ec-39ba4fab9e1f', '61f526d1-2f1d-48cd-b1cc-f32aaca0fc02', '22243472-0933-40b7-b393-efcc687a27dc', '2cdf9a01-ee1d-4839-b1aa-0325bf825c53'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:30:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ec717256-6604-4e82-b311-905a447105a4 tempest-TestInstancesWithCinderVolumes-872796781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ec717256-6604-4e82-b311-905a447105a4 tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ec717256-6604-4e82-b311-905a447105a4 tempest-TestInstancesWithCinderVolumes-872796781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:30:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ec717256-6604-4e82-b311-905a447105a4 tempest-TestInstancesWithCinderVolumes-872796781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:30:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ec717256-6604-4e82-b311-905a447105a4 tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ec717256-6604-4e82-b311-905a447105a4 tempest-TestInstancesWithCinderVolumes-872796781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:24 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:30:24 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:24 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ec717256-6604-4e82-b311-905a447105a4 tempest-TestInstancesWithCinderVolumes-872796781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.274s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:24 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-ec717256-6604-4e82-b311-905a447105a4 tempest-TestInstancesWithCinderVolumes-872796781 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:30:24 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-ec717256-6604-4e82-b311-905a447105a4 tempest-TestInstancesWithCinderVolumes-872796781 None] Deleted volume successfully. Sep 28 17:30:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ec717256-6604-4e82-b311-905a447105a4 tempest-TestInstancesWithCinderVolumes-872796781 None] Lock "cinder-90f04ff3-e99f-4fa5-8061-330e7989fe49-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:34 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=32,cinder:UPDATE=25,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:30:34 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=31,cinder:UPDATE=30,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:30:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:30:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:30:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:30:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:49 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:30:49 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:49 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.249s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:49 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:30:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager._thread_info {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:30:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread count: 28 {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:30:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread info: [<_MainThread(MainThread, started 132915553284224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:31:45 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-0943b460-a3c1-452f-bd1c-03cb9d50f6f9 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:31:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0943b460-a3c1-452f-bd1c-03cb9d50f6f9 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Flow 'volume_create_manager' (2907bc14-f2d7-4c52-9e4b-a1daee622e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0943b460-a3c1-452f-bd1c-03cb9d50f6f9 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7de43956-a07d-43b6-94d9-7432b9ecc72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0943b460-a3c1-452f-bd1c-03cb9d50f6f9 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7de43956-a07d-43b6-94d9-7432b9ecc72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1273803209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab929035-af71-4a61-8628-1d0ac2f90579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e95722a7f32c45a3a75f99cb6c48b87d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:46Z,use_quota=True,user_id='a414d0b637f040c7aca2222d339c7304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0943b460-a3c1-452f-bd1c-03cb9d50f6f9 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (442b747e-ba69-4d5e-9b20-8e9606829ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0943b460-a3c1-452f-bd1c-03cb9d50f6f9 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (442b747e-ba69-4d5e-9b20-8e9606829ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0943b460-a3c1-452f-bd1c-03cb9d50f6f9 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e098d5c2-81b8-4b53-859c-f6e5ee56dca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0943b460-a3c1-452f-bd1c-03cb9d50f6f9 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e098d5c2-81b8-4b53-859c-f6e5ee56dca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab929035-af71-4a61-8628-1d0ac2f90579', 'volume_name': 'volume-ab929035-af71-4a61-8628-1d0ac2f90579', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0943b460-a3c1-452f-bd1c-03cb9d50f6f9 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bdfd505-0b84-4d39-bb1c-9f840bedf8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0943b460-a3c1-452f-bd1c-03cb9d50f6f9 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bdfd505-0b84-4d39-bb1c-9f840bedf8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0943b460-a3c1-452f-bd1c-03cb9d50f6f9 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d0a7b17-3027-471e-82f3-77fd262a6a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:46 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-0943b460-a3c1-452f-bd1c-03cb9d50f6f9 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Volume ab929035-af71-4a61-8628-1d0ac2f90579: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab929035-af71-4a61-8628-1d0ac2f90579', 'volume_size': 1} Sep 28 17:31:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0943b460-a3c1-452f-bd1c-03cb9d50f6f9 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0943b460-a3c1-452f-bd1c-03cb9d50f6f9 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:46 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0943b460-a3c1-452f-bd1c-03cb9d50f6f9 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1273803209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab929035-af71-4a61-8628-1d0ac2f90579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e95722a7f32c45a3a75f99cb6c48b87d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:46Z,use_quota=True,user_id='a414d0b637f040c7aca2222d339c7304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:31:46 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-0943b460-a3c1-452f-bd1c-03cb9d50f6f9 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Creating volume ab929035-af71-4a61-8628-1d0ac2f90579 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:31:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0943b460-a3c1-452f-bd1c-03cb9d50f6f9 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0943b460-a3c1-452f-bd1c-03cb9d50f6f9 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:46 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0943b460-a3c1-452f-bd1c-03cb9d50f6f9 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:46 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0943b460-a3c1-452f-bd1c-03cb9d50f6f9 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0943b460-a3c1-452f-bd1c-03cb9d50f6f9 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:46 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0943b460-a3c1-452f-bd1c-03cb9d50f6f9 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:31:46 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-0943b460-a3c1-452f-bd1c-03cb9d50f6f9 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:31:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0943b460-a3c1-452f-bd1c-03cb9d50f6f9 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ab929035-af71-4a61-8628-1d0ac2f90579 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:46 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ab929035-af71-4a61-8628-1d0ac2f90579 1073741824 Sep 28 17:31:46 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:46 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0943b460-a3c1-452f-bd1c-03cb9d50f6f9 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ab929035-af71-4a61-8628-1d0ac2f90579 1073741824" returned: 0 in 0.425s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0943b460-a3c1-452f-bd1c-03cb9d50f6f9 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ab929035-af71-4a61-8628-1d0ac2f90579 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:46 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ab929035-af71-4a61-8628-1d0ac2f90579 Sep 28 17:31:46 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:46 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0943b460-a3c1-452f-bd1c-03cb9d50f6f9 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ab929035-af71-4a61-8628-1d0ac2f90579" returned: 0 in 0.232s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:46 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0943b460-a3c1-452f-bd1c-03cb9d50f6f9 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:31:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0943b460-a3c1-452f-bd1c-03cb9d50f6f9 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0943b460-a3c1-452f-bd1c-03cb9d50f6f9 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d0a7b17-3027-471e-82f3-77fd262a6a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab929035-af71-4a61-8628-1d0ac2f90579', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0943b460-a3c1-452f-bd1c-03cb9d50f6f9 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0b14ed-dd05-40f8-8195-63bec8fdff84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:46 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-0943b460-a3c1-452f-bd1c-03cb9d50f6f9 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Volume volume-ab929035-af71-4a61-8628-1d0ac2f90579 (ab929035-af71-4a61-8628-1d0ac2f90579): created successfully Sep 28 17:31:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0943b460-a3c1-452f-bd1c-03cb9d50f6f9 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0b14ed-dd05-40f8-8195-63bec8fdff84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:46 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0943b460-a3c1-452f-bd1c-03cb9d50f6f9 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Flow 'volume_create_manager' (2907bc14-f2d7-4c52-9e4b-a1daee622e7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:46 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-0943b460-a3c1-452f-bd1c-03cb9d50f6f9 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Created volume successfully. Sep 28 17:31:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-d2ebb7ec-44e5-4f44-846e-9a1d029f14d8 req-db88d0fa-bfd0-4e9a-99cf-c9be127408e8 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-d2ebb7ec-44e5-4f44-846e-9a1d029f14d8 req-db88d0fa-bfd0-4e9a-99cf-c9be127408e8 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-d2ebb7ec-44e5-4f44-846e-9a1d029f14d8 req-db88d0fa-bfd0-4e9a-99cf-c9be127408e8 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:47 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-d2ebb7ec-44e5-4f44-846e-9a1d029f14d8 req-db88d0fa-bfd0-4e9a-99cf-c9be127408e8 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069', 'name': 'volume-ab929035-af71-4a61-8628-1d0ac2f90579', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1502ccf8-0587-4cb4-98c1-63f9c330016a', 'enforce_multipath': True} {{(pid=86917) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:31:47 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-d2ebb7ec-44e5-4f44-846e-9a1d029f14d8 req-db88d0fa-bfd0-4e9a-99cf-c9be127408e8 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] attachment_update completed successfully. Sep 28 17:31:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:31:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:49 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:31:49 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:49 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.248s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:49 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:31:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager._thread_info {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:31:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread count: 28 {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:31:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread info: [<_MainThread(MainThread, started 132915553284224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:31:50 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-f259065e-b606-4beb-8eaa-b9763b14bb29 req-126c5c8d-a230-439b-a9f7-c9c6e7160d32 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Terminate volume connection completed successfully. Sep 28 17:31:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-f259065e-b606-4beb-8eaa-b9763b14bb29 req-126c5c8d-a230-439b-a9f7-c9c6e7160d32 tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Deleting attachment 1502ccf8-0587-4cb4-98c1-63f9c330016a. {{(pid=86917) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:31:51 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8a58be26-76a5-4427-91c2-8f3d613f4aaa tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Acquiring lock "cinder-ab929035-af71-4a61-8628-1d0ac2f90579-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:51 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8a58be26-76a5-4427-91c2-8f3d613f4aaa tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Lock "cinder-ab929035-af71-4a61-8628-1d0ac2f90579-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:51 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8a58be26-76a5-4427-91c2-8f3d613f4aaa tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Acquiring lock "cinder-quobyte-ab929035-af71-4a61-8628-1d0ac2f90579" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:51 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8a58be26-76a5-4427-91c2-8f3d613f4aaa tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Lock "cinder-quobyte-ab929035-af71-4a61-8628-1d0ac2f90579" acquired by "delete_volume" :: waited 0.021s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:51 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba1a4b3-a64a-43b6-ab3a-42d6c8729697]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8a58be26-76a5-4427-91c2-8f3d613f4aaa tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ab929035-af71-4a61-8628-1d0ac2f90579 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:51 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ab929035-af71-4a61-8628-1d0ac2f90579 Sep 28 17:31:51 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:52 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8a58be26-76a5-4427-91c2-8f3d613f4aaa tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ab929035-af71-4a61-8628-1d0ac2f90579" returned: 0 in 0.368s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8a58be26-76a5-4427-91c2-8f3d613f4aaa tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ab929035-af71-4a61-8628-1d0ac2f90579 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:52 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ab929035-af71-4a61-8628-1d0ac2f90579 Sep 28 17:31:52 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:52 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8a58be26-76a5-4427-91c2-8f3d613f4aaa tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ab929035-af71-4a61-8628-1d0ac2f90579" returned: 0 in 0.250s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:52 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8a58be26-76a5-4427-91c2-8f3d613f4aaa tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Lock "cinder-quobyte-ab929035-af71-4a61-8628-1d0ac2f90579" released by "delete_volume" :: held 0.657s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:52 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-8a58be26-76a5-4427-91c2-8f3d613f4aaa tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Created reservations ['687653b4-6412-4ca4-806c-32e2a9d3495e', '9f4d7115-765d-4b69-bec5-025f754cbca5', '24d8937b-eb94-4973-962d-09fd867c7a36', '20e47f25-9469-48c4-bc90-89127d102f4e'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:31:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8a58be26-76a5-4427-91c2-8f3d613f4aaa tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8a58be26-76a5-4427-91c2-8f3d613f4aaa tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-8a58be26-76a5-4427-91c2-8f3d613f4aaa tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-8a58be26-76a5-4427-91c2-8f3d613f4aaa tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8a58be26-76a5-4427-91c2-8f3d613f4aaa tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8a58be26-76a5-4427-91c2-8f3d613f4aaa tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:52 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:31:52 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:52 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8a58be26-76a5-4427-91c2-8f3d613f4aaa tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.272s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:52 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-8a58be26-76a5-4427-91c2-8f3d613f4aaa tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:31:52 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-8a58be26-76a5-4427-91c2-8f3d613f4aaa tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Deleted volume successfully. Sep 28 17:31:52 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8a58be26-76a5-4427-91c2-8f3d613f4aaa tempest-TestServerVolumeAttachScenarioOldVersion-984510570 None] Lock "cinder-ab929035-af71-4a61-8628-1d0ac2f90579-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:02 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:UPDATE=14,cinder:SELECT=13,cinder:INSERT=3 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:32:02 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=16,cinder:UPDATE=11,cinder:DELETE=2,cinder:INSERT=2 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:32:17 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=1 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:32:17 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:UPDATE=1 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:32:29 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:32:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Flow 'volume_create_manager' (4897229b-c8ef-4260-a78c-8aa892cc6ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:32:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949bfafa-ab6c-48d7-820a-956e86991784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949bfafa-ab6c-48d7-820a-956e86991784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1402900114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=555bcc71-230f-4038-8860-4e5e61316877,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a119723c344b03beca52887be9296f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:32:30Z,use_quota=True,user_id='bd8768615f6a4607b24ff47280c3f5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed915688-2d52-4153-838c-bf3c03ddb929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed915688-2d52-4153-838c-bf3c03ddb929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7908edba-94ed-4a0e-9a10-4b7066bf918e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:30 devstack cinder-volume[86917]: DEBUG cinder.image.glance [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Creating Keystone auth plugin from conf {{(pid=86917) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:32:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7908edba-94ed-4a0e-9a10-4b7066bf918e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '555bcc71-230f-4038-8860-4e5e61316877', 'volume_name': 'volume-555bcc71-230f-4038-8860-4e5e61316877', 'volume_size': 1, 'image_id': '19d24755-5fa8-4e1d-aef6-b5fdde452855', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19d24755-5fa8-4e1d-aef6-b5fdde452855', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '307b831956a2452b912f3a0d37f5ee84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '19d24755-5fa8-4e1d-aef6-b5fdde452855', 'created_at': datetime.datetime(2026, 9, 28, 15, 0, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 0, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19d24755-5fa8-4e1d-aef6-b5fdde452855/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceaa063e-5ed3-45e7-b71d-4223a7c76b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceaa063e-5ed3-45e7-b71d-4223a7c76b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4ecc519-02b2-457f-8a69-4e65bf30151c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:30 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Volume 555bcc71-230f-4038-8860-4e5e61316877: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-555bcc71-230f-4038-8860-4e5e61316877', 'volume_size': 1, 'image_id': '19d24755-5fa8-4e1d-aef6-b5fdde452855', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19d24755-5fa8-4e1d-aef6-b5fdde452855', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '307b831956a2452b912f3a0d37f5ee84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '19d24755-5fa8-4e1d-aef6-b5fdde452855', 'created_at': datetime.datetime(2026, 9, 28, 15, 0, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 0, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19d24755-5fa8-4e1d-aef6-b5fdde452855/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 17:32:30 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Trying to clone 555bcc71-230f-4038-8860-4e5e61316877 from image 19d24755-5fa8-4e1d-aef6-b5fdde452855 at location (None, [{'url': 'file:///opt/stack/data/glance/images/19d24755-5fa8-4e1d-aef6-b5fdde452855', 'metadata': {}}]). {{(pid=86917) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:32:30 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_v22wmgwhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86917) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:32:30 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Image download 20.69 MB at 20.69 MB/s Sep 28 17:32:30 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f20eb0d-c48e-4fa4-ac1b-f2ca693e97b5]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_v22wmgwhdevstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:30 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_v22wmgwhdevstack@QuobyteHD Sep 28 17:32:30 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:31 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_v22wmgwhdevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:31 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Temporary image 19d24755-5fa8-4e1d-aef6-b5fdde452855 is fetched for user bd8768615f6a4607b24ff47280c3f5dc. {{(pid=86917) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:32:31 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffad351d-c833-48de-bf4a-65cb7c0ea294]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_v22wmgwhdevstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:31 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_v22wmgwhdevstack@QuobyteHD Sep 28 17:32:31 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:31 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_v22wmgwhdevstack@QuobyteHD" returned: 0 in 0.324s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1402900114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=555bcc71-230f-4038-8860-4e5e61316877,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3a119723c344b03beca52887be9296f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:32:30Z,use_quota=True,user_id='bd8768615f6a4607b24ff47280c3f5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:32:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Creating volume 555bcc71-230f-4038-8860-4e5e61316877 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:32:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:32:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:32:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:32:31 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:32:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-555bcc71-230f-4038-8860-4e5e61316877 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:31 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-555bcc71-230f-4038-8860-4e5e61316877 1073741824 Sep 28 17:32:31 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:31 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-555bcc71-230f-4038-8860-4e5e61316877 1073741824" returned: 0 in 0.413s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-555bcc71-230f-4038-8860-4e5e61316877 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:32 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-555bcc71-230f-4038-8860-4e5e61316877 Sep 28 17:32:32 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:32 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-555bcc71-230f-4038-8860-4e5e61316877" returned: 0 in 0.259s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:32:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:32 devstack cinder-volume[86917]: DEBUG cinder.volume.volume_utils [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Attempting download of 19d24755-5fa8-4e1d-aef6-b5fdde452855 ((None, [{'url': 'file:///opt/stack/data/glance/images/19d24755-5fa8-4e1d-aef6-b5fdde452855', 'metadata': {}}])) to volume 555bcc71-230f-4038-8860-4e5e61316877. {{(pid=86917) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:32:32 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[598eedc7-a633-4d72-96fc-1ad3329b9521]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19d24755-5fa8-4e1d-aef6-b5fdde452855_ozawuj6n {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:32 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19d24755-5fa8-4e1d-aef6-b5fdde452855_ozawuj6n Sep 28 17:32:32 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:32 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19d24755-5fa8-4e1d-aef6-b5fdde452855_ozawuj6n" returned: 0 in 0.334s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19d24755-5fa8-4e1d-aef6-b5fdde452855_ozawuj6n {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:32 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19d24755-5fa8-4e1d-aef6-b5fdde452855_ozawuj6n Sep 28 17:32:32 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:33 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19d24755-5fa8-4e1d-aef6-b5fdde452855_ozawuj6n" returned: 1 in 0.336s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19d24755-5fa8-4e1d-aef6-b5fdde452855_ozawuj6n' failed. Not Retrying. {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:32:33 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8daa1dd5-0968-4d95-94e1-6ce4c4668355]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_v22wmgwhdevstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:33 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_v22wmgwhdevstack@QuobyteHD Sep 28 17:32:33 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:33 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_v22wmgwhdevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:33 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] 19d24755-5fa8-4e1d-aef6-b5fdde452855 was qcow2, converting to qcow2 {{(pid=86917) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:32:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_v22wmgwhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-555bcc71-230f-4038-8860-4e5e61316877 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:33 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_v22wmgwhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-555bcc71-230f-4038-8860-4e5e61316877 Sep 28 17:32:33 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:35 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_v22wmgwhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-555bcc71-230f-4038-8860-4e5e61316877" returned: 0 in 1.859s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:35 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_19d24755-5fa8-4e1d-aef6-b5fdde452855_v22wmgwhdevstack@QuobyteHD, size 112.00 MB, duration 1.86 sec, destination /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-555bcc71-230f-4038-8860-4e5e61316877 {{(pid=86917) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:32:35 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Converted 112.00 MB image at 60.21 MB/s Sep 28 17:32:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-555bcc71-230f-4038-8860-4e5e61316877 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:35 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-555bcc71-230f-4038-8860-4e5e61316877 1G Sep 28 17:32:35 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:35 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-555bcc71-230f-4038-8860-4e5e61316877 1G" returned: 0 in 0.340s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:35 devstack cinder-volume[86917]: DEBUG cinder.volume.volume_utils [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Downloaded image 19d24755-5fa8-4e1d-aef6-b5fdde452855 ((None, [{'url': 'file:///opt/stack/data/glance/images/19d24755-5fa8-4e1d-aef6-b5fdde452855', 'metadata': {}}])) to volume 555bcc71-230f-4038-8860-4e5e61316877 successfully. {{(pid=86917) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:32:35 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Temporary image 19d24755-5fa8-4e1d-aef6-b5fdde452855 for user bd8768615f6a4607b24ff47280c3f5dc is deleted. {{(pid=86917) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:32:35 devstack cinder-volume[86917]: DEBUG cinder.volume.volume_utils [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Marking volume 555bcc71-230f-4038-8860-4e5e61316877 as bootable. {{(pid=86917) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:32:35 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Copying metadata from image 19d24755-5fa8-4e1d-aef6-b5fdde452855 to 555bcc71-230f-4038-8860-4e5e61316877. {{(pid=86917) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:32:35 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Creating volume glance metadata for volume 555bcc71-230f-4038-8860-4e5e61316877 backed by image 19d24755-5fa8-4e1d-aef6-b5fdde452855 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '19d24755-5fa8-4e1d-aef6-b5fdde452855', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86917) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:32:35 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4ecc519-02b2-457f-8a69-4e65bf30151c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-555bcc71-230f-4038-8860-4e5e61316877', 'volume_size': 1, 'image_id': '19d24755-5fa8-4e1d-aef6-b5fdde452855', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19d24755-5fa8-4e1d-aef6-b5fdde452855', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '307b831956a2452b912f3a0d37f5ee84', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '19d24755-5fa8-4e1d-aef6-b5fdde452855', 'created_at': datetime.datetime(2026, 9, 28, 15, 0, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 0, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19d24755-5fa8-4e1d-aef6-b5fdde452855/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:35 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a7cf80-1235-463f-a672-86cbe63221c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:35 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Volume volume-555bcc71-230f-4038-8860-4e5e61316877 (555bcc71-230f-4038-8860-4e5e61316877): created successfully Sep 28 17:32:35 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a7cf80-1235-463f-a672-86cbe63221c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:35 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Flow 'volume_create_manager' (4897229b-c8ef-4260-a78c-8aa892cc6ee3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:32:35 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-bb1d89dd-988b-4802-8473-76d793c17621 tempest-TestShelveInstance-336721030 None] Created volume successfully. Sep 28 17:32:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-9e008b4b-6582-4998-8ab9-a22d385b6d87 req-240becb3-c59b-4da5-930a-40e7ebe9b0e7 tempest-TestShelveInstance-336721030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-9e008b4b-6582-4998-8ab9-a22d385b6d87 req-240becb3-c59b-4da5-930a-40e7ebe9b0e7 tempest-TestShelveInstance-336721030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-9e008b4b-6582-4998-8ab9-a22d385b6d87 req-240becb3-c59b-4da5-930a-40e7ebe9b0e7 tempest-TestShelveInstance-336721030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-9e008b4b-6582-4998-8ab9-a22d385b6d87 req-240becb3-c59b-4da5-930a-40e7ebe9b0e7 tempest-TestShelveInstance-336721030 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069', 'name': 'volume-555bcc71-230f-4038-8860-4e5e61316877', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e8bc34db-7927-487b-9002-65f9b31a8035', 'enforce_multipath': True} {{(pid=86917) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:32:38 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-9e008b4b-6582-4998-8ab9-a22d385b6d87 req-240becb3-c59b-4da5-930a-40e7ebe9b0e7 tempest-TestShelveInstance-336721030 None] attachment_update completed successfully. Sep 28 17:32:48 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:UPDATE=6,cinder:SELECT=15,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:32:48 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=17,cinder:UPDATE=6,cinder:INSERT=9 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:32:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:32:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:32:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:32:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:49 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:32:49 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:49 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.260s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:49 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:32:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager._thread_info {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:32:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread count: 28 {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:32:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread info: [<_MainThread(MainThread, started 132915553284224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:33:13 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-1adb88f1-e5c6-409f-b432-e0438e4b5b2b req-697c90d5-e0b8-4891-8266-23a74d2dad4c tempest-TestShelveInstance-336721030 None] Terminate volume connection completed successfully. Sep 28 17:33:13 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-1adb88f1-e5c6-409f-b432-e0438e4b5b2b req-697c90d5-e0b8-4891-8266-23a74d2dad4c tempest-TestShelveInstance-336721030 None] Deleting attachment e8bc34db-7927-487b-9002-65f9b31a8035. {{(pid=86917) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:33:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-06fd711e-4569-4219-a1fb-afcd68aa8b3b req-fe4c0b35-c1a0-4479-8930-3aec60b9ddff tempest-TestShelveInstance-336721030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:33:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-06fd711e-4569-4219-a1fb-afcd68aa8b3b req-fe4c0b35-c1a0-4479-8930-3aec60b9ddff tempest-TestShelveInstance-336721030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:33:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-06fd711e-4569-4219-a1fb-afcd68aa8b3b req-fe4c0b35-c1a0-4479-8930-3aec60b9ddff tempest-TestShelveInstance-336721030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:33:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-06fd711e-4569-4219-a1fb-afcd68aa8b3b req-fe4c0b35-c1a0-4479-8930-3aec60b9ddff tempest-TestShelveInstance-336721030 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069', 'name': 'volume-555bcc71-230f-4038-8860-4e5e61316877', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '79c94afb-c54b-4d3f-a36b-4f28b69454f0', 'enforce_multipath': True} {{(pid=86917) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:33:15 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-06fd711e-4569-4219-a1fb-afcd68aa8b3b req-fe4c0b35-c1a0-4479-8930-3aec60b9ddff tempest-TestShelveInstance-336721030 None] attachment_update completed successfully. Sep 28 17:33:25 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:33:25 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=9 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:33:47 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-0193a58a-e2b4-4ddd-883f-6218d9a375d8 req-8fc42074-af99-44e0-9025-0c42ad138e7f tempest-TestShelveInstance-336721030 None] Terminate volume connection completed successfully. Sep 28 17:33:47 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [req-0193a58a-e2b4-4ddd-883f-6218d9a375d8 req-8fc42074-af99-44e0-9025-0c42ad138e7f tempest-TestShelveInstance-336721030 None] Deleting attachment 79c94afb-c54b-4d3f-a36b-4f28b69454f0. {{(pid=86917) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:33:48 devstack cinder-volume[86917]: DEBUG cinder.coordination [req-0193a58a-e2b4-4ddd-883f-6218d9a375d8 req-c748e28b-3088-4915-9b58-094de5f88615 tempest-TestShelveInstance-336721030 None] Acquiring lock "cinder-555bcc71-230f-4038-8860-4e5e61316877-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:33:48 devstack cinder-volume[86917]: DEBUG cinder.coordination [req-0193a58a-e2b4-4ddd-883f-6218d9a375d8 req-c748e28b-3088-4915-9b58-094de5f88615 tempest-TestShelveInstance-336721030 None] Lock "cinder-555bcc71-230f-4038-8860-4e5e61316877-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:48 devstack cinder-volume[86917]: DEBUG cinder.coordination [req-0193a58a-e2b4-4ddd-883f-6218d9a375d8 req-c748e28b-3088-4915-9b58-094de5f88615 tempest-TestShelveInstance-336721030 None] Acquiring lock "cinder-quobyte-555bcc71-230f-4038-8860-4e5e61316877" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:33:48 devstack cinder-volume[86917]: DEBUG cinder.coordination [req-0193a58a-e2b4-4ddd-883f-6218d9a375d8 req-c748e28b-3088-4915-9b58-094de5f88615 tempest-TestShelveInstance-336721030 None] Lock "cinder-quobyte-555bcc71-230f-4038-8860-4e5e61316877" acquired by "delete_volume" :: waited 0.020s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:48 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bcbcb9-1371-410c-a84b-f21045bfc148]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:33:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-0193a58a-e2b4-4ddd-883f-6218d9a375d8 req-c748e28b-3088-4915-9b58-094de5f88615 tempest-TestShelveInstance-336721030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-555bcc71-230f-4038-8860-4e5e61316877 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:48 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-555bcc71-230f-4038-8860-4e5e61316877 Sep 28 17:33:48 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:48 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-0193a58a-e2b4-4ddd-883f-6218d9a375d8 req-c748e28b-3088-4915-9b58-094de5f88615 tempest-TestShelveInstance-336721030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-555bcc71-230f-4038-8860-4e5e61316877" returned: 0 in 0.393s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-0193a58a-e2b4-4ddd-883f-6218d9a375d8 req-c748e28b-3088-4915-9b58-094de5f88615 tempest-TestShelveInstance-336721030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-555bcc71-230f-4038-8860-4e5e61316877 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:48 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-555bcc71-230f-4038-8860-4e5e61316877 Sep 28 17:33:48 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:48 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-0193a58a-e2b4-4ddd-883f-6218d9a375d8 req-c748e28b-3088-4915-9b58-094de5f88615 tempest-TestShelveInstance-336721030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-555bcc71-230f-4038-8860-4e5e61316877" returned: 0 in 0.325s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:48 devstack cinder-volume[86917]: DEBUG cinder.coordination [req-0193a58a-e2b4-4ddd-883f-6218d9a375d8 req-c748e28b-3088-4915-9b58-094de5f88615 tempest-TestShelveInstance-336721030 None] Lock "cinder-quobyte-555bcc71-230f-4038-8860-4e5e61316877" released by "delete_volume" :: held 0.767s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:48 devstack cinder-volume[86917]: DEBUG cinder.quota [req-0193a58a-e2b4-4ddd-883f-6218d9a375d8 req-c748e28b-3088-4915-9b58-094de5f88615 tempest-TestShelveInstance-336721030 None] Created reservations ['debb6934-b10a-4826-9c59-96aaec461731', '24d3b5a7-2f4c-40b6-8bf0-3e8c44720d23', '7600d9c8-479a-45fd-9662-8b20ec318aa6', 'e501769d-7d24-4b63-ab09-e57cc5091a8c'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:33:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-0193a58a-e2b4-4ddd-883f-6218d9a375d8 req-c748e28b-3088-4915-9b58-094de5f88615 tempest-TestShelveInstance-336721030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:33:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-0193a58a-e2b4-4ddd-883f-6218d9a375d8 req-c748e28b-3088-4915-9b58-094de5f88615 tempest-TestShelveInstance-336721030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:33:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [req-0193a58a-e2b4-4ddd-883f-6218d9a375d8 req-c748e28b-3088-4915-9b58-094de5f88615 tempest-TestShelveInstance-336721030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:33:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [req-0193a58a-e2b4-4ddd-883f-6218d9a375d8 req-c748e28b-3088-4915-9b58-094de5f88615 tempest-TestShelveInstance-336721030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:33:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [req-0193a58a-e2b4-4ddd-883f-6218d9a375d8 req-c748e28b-3088-4915-9b58-094de5f88615 tempest-TestShelveInstance-336721030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:33:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-0193a58a-e2b4-4ddd-883f-6218d9a375d8 req-c748e28b-3088-4915-9b58-094de5f88615 tempest-TestShelveInstance-336721030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:49 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:33:49 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:49 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [req-0193a58a-e2b4-4ddd-883f-6218d9a375d8 req-c748e28b-3088-4915-9b58-094de5f88615 tempest-TestShelveInstance-336721030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.322s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:49 devstack cinder-volume[86917]: DEBUG cinder.manager [req-0193a58a-e2b4-4ddd-883f-6218d9a375d8 req-c748e28b-3088-4915-9b58-094de5f88615 tempest-TestShelveInstance-336721030 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:33:49 devstack cinder-volume[86917]: INFO cinder.volume.manager [req-0193a58a-e2b4-4ddd-883f-6218d9a375d8 req-c748e28b-3088-4915-9b58-094de5f88615 tempest-TestShelveInstance-336721030 None] Deleted volume successfully. Sep 28 17:33:49 devstack cinder-volume[86917]: DEBUG cinder.coordination [req-0193a58a-e2b4-4ddd-883f-6218d9a375d8 req-c748e28b-3088-4915-9b58-094de5f88615 tempest-TestShelveInstance-336721030 None] Lock "cinder-555bcc71-230f-4038-8860-4e5e61316877-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:33:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:33:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:33:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:33:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:33:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:33:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:49 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:33:49 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:49 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.289s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:49 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:33:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager._thread_info {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:33:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread count: 28 {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:33:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread info: [<_MainThread(MainThread, started 132915553284224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:33:58 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8,cinder:INSERT=1 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:33:59 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:34:17 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=1 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:34:17 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:UPDATE=1 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:34:20 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ce42515-f7c2-4b00-abfd-cd2f7b70eef0 tempest-TestImageHashVerification-829052434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:34:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-8ce42515-f7c2-4b00-abfd-cd2f7b70eef0 tempest-TestImageHashVerification-829052434 None] Flow 'volume_create_manager' (ba50eaba-bd00-416d-a637-4cce0e6acbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:34:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-8ce42515-f7c2-4b00-abfd-cd2f7b70eef0 tempest-TestImageHashVerification-829052434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6905944a-0de0-4652-88d9-36855dd1971a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:34:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-8ce42515-f7c2-4b00-abfd-cd2f7b70eef0 tempest-TestImageHashVerification-829052434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6905944a-0de0-4652-88d9-36855dd1971a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-267764737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aef7e2b-5c60-49a2-95b4-3bbade4ed498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4357bb4c5441629f049b0ad6b966d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:34:20Z,use_quota=True,user_id='0384d458a2134dc7994f14376a98ce08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:34:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-8ce42515-f7c2-4b00-abfd-cd2f7b70eef0 tempest-TestImageHashVerification-829052434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60cefd2d-1c07-45f1-b942-dc90d5d55c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:34:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-8ce42515-f7c2-4b00-abfd-cd2f7b70eef0 tempest-TestImageHashVerification-829052434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60cefd2d-1c07-45f1-b942-dc90d5d55c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:34:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-8ce42515-f7c2-4b00-abfd-cd2f7b70eef0 tempest-TestImageHashVerification-829052434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0ec2c19-2bce-4263-916c-3ee1634760f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:34:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-8ce42515-f7c2-4b00-abfd-cd2f7b70eef0 tempest-TestImageHashVerification-829052434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0ec2c19-2bce-4263-916c-3ee1634760f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5aef7e2b-5c60-49a2-95b4-3bbade4ed498', 'volume_name': 'volume-5aef7e2b-5c60-49a2-95b4-3bbade4ed498', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:34:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-8ce42515-f7c2-4b00-abfd-cd2f7b70eef0 tempest-TestImageHashVerification-829052434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fabcd79-dbd7-47c8-ae20-1eb91605b9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:34:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-8ce42515-f7c2-4b00-abfd-cd2f7b70eef0 tempest-TestImageHashVerification-829052434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fabcd79-dbd7-47c8-ae20-1eb91605b9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:34:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-8ce42515-f7c2-4b00-abfd-cd2f7b70eef0 tempest-TestImageHashVerification-829052434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81447c22-f69c-4502-a12e-9ccc2f97d894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:34:20 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-8ce42515-f7c2-4b00-abfd-cd2f7b70eef0 tempest-TestImageHashVerification-829052434 None] Volume 5aef7e2b-5c60-49a2-95b4-3bbade4ed498: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5aef7e2b-5c60-49a2-95b4-3bbade4ed498', 'volume_size': 1} Sep 28 17:34:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8ce42515-f7c2-4b00-abfd-cd2f7b70eef0 tempest-TestImageHashVerification-829052434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:34:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8ce42515-f7c2-4b00-abfd-cd2f7b70eef0 tempest-TestImageHashVerification-829052434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:34:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-8ce42515-f7c2-4b00-abfd-cd2f7b70eef0 tempest-TestImageHashVerification-829052434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-267764737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aef7e2b-5c60-49a2-95b4-3bbade4ed498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4357bb4c5441629f049b0ad6b966d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:34:20Z,use_quota=True,user_id='0384d458a2134dc7994f14376a98ce08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:34:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-8ce42515-f7c2-4b00-abfd-cd2f7b70eef0 tempest-TestImageHashVerification-829052434 None] Creating volume 5aef7e2b-5c60-49a2-95b4-3bbade4ed498 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:34:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8ce42515-f7c2-4b00-abfd-cd2f7b70eef0 tempest-TestImageHashVerification-829052434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:34:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8ce42515-f7c2-4b00-abfd-cd2f7b70eef0 tempest-TestImageHashVerification-829052434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:34:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-8ce42515-f7c2-4b00-abfd-cd2f7b70eef0 tempest-TestImageHashVerification-829052434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:34:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-8ce42515-f7c2-4b00-abfd-cd2f7b70eef0 tempest-TestImageHashVerification-829052434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:34:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8ce42515-f7c2-4b00-abfd-cd2f7b70eef0 tempest-TestImageHashVerification-829052434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:34:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-8ce42515-f7c2-4b00-abfd-cd2f7b70eef0 tempest-TestImageHashVerification-829052434 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:34:20 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-8ce42515-f7c2-4b00-abfd-cd2f7b70eef0 tempest-TestImageHashVerification-829052434 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:34:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8ce42515-f7c2-4b00-abfd-cd2f7b70eef0 tempest-TestImageHashVerification-829052434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5aef7e2b-5c60-49a2-95b4-3bbade4ed498 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:34:20 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5aef7e2b-5c60-49a2-95b4-3bbade4ed498 1073741824 Sep 28 17:34:20 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:34:20 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Sep 28 17:34:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8ce42515-f7c2-4b00-abfd-cd2f7b70eef0 tempest-TestImageHashVerification-829052434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5aef7e2b-5c60-49a2-95b4-3bbade4ed498 1073741824" returned: 0 in 0.445s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:34:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8ce42515-f7c2-4b00-abfd-cd2f7b70eef0 tempest-TestImageHashVerification-829052434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5aef7e2b-5c60-49a2-95b4-3bbade4ed498 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:34:20 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5aef7e2b-5c60-49a2-95b4-3bbade4ed498 Sep 28 17:34:20 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:34:20 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Sep 28 17:34:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8ce42515-f7c2-4b00-abfd-cd2f7b70eef0 tempest-TestImageHashVerification-829052434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5aef7e2b-5c60-49a2-95b4-3bbade4ed498" returned: 0 in 0.246s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:34:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-8ce42515-f7c2-4b00-abfd-cd2f7b70eef0 tempest-TestImageHashVerification-829052434 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:34:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8ce42515-f7c2-4b00-abfd-cd2f7b70eef0 tempest-TestImageHashVerification-829052434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:34:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-8ce42515-f7c2-4b00-abfd-cd2f7b70eef0 tempest-TestImageHashVerification-829052434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81447c22-f69c-4502-a12e-9ccc2f97d894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5aef7e2b-5c60-49a2-95b4-3bbade4ed498', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:34:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-8ce42515-f7c2-4b00-abfd-cd2f7b70eef0 tempest-TestImageHashVerification-829052434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3506443-85e9-4f11-bf25-d002a3e3b012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:34:21 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-8ce42515-f7c2-4b00-abfd-cd2f7b70eef0 tempest-TestImageHashVerification-829052434 None] Volume volume-5aef7e2b-5c60-49a2-95b4-3bbade4ed498 (5aef7e2b-5c60-49a2-95b4-3bbade4ed498): created successfully Sep 28 17:34:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-8ce42515-f7c2-4b00-abfd-cd2f7b70eef0 tempest-TestImageHashVerification-829052434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3506443-85e9-4f11-bf25-d002a3e3b012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:34:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-8ce42515-f7c2-4b00-abfd-cd2f7b70eef0 tempest-TestImageHashVerification-829052434 None] Flow 'volume_create_manager' (ba50eaba-bd00-416d-a637-4cce0e6acbdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:34:21 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-8ce42515-f7c2-4b00-abfd-cd2f7b70eef0 tempest-TestImageHashVerification-829052434 None] Created volume successfully. Sep 28 17:34:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-fada09d9-461e-4a04-bfc8-e03f62e0f301 tempest-TestImageHashVerification-829052434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:34:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-fada09d9-461e-4a04-bfc8-e03f62e0f301 tempest-TestImageHashVerification-829052434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:34:23 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2267a241-4b0d-45e2-94a8-5542f1a3296b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:34:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fada09d9-461e-4a04-bfc8-e03f62e0f301 tempest-TestImageHashVerification-829052434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5aef7e2b-5c60-49a2-95b4-3bbade4ed498 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:34:23 devstack sudo[107530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5aef7e2b-5c60-49a2-95b4-3bbade4ed498 Sep 28 17:34:23 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:34:23 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root Sep 28 17:34:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fada09d9-461e-4a04-bfc8-e03f62e0f301 tempest-TestImageHashVerification-829052434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5aef7e2b-5c60-49a2-95b4-3bbade4ed498" returned: 0 in 0.387s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:34:23 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c48bb50-4e26-4e49-b5dd-950d0dc6808e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:34:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fada09d9-461e-4a04-bfc8-e03f62e0f301 tempest-TestImageHashVerification-829052434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5aef7e2b-5c60-49a2-95b4-3bbade4ed498 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:34:23 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5aef7e2b-5c60-49a2-95b4-3bbade4ed498 Sep 28 17:34:23 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:34:23 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Sep 28 17:34:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fada09d9-461e-4a04-bfc8-e03f62e0f301 tempest-TestImageHashVerification-829052434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5aef7e2b-5c60-49a2-95b4-3bbade4ed498" returned: 0 in 0.349s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:34:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fada09d9-461e-4a04-bfc8-e03f62e0f301 tempest-TestImageHashVerification-829052434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5aef7e2b-5c60-49a2-95b4-3bbade4ed498 /opt/stack/data/cinder/conversion/5aef7e2b-5c60-49a2-95b4-3bbade4ed498.temp_image.54956cca-1465-4c1f-8ae8-9810f051c898kswz1yuw.img {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:34:23 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5aef7e2b-5c60-49a2-95b4-3bbade4ed498 /opt/stack/data/cinder/conversion/5aef7e2b-5c60-49a2-95b4-3bbade4ed498.temp_image.54956cca-1465-4c1f-8ae8-9810f051c898kswz1yuw.img Sep 28 17:34:23 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:34:29 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Sep 28 17:34:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fada09d9-461e-4a04-bfc8-e03f62e0f301 tempest-TestImageHashVerification-829052434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5aef7e2b-5c60-49a2-95b4-3bbade4ed498 /opt/stack/data/cinder/conversion/5aef7e2b-5c60-49a2-95b4-3bbade4ed498.temp_image.54956cca-1465-4c1f-8ae8-9810f051c898kswz1yuw.img" returned: 0 in 5.870s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:34:29 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9168958e-0c65-4693-af0f-8bef57460fb7]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:34:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fada09d9-461e-4a04-bfc8-e03f62e0f301 tempest-TestImageHashVerification-829052434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5aef7e2b-5c60-49a2-95b4-3bbade4ed498 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:34:29 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5aef7e2b-5c60-49a2-95b4-3bbade4ed498 Sep 28 17:34:29 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:34:30 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Sep 28 17:34:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fada09d9-461e-4a04-bfc8-e03f62e0f301 tempest-TestImageHashVerification-829052434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5aef7e2b-5c60-49a2-95b4-3bbade4ed498" returned: 0 in 0.554s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:34:30 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-fada09d9-461e-4a04-bfc8-e03f62e0f301 tempest-TestImageHashVerification-829052434 None] Image conversion details: src /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5aef7e2b-5c60-49a2-95b4-3bbade4ed498, size 1024.00 MB, duration 5.87 sec, destination /opt/stack/data/cinder/conversion/5aef7e2b-5c60-49a2-95b4-3bbade4ed498.temp_image.54956cca-1465-4c1f-8ae8-9810f051c898kswz1yuw.img {{(pid=86917) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:34:30 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-fada09d9-461e-4a04-bfc8-e03f62e0f301 tempest-TestImageHashVerification-829052434 None] Converted 1024.00 MB image at 174.41 MB/s Sep 28 17:34:30 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-fada09d9-461e-4a04-bfc8-e03f62e0f301 tempest-TestImageHashVerification-829052434 None] 54956cca-1465-4c1f-8ae8-9810f051c898 was raw, no need to convert to raw {{(pid=86917) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 17:34:33 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:UPDATE=3,cinder:SELECT=3 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:34:40 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:34:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-fada09d9-461e-4a04-bfc8-e03f62e0f301 tempest-TestImageHashVerification-829052434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.362s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:34:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-fada09d9-461e-4a04-bfc8-e03f62e0f301 tempest-TestImageHashVerification-829052434 None] Uploaded volume to glance image-id: 54956cca-1465-4c1f-8ae8-9810f051c898. {{(pid=86917) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 17:34:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:34:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:34:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:34:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:34:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:34:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:34:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:34:49 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-fada09d9-461e-4a04-bfc8-e03f62e0f301 tempest-TestImageHashVerification-829052434 None] Copy volume to image completed successfully. Sep 28 17:34:49 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:34:49 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:34:49 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Sep 28 17:34:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.249s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:34:49 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:34:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager._thread_info {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:34:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread count: 28 {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:34:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread info: [<_MainThread(MainThread, started 132915553284224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:34:50 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-bed536d1-f93d-4043-ae8e-43572fc2dc83 tempest-TestImageHashVerification-829052434 None] Acquiring lock "cinder-5aef7e2b-5c60-49a2-95b4-3bbade4ed498-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:34:50 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-bed536d1-f93d-4043-ae8e-43572fc2dc83 tempest-TestImageHashVerification-829052434 None] Lock "cinder-5aef7e2b-5c60-49a2-95b4-3bbade4ed498-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:34:50 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-bed536d1-f93d-4043-ae8e-43572fc2dc83 tempest-TestImageHashVerification-829052434 None] Acquiring lock "cinder-quobyte-5aef7e2b-5c60-49a2-95b4-3bbade4ed498" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:34:50 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-bed536d1-f93d-4043-ae8e-43572fc2dc83 tempest-TestImageHashVerification-829052434 None] Lock "cinder-quobyte-5aef7e2b-5c60-49a2-95b4-3bbade4ed498" acquired by "delete_volume" :: waited 0.015s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:34:50 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c655f9a-e9bc-4738-b8db-6bab3bb1b3c8]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:34:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bed536d1-f93d-4043-ae8e-43572fc2dc83 tempest-TestImageHashVerification-829052434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5aef7e2b-5c60-49a2-95b4-3bbade4ed498 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:34:50 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5aef7e2b-5c60-49a2-95b4-3bbade4ed498 Sep 28 17:34:50 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:34:51 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Sep 28 17:34:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bed536d1-f93d-4043-ae8e-43572fc2dc83 tempest-TestImageHashVerification-829052434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5aef7e2b-5c60-49a2-95b4-3bbade4ed498" returned: 0 in 0.390s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:34:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bed536d1-f93d-4043-ae8e-43572fc2dc83 tempest-TestImageHashVerification-829052434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5aef7e2b-5c60-49a2-95b4-3bbade4ed498 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:34:51 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5aef7e2b-5c60-49a2-95b4-3bbade4ed498 Sep 28 17:34:51 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:34:51 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Sep 28 17:34:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bed536d1-f93d-4043-ae8e-43572fc2dc83 tempest-TestImageHashVerification-829052434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-5aef7e2b-5c60-49a2-95b4-3bbade4ed498" returned: 0 in 0.253s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:34:51 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-bed536d1-f93d-4043-ae8e-43572fc2dc83 tempest-TestImageHashVerification-829052434 None] Lock "cinder-quobyte-5aef7e2b-5c60-49a2-95b4-3bbade4ed498" released by "delete_volume" :: held 0.683s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:34:51 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-bed536d1-f93d-4043-ae8e-43572fc2dc83 tempest-TestImageHashVerification-829052434 None] Created reservations ['f3e30f40-99d4-4729-b29a-45b3093be5d2', '117dc6f4-aae5-4391-83a0-87e61c841703', '6492be0f-3759-4a84-b5ac-d28bcb21c6b1', '24ee6899-6901-4bad-88b5-f07ec3fbd155'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:34:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-bed536d1-f93d-4043-ae8e-43572fc2dc83 tempest-TestImageHashVerification-829052434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:34:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-bed536d1-f93d-4043-ae8e-43572fc2dc83 tempest-TestImageHashVerification-829052434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:34:51 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-bed536d1-f93d-4043-ae8e-43572fc2dc83 tempest-TestImageHashVerification-829052434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:34:51 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-bed536d1-f93d-4043-ae8e-43572fc2dc83 tempest-TestImageHashVerification-829052434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:34:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-bed536d1-f93d-4043-ae8e-43572fc2dc83 tempest-TestImageHashVerification-829052434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:34:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bed536d1-f93d-4043-ae8e-43572fc2dc83 tempest-TestImageHashVerification-829052434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:34:51 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:34:51 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:34:51 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Sep 28 17:34:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bed536d1-f93d-4043-ae8e-43572fc2dc83 tempest-TestImageHashVerification-829052434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.260s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:34:51 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-bed536d1-f93d-4043-ae8e-43572fc2dc83 tempest-TestImageHashVerification-829052434 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:34:51 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-bed536d1-f93d-4043-ae8e-43572fc2dc83 tempest-TestImageHashVerification-829052434 None] Deleted volume successfully. Sep 28 17:34:51 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-bed536d1-f93d-4043-ae8e-43572fc2dc83 tempest-TestImageHashVerification-829052434 None] Lock "cinder-5aef7e2b-5c60-49a2-95b4-3bbade4ed498-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:01 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:UPDATE=7,cinder:SELECT=6,cinder:INSERT=2 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:35:01 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:35:15 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-54041b80-e842-406d-9cb9-6792c903c596 tempest-CreateVolumesFromSnapshotTest-556144415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:35:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-54041b80-e842-406d-9cb9-6792c903c596 tempest-CreateVolumesFromSnapshotTest-556144415 None] Flow 'volume_create_manager' (1c4e52a6-f5f4-4294-a1e2-dc30aed77e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-54041b80-e842-406d-9cb9-6792c903c596 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a70af53-5e78-4121-94ea-b3dcb69fde57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:15 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-78051a87-05e4-48f5-bcec-b0fe11ccfcf7 tempest-CreateVolumesFromImageTest-192687972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:35:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-78051a87-05e4-48f5-bcec-b0fe11ccfcf7 tempest-CreateVolumesFromImageTest-192687972 None] Flow 'volume_create_manager' (9d8ac064-ccd4-47ee-bee4-d5c000a97ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-78051a87-05e4-48f5-bcec-b0fe11ccfcf7 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94beb24d-fe30-4162-a41c-957a51135388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-54041b80-e842-406d-9cb9-6792c903c596 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a70af53-5e78-4121-94ea-b3dcb69fde57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1593903426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c16e5d7-4f44-4277-ba04-fb6134e5291b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e31a8b9f98504508bbf6f0f6308f704d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:15Z,use_quota=True,user_id='53248b61305f4b41a36ac533bdced5e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-54041b80-e842-406d-9cb9-6792c903c596 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02fa4a24-e1f4-4d34-9125-1f3e491db184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-54041b80-e842-406d-9cb9-6792c903c596 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02fa4a24-e1f4-4d34-9125-1f3e491db184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-54041b80-e842-406d-9cb9-6792c903c596 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf02faad-9e07-465d-a2db-6546e4488960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-54041b80-e842-406d-9cb9-6792c903c596 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf02faad-9e07-465d-a2db-6546e4488960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c16e5d7-4f44-4277-ba04-fb6134e5291b', 'volume_name': 'volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-54041b80-e842-406d-9cb9-6792c903c596 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d38eda-2ca6-437b-bb7a-1c6920bce8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-54041b80-e842-406d-9cb9-6792c903c596 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d38eda-2ca6-437b-bb7a-1c6920bce8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-54041b80-e842-406d-9cb9-6792c903c596 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85230e36-4abd-4c75-a859-f817a9bdd616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:15 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-54041b80-e842-406d-9cb9-6792c903c596 tempest-CreateVolumesFromSnapshotTest-556144415 None] Volume 0c16e5d7-4f44-4277-ba04-fb6134e5291b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b', 'volume_size': 1} Sep 28 17:35:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-54041b80-e842-406d-9cb9-6792c903c596 tempest-CreateVolumesFromSnapshotTest-556144415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-54041b80-e842-406d-9cb9-6792c903c596 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:15 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-54041b80-e842-406d-9cb9-6792c903c596 tempest-CreateVolumesFromSnapshotTest-556144415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1593903426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c16e5d7-4f44-4277-ba04-fb6134e5291b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e31a8b9f98504508bbf6f0f6308f704d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:15Z,use_quota=True,user_id='53248b61305f4b41a36ac533bdced5e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:35:15 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-54041b80-e842-406d-9cb9-6792c903c596 tempest-CreateVolumesFromSnapshotTest-556144415 None] Creating volume 0c16e5d7-4f44-4277-ba04-fb6134e5291b {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:35:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-54041b80-e842-406d-9cb9-6792c903c596 tempest-CreateVolumesFromSnapshotTest-556144415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-54041b80-e842-406d-9cb9-6792c903c596 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:15 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-54041b80-e842-406d-9cb9-6792c903c596 tempest-CreateVolumesFromSnapshotTest-556144415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:15 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-54041b80-e842-406d-9cb9-6792c903c596 tempest-CreateVolumesFromSnapshotTest-556144415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-54041b80-e842-406d-9cb9-6792c903c596 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:15 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-54041b80-e842-406d-9cb9-6792c903c596 tempest-CreateVolumesFromSnapshotTest-556144415 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:35:15 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-54041b80-e842-406d-9cb9-6792c903c596 tempest-CreateVolumesFromSnapshotTest-556144415 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:35:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-54041b80-e842-406d-9cb9-6792c903c596 tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-78051a87-05e4-48f5-bcec-b0fe11ccfcf7 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94beb24d-fe30-4162-a41c-957a51135388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-84422283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9a0b6a1-31e7-463f-a633-34e21d08ebd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4874c78ae548df9c92c97e9d5b9d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:15Z,use_quota=True,user_id='c3c29c44bace42759ede43ac12bea36a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:15 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b 1073741824 Sep 28 17:35:15 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-78051a87-05e4-48f5-bcec-b0fe11ccfcf7 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d49e9130-f6bd-45e6-96d0-ae9f4be74104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-78051a87-05e4-48f5-bcec-b0fe11ccfcf7 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d49e9130-f6bd-45e6-96d0-ae9f4be74104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-78051a87-05e4-48f5-bcec-b0fe11ccfcf7 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09b56b72-aef8-4d5f-8f32-3f5e6831a8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-78051a87-05e4-48f5-bcec-b0fe11ccfcf7 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09b56b72-aef8-4d5f-8f32-3f5e6831a8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9a0b6a1-31e7-463f-a633-34e21d08ebd7', 'volume_name': 'volume-e9a0b6a1-31e7-463f-a633-34e21d08ebd7', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-78051a87-05e4-48f5-bcec-b0fe11ccfcf7 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6140912c-a248-425f-855c-d3bddcc303cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-78051a87-05e4-48f5-bcec-b0fe11ccfcf7 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6140912c-a248-425f-855c-d3bddcc303cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-78051a87-05e4-48f5-bcec-b0fe11ccfcf7 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d2c913-64a5-4529-927a-b86c4a9abfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:15 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-78051a87-05e4-48f5-bcec-b0fe11ccfcf7 tempest-CreateVolumesFromImageTest-192687972 None] Volume e9a0b6a1-31e7-463f-a633-34e21d08ebd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9a0b6a1-31e7-463f-a633-34e21d08ebd7', 'volume_size': 1} Sep 28 17:35:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-78051a87-05e4-48f5-bcec-b0fe11ccfcf7 tempest-CreateVolumesFromImageTest-192687972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:15 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-54041b80-e842-406d-9cb9-6792c903c596 tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b 1073741824" returned: 0 in 0.438s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-54041b80-e842-406d-9cb9-6792c903c596 tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:16 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b Sep 28 17:35:16 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:16 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-54041b80-e842-406d-9cb9-6792c903c596 tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b" returned: 0 in 0.291s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:16 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-54041b80-e842-406d-9cb9-6792c903c596 tempest-CreateVolumesFromSnapshotTest-556144415 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:35:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-54041b80-e842-406d-9cb9-6792c903c596 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-78051a87-05e4-48f5-bcec-b0fe11ccfcf7 tempest-CreateVolumesFromImageTest-192687972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.124s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:16 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-78051a87-05e4-48f5-bcec-b0fe11ccfcf7 tempest-CreateVolumesFromImageTest-192687972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-84422283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9a0b6a1-31e7-463f-a633-34e21d08ebd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4874c78ae548df9c92c97e9d5b9d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:15Z,use_quota=True,user_id='c3c29c44bace42759ede43ac12bea36a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:35:16 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-78051a87-05e4-48f5-bcec-b0fe11ccfcf7 tempest-CreateVolumesFromImageTest-192687972 None] Creating volume e9a0b6a1-31e7-463f-a633-34e21d08ebd7 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:35:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-78051a87-05e4-48f5-bcec-b0fe11ccfcf7 tempest-CreateVolumesFromImageTest-192687972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-78051a87-05e4-48f5-bcec-b0fe11ccfcf7 tempest-CreateVolumesFromImageTest-192687972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:16 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-78051a87-05e4-48f5-bcec-b0fe11ccfcf7 tempest-CreateVolumesFromImageTest-192687972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:16 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-78051a87-05e4-48f5-bcec-b0fe11ccfcf7 tempest-CreateVolumesFromImageTest-192687972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-78051a87-05e4-48f5-bcec-b0fe11ccfcf7 tempest-CreateVolumesFromImageTest-192687972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:16 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-78051a87-05e4-48f5-bcec-b0fe11ccfcf7 tempest-CreateVolumesFromImageTest-192687972 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:35:16 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-78051a87-05e4-48f5-bcec-b0fe11ccfcf7 tempest-CreateVolumesFromImageTest-192687972 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:35:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-78051a87-05e4-48f5-bcec-b0fe11ccfcf7 tempest-CreateVolumesFromImageTest-192687972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9a0b6a1-31e7-463f-a633-34e21d08ebd7 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:16 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9a0b6a1-31e7-463f-a633-34e21d08ebd7 1073741824 Sep 28 17:35:16 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-54041b80-e842-406d-9cb9-6792c903c596 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85230e36-4abd-4c75-a859-f817a9bdd616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-54041b80-e842-406d-9cb9-6792c903c596 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d72d166c-2734-4e91-bff3-83295ae86710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:16 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dc17525-2c88-4295-b2de-6f7c3b4eb472 tempest-CreateVolumesFromImageTest-192687972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:35:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4dc17525-2c88-4295-b2de-6f7c3b4eb472 tempest-CreateVolumesFromImageTest-192687972 None] Flow 'volume_create_manager' (2d807be7-d4fa-41ae-9d44-660ad48668a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4dc17525-2c88-4295-b2de-6f7c3b4eb472 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c7e4e38-a7c7-4bed-9f7b-1845b6aff0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:16 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-54041b80-e842-406d-9cb9-6792c903c596 tempest-CreateVolumesFromSnapshotTest-556144415 None] Volume volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b (0c16e5d7-4f44-4277-ba04-fb6134e5291b): created successfully Sep 28 17:35:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-54041b80-e842-406d-9cb9-6792c903c596 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d72d166c-2734-4e91-bff3-83295ae86710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-54041b80-e842-406d-9cb9-6792c903c596 tempest-CreateVolumesFromSnapshotTest-556144415 None] Flow 'volume_create_manager' (1c4e52a6-f5f4-4294-a1e2-dc30aed77e34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4dc17525-2c88-4295-b2de-6f7c3b4eb472 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c7e4e38-a7c7-4bed-9f7b-1845b6aff0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-331486027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e03364eb-953a-4d44-89c8-c16bb2766740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4874c78ae548df9c92c97e9d5b9d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:17Z,use_quota=True,user_id='c3c29c44bace42759ede43ac12bea36a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4dc17525-2c88-4295-b2de-6f7c3b4eb472 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f894aebf-d2ca-4335-8461-d70e1443c476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4dc17525-2c88-4295-b2de-6f7c3b4eb472 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f894aebf-d2ca-4335-8461-d70e1443c476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4dc17525-2c88-4295-b2de-6f7c3b4eb472 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc15aa1-3063-410b-a9ea-994a8aa00087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4dc17525-2c88-4295-b2de-6f7c3b4eb472 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc15aa1-3063-410b-a9ea-994a8aa00087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e03364eb-953a-4d44-89c8-c16bb2766740', 'volume_name': 'volume-e03364eb-953a-4d44-89c8-c16bb2766740', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4dc17525-2c88-4295-b2de-6f7c3b4eb472 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c972a5c-7131-409a-832d-eed40779e596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4dc17525-2c88-4295-b2de-6f7c3b4eb472 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c972a5c-7131-409a-832d-eed40779e596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4dc17525-2c88-4295-b2de-6f7c3b4eb472 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc9db7f1-dc69-4a6e-82ae-73ddfee590b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:16 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-4dc17525-2c88-4295-b2de-6f7c3b4eb472 tempest-CreateVolumesFromImageTest-192687972 None] Volume e03364eb-953a-4d44-89c8-c16bb2766740: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e03364eb-953a-4d44-89c8-c16bb2766740', 'volume_size': 1} Sep 28 17:35:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4dc17525-2c88-4295-b2de-6f7c3b4eb472 tempest-CreateVolumesFromImageTest-192687972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:17 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-54041b80-e842-406d-9cb9-6792c903c596 tempest-CreateVolumesFromSnapshotTest-556144415 None] Created volume successfully. Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f493e9f-f7aa-49a5-b8d7-565f5752114c tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0f493e9f-f7aa-49a5-b8d7-565f5752114c tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Flow 'volume_create_manager' (79e44150-1829-4198-8ba0-e21389cbf677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0f493e9f-f7aa-49a5-b8d7-565f5752114c tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05a07378-add3-45e5-b6d6-089ef877abfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0f493e9f-f7aa-49a5-b8d7-565f5752114c tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05a07378-add3-45e5-b6d6-089ef877abfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1189158201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d51f8b0f-024b-47f5-8594-5149480740c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='713b25778b3249ea9fb111d34096d5c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:17Z,use_quota=True,user_id='239f5a31ee02460b9a4b8bd670f8f600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0f493e9f-f7aa-49a5-b8d7-565f5752114c tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0daf5700-8aa3-4b17-8d6c-6af6713043f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0f493e9f-f7aa-49a5-b8d7-565f5752114c tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0daf5700-8aa3-4b17-8d6c-6af6713043f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0f493e9f-f7aa-49a5-b8d7-565f5752114c tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a02f596b-24ae-4bbb-bf5f-05163cf35576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:17 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0f493e9f-f7aa-49a5-b8d7-565f5752114c tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a02f596b-24ae-4bbb-bf5f-05163cf35576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd51f8b0f-024b-47f5-8594-5149480740c9', 'volume_name': 'volume-d51f8b0f-024b-47f5-8594-5149480740c9', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0f493e9f-f7aa-49a5-b8d7-565f5752114c tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3af04162-6400-49a9-8fa8-096a760e2a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0f493e9f-f7aa-49a5-b8d7-565f5752114c tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3af04162-6400-49a9-8fa8-096a760e2a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0f493e9f-f7aa-49a5-b8d7-565f5752114c tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f4f087-7064-40ca-a4de-f8d698f212d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:17 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-0f493e9f-f7aa-49a5-b8d7-565f5752114c tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Volume d51f8b0f-024b-47f5-8594-5149480740c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d51f8b0f-024b-47f5-8594-5149480740c9', 'volume_size': 1} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0f493e9f-f7aa-49a5-b8d7-565f5752114c tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-78051a87-05e4-48f5-bcec-b0fe11ccfcf7 tempest-CreateVolumesFromImageTest-192687972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9a0b6a1-31e7-463f-a633-34e21d08ebd7 1073741824" returned: 0 in 0.544s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-78051a87-05e4-48f5-bcec-b0fe11ccfcf7 tempest-CreateVolumesFromImageTest-192687972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9a0b6a1-31e7-463f-a633-34e21d08ebd7 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:17 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9a0b6a1-31e7-463f-a633-34e21d08ebd7 Sep 28 17:35:17 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-26b1f09b-f7bd-4ece-a1f9-7eb97a274155 tempest-CreateVolumesFromImageTest-192687972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-26b1f09b-f7bd-4ece-a1f9-7eb97a274155 tempest-CreateVolumesFromImageTest-192687972 None] Flow 'volume_create_manager' (3d1f39c2-fdd7-4647-94d6-19444dd681e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-26b1f09b-f7bd-4ece-a1f9-7eb97a274155 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09845451-3e89-4f71-9266-514a69754e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-26b1f09b-f7bd-4ece-a1f9-7eb97a274155 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09845451-3e89-4f71-9266-514a69754e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1996282356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d5f6f0-a124-42ce-a194-2edfbdb7f830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4874c78ae548df9c92c97e9d5b9d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:17Z,use_quota=True,user_id='c3c29c44bace42759ede43ac12bea36a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-26b1f09b-f7bd-4ece-a1f9-7eb97a274155 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47937b25-8708-4f4b-84a5-9220087f7a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-26b1f09b-f7bd-4ece-a1f9-7eb97a274155 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47937b25-8708-4f4b-84a5-9220087f7a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-26b1f09b-f7bd-4ece-a1f9-7eb97a274155 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c91092cd-50ee-426e-a4ee-88cfeb4b2673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-26b1f09b-f7bd-4ece-a1f9-7eb97a274155 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c91092cd-50ee-426e-a4ee-88cfeb4b2673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18d5f6f0-a124-42ce-a194-2edfbdb7f830', 'volume_name': 'volume-18d5f6f0-a124-42ce-a194-2edfbdb7f830', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-26b1f09b-f7bd-4ece-a1f9-7eb97a274155 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87861cc3-d7ba-4c55-b17c-9ae2f6de344a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-26b1f09b-f7bd-4ece-a1f9-7eb97a274155 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87861cc3-d7ba-4c55-b17c-9ae2f6de344a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-26b1f09b-f7bd-4ece-a1f9-7eb97a274155 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (782ca73c-9205-426f-b301-c00a0bcf66bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:17 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-26b1f09b-f7bd-4ece-a1f9-7eb97a274155 tempest-CreateVolumesFromImageTest-192687972 None] Volume 18d5f6f0-a124-42ce-a194-2edfbdb7f830: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18d5f6f0-a124-42ce-a194-2edfbdb7f830', 'volume_size': 1} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-26b1f09b-f7bd-4ece-a1f9-7eb97a274155 tempest-CreateVolumesFromImageTest-192687972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:17 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-78051a87-05e4-48f5-bcec-b0fe11ccfcf7 tempest-CreateVolumesFromImageTest-192687972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9a0b6a1-31e7-463f-a633-34e21d08ebd7" returned: 0 in 0.385s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-78051a87-05e4-48f5-bcec-b0fe11ccfcf7 tempest-CreateVolumesFromImageTest-192687972 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-78051a87-05e4-48f5-bcec-b0fe11ccfcf7 tempest-CreateVolumesFromImageTest-192687972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4dc17525-2c88-4295-b2de-6f7c3b4eb472 tempest-CreateVolumesFromImageTest-192687972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.590s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4dc17525-2c88-4295-b2de-6f7c3b4eb472 tempest-CreateVolumesFromImageTest-192687972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-331486027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e03364eb-953a-4d44-89c8-c16bb2766740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4874c78ae548df9c92c97e9d5b9d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:17Z,use_quota=True,user_id='c3c29c44bace42759ede43ac12bea36a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-4dc17525-2c88-4295-b2de-6f7c3b4eb472 tempest-CreateVolumesFromImageTest-192687972 None] Creating volume e03364eb-953a-4d44-89c8-c16bb2766740 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4dc17525-2c88-4295-b2de-6f7c3b4eb472 tempest-CreateVolumesFromImageTest-192687972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4dc17525-2c88-4295-b2de-6f7c3b4eb472 tempest-CreateVolumesFromImageTest-192687972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4dc17525-2c88-4295-b2de-6f7c3b4eb472 tempest-CreateVolumesFromImageTest-192687972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4dc17525-2c88-4295-b2de-6f7c3b4eb472 tempest-CreateVolumesFromImageTest-192687972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4dc17525-2c88-4295-b2de-6f7c3b4eb472 tempest-CreateVolumesFromImageTest-192687972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4dc17525-2c88-4295-b2de-6f7c3b4eb472 tempest-CreateVolumesFromImageTest-192687972 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:35:17 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-4dc17525-2c88-4295-b2de-6f7c3b4eb472 tempest-CreateVolumesFromImageTest-192687972 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4dc17525-2c88-4295-b2de-6f7c3b4eb472 tempest-CreateVolumesFromImageTest-192687972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e03364eb-953a-4d44-89c8-c16bb2766740 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-78051a87-05e4-48f5-bcec-b0fe11ccfcf7 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d2c913-64a5-4529-927a-b86c4a9abfec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9a0b6a1-31e7-463f-a633-34e21d08ebd7', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:17 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e03364eb-953a-4d44-89c8-c16bb2766740 1073741824 Sep 28 17:35:17 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-78051a87-05e4-48f5-bcec-b0fe11ccfcf7 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f149d64f-54d6-4773-a4ba-d33b6cd79bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:17 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-78051a87-05e4-48f5-bcec-b0fe11ccfcf7 tempest-CreateVolumesFromImageTest-192687972 None] Volume volume-e9a0b6a1-31e7-463f-a633-34e21d08ebd7 (e9a0b6a1-31e7-463f-a633-34e21d08ebd7): created successfully Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-78051a87-05e4-48f5-bcec-b0fe11ccfcf7 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f149d64f-54d6-4773-a4ba-d33b6cd79bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-78051a87-05e4-48f5-bcec-b0fe11ccfcf7 tempest-CreateVolumesFromImageTest-192687972 None] Flow 'volume_create_manager' (9d8ac064-ccd4-47ee-bee4-d5c000a97ec7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:17 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-78051a87-05e4-48f5-bcec-b0fe11ccfcf7 tempest-CreateVolumesFromImageTest-192687972 None] Created volume successfully. Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b62fdb4-0cbd-47ca-961e-14a9ff448d43 tempest-CreateVolumesFromImageTest-192687972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b62fdb4-0cbd-47ca-961e-14a9ff448d43 tempest-CreateVolumesFromImageTest-192687972 None] Flow 'volume_create_manager' (676f8931-5cfb-4d51-89d7-d905195dcb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:17 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b62fdb4-0cbd-47ca-961e-14a9ff448d43 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9358a789-b2e2-48cf-ab6f-ae11e4486376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b62fdb4-0cbd-47ca-961e-14a9ff448d43 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9358a789-b2e2-48cf-ab6f-ae11e4486376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-699139002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24c1f90-20c9-4a2e-897b-7c96c3dcb26c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4874c78ae548df9c92c97e9d5b9d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:18Z,use_quota=True,user_id='c3c29c44bace42759ede43ac12bea36a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b62fdb4-0cbd-47ca-961e-14a9ff448d43 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b677994-bfc1-4c55-a8a9-dde048d62b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b62fdb4-0cbd-47ca-961e-14a9ff448d43 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b677994-bfc1-4c55-a8a9-dde048d62b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b62fdb4-0cbd-47ca-961e-14a9ff448d43 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eea2eca-1847-46c7-b24c-c1546dc94114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b62fdb4-0cbd-47ca-961e-14a9ff448d43 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eea2eca-1847-46c7-b24c-c1546dc94114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c24c1f90-20c9-4a2e-897b-7c96c3dcb26c', 'volume_name': 'volume-c24c1f90-20c9-4a2e-897b-7c96c3dcb26c', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b62fdb4-0cbd-47ca-961e-14a9ff448d43 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b704ed7-f7db-4077-ae42-ee8b68b7774a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b62fdb4-0cbd-47ca-961e-14a9ff448d43 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b704ed7-f7db-4077-ae42-ee8b68b7774a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b62fdb4-0cbd-47ca-961e-14a9ff448d43 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75080acd-4fd5-4dc2-8ccd-60ce9345d75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:18 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-6b62fdb4-0cbd-47ca-961e-14a9ff448d43 tempest-CreateVolumesFromImageTest-192687972 None] Volume c24c1f90-20c9-4a2e-897b-7c96c3dcb26c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c24c1f90-20c9-4a2e-897b-7c96c3dcb26c', 'volume_size': 1} Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6b62fdb4-0cbd-47ca-961e-14a9ff448d43 tempest-CreateVolumesFromImageTest-192687972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2209ada4-3c38-4d63-a931-0739260fd322 tempest-CreateVolumesFromSnapshotTest-556144415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:18 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4dc17525-2c88-4295-b2de-6f7c3b4eb472 tempest-CreateVolumesFromImageTest-192687972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e03364eb-953a-4d44-89c8-c16bb2766740 1073741824" returned: 0 in 0.772s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1844412-dc63-4294-b907-1db06adc09ee tempest-CreateVolumesFromImageTest-192687972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b1844412-dc63-4294-b907-1db06adc09ee tempest-CreateVolumesFromImageTest-192687972 None] Flow 'volume_create_manager' (e9b9af79-9293-4d93-85d3-e1c30277425e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b1844412-dc63-4294-b907-1db06adc09ee tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1945a6c2-1037-4fe7-8140-0ca6f7b50178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4dc17525-2c88-4295-b2de-6f7c3b4eb472 tempest-CreateVolumesFromImageTest-192687972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e03364eb-953a-4d44-89c8-c16bb2766740 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:18 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e03364eb-953a-4d44-89c8-c16bb2766740 Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b1844412-dc63-4294-b907-1db06adc09ee tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1945a6c2-1037-4fe7-8140-0ca6f7b50178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-131010832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=296666e8-41f5-468a-9b1f-8ca17c8d3ce5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4874c78ae548df9c92c97e9d5b9d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:18Z,use_quota=True,user_id='c3c29c44bace42759ede43ac12bea36a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:18 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b1844412-dc63-4294-b907-1db06adc09ee tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b89db8-af56-4ff9-9a00-806e8e64721f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b1844412-dc63-4294-b907-1db06adc09ee tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b89db8-af56-4ff9-9a00-806e8e64721f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b1844412-dc63-4294-b907-1db06adc09ee tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dad93e3-3a1e-4e9e-9902-cea751f3659a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b1844412-dc63-4294-b907-1db06adc09ee tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dad93e3-3a1e-4e9e-9902-cea751f3659a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '296666e8-41f5-468a-9b1f-8ca17c8d3ce5', 'volume_name': 'volume-296666e8-41f5-468a-9b1f-8ca17c8d3ce5', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b1844412-dc63-4294-b907-1db06adc09ee tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31c6284e-9913-4416-a946-1c5ebe173d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b1844412-dc63-4294-b907-1db06adc09ee tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31c6284e-9913-4416-a946-1c5ebe173d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b1844412-dc63-4294-b907-1db06adc09ee tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a4d972-1d4f-45bd-8d71-f1b11fb3ee44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:18 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-b1844412-dc63-4294-b907-1db06adc09ee tempest-CreateVolumesFromImageTest-192687972 None] Volume 296666e8-41f5-468a-9b1f-8ca17c8d3ce5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-296666e8-41f5-468a-9b1f-8ca17c8d3ce5', 'volume_size': 1} Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b1844412-dc63-4294-b907-1db06adc09ee tempest-CreateVolumesFromImageTest-192687972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:18 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4dc17525-2c88-4295-b2de-6f7c3b4eb472 tempest-CreateVolumesFromImageTest-192687972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e03364eb-953a-4d44-89c8-c16bb2766740" returned: 0 in 0.271s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4dc17525-2c88-4295-b2de-6f7c3b4eb472 tempest-CreateVolumesFromImageTest-192687972 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4dc17525-2c88-4295-b2de-6f7c3b4eb472 tempest-CreateVolumesFromImageTest-192687972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0f493e9f-f7aa-49a5-b8d7-565f5752114c tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.579s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0f493e9f-f7aa-49a5-b8d7-565f5752114c tempest-CreateVolumesFromSourceVolumeTest-929854129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1189158201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d51f8b0f-024b-47f5-8594-5149480740c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='713b25778b3249ea9fb111d34096d5c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:17Z,use_quota=True,user_id='239f5a31ee02460b9a4b8bd670f8f600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-0f493e9f-f7aa-49a5-b8d7-565f5752114c tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Creating volume d51f8b0f-024b-47f5-8594-5149480740c9 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0f493e9f-f7aa-49a5-b8d7-565f5752114c tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0f493e9f-f7aa-49a5-b8d7-565f5752114c tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0f493e9f-f7aa-49a5-b8d7-565f5752114c tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0f493e9f-f7aa-49a5-b8d7-565f5752114c tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0f493e9f-f7aa-49a5-b8d7-565f5752114c tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0f493e9f-f7aa-49a5-b8d7-565f5752114c tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:35:18 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-0f493e9f-f7aa-49a5-b8d7-565f5752114c tempest-CreateVolumesFromSourceVolumeTest-929854129 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0f493e9f-f7aa-49a5-b8d7-565f5752114c tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d51f8b0f-024b-47f5-8594-5149480740c9 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:18 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d51f8b0f-024b-47f5-8594-5149480740c9 1073741824 Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4dc17525-2c88-4295-b2de-6f7c3b4eb472 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc9db7f1-dc69-4a6e-82ae-73ddfee590b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e03364eb-953a-4d44-89c8-c16bb2766740', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:18 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4dc17525-2c88-4295-b2de-6f7c3b4eb472 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (071d2642-a7c9-460c-b85b-2b4eeb704f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:18 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-4dc17525-2c88-4295-b2de-6f7c3b4eb472 tempest-CreateVolumesFromImageTest-192687972 None] Volume volume-e03364eb-953a-4d44-89c8-c16bb2766740 (e03364eb-953a-4d44-89c8-c16bb2766740): created successfully Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4dc17525-2c88-4295-b2de-6f7c3b4eb472 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (071d2642-a7c9-460c-b85b-2b4eeb704f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4dc17525-2c88-4295-b2de-6f7c3b4eb472 tempest-CreateVolumesFromImageTest-192687972 None] Flow 'volume_create_manager' (2d807be7-d4fa-41ae-9d44-660ad48668a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:18 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-4dc17525-2c88-4295-b2de-6f7c3b4eb472 tempest-CreateVolumesFromImageTest-192687972 None] Created volume successfully. Sep 28 17:35:19 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0f493e9f-f7aa-49a5-b8d7-565f5752114c tempest-CreateVolumesFromSourceVolumeTest-929854129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d51f8b0f-024b-47f5-8594-5149480740c9 1073741824" returned: 0 in 0.488s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0f493e9f-f7aa-49a5-b8d7-565f5752114c tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d51f8b0f-024b-47f5-8594-5149480740c9 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:19 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d51f8b0f-024b-47f5-8594-5149480740c9 Sep 28 17:35:19 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:19 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0f493e9f-f7aa-49a5-b8d7-565f5752114c tempest-CreateVolumesFromSourceVolumeTest-929854129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d51f8b0f-024b-47f5-8594-5149480740c9" returned: 0 in 0.278s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0f493e9f-f7aa-49a5-b8d7-565f5752114c tempest-CreateVolumesFromSourceVolumeTest-929854129 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:35:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0f493e9f-f7aa-49a5-b8d7-565f5752114c tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-26b1f09b-f7bd-4ece-a1f9-7eb97a274155 tempest-CreateVolumesFromImageTest-192687972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.992s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-26b1f09b-f7bd-4ece-a1f9-7eb97a274155 tempest-CreateVolumesFromImageTest-192687972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1996282356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d5f6f0-a124-42ce-a194-2edfbdb7f830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4874c78ae548df9c92c97e9d5b9d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:17Z,use_quota=True,user_id='c3c29c44bace42759ede43ac12bea36a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:35:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-26b1f09b-f7bd-4ece-a1f9-7eb97a274155 tempest-CreateVolumesFromImageTest-192687972 None] Creating volume 18d5f6f0-a124-42ce-a194-2edfbdb7f830 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:35:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-26b1f09b-f7bd-4ece-a1f9-7eb97a274155 tempest-CreateVolumesFromImageTest-192687972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-26b1f09b-f7bd-4ece-a1f9-7eb97a274155 tempest-CreateVolumesFromImageTest-192687972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-26b1f09b-f7bd-4ece-a1f9-7eb97a274155 tempest-CreateVolumesFromImageTest-192687972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-26b1f09b-f7bd-4ece-a1f9-7eb97a274155 tempest-CreateVolumesFromImageTest-192687972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-26b1f09b-f7bd-4ece-a1f9-7eb97a274155 tempest-CreateVolumesFromImageTest-192687972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-26b1f09b-f7bd-4ece-a1f9-7eb97a274155 tempest-CreateVolumesFromImageTest-192687972 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:35:19 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-26b1f09b-f7bd-4ece-a1f9-7eb97a274155 tempest-CreateVolumesFromImageTest-192687972 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:35:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-26b1f09b-f7bd-4ece-a1f9-7eb97a274155 tempest-CreateVolumesFromImageTest-192687972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18d5f6f0-a124-42ce-a194-2edfbdb7f830 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0f493e9f-f7aa-49a5-b8d7-565f5752114c tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f4f087-7064-40ca-a4de-f8d698f212d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d51f8b0f-024b-47f5-8594-5149480740c9', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:19 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18d5f6f0-a124-42ce-a194-2edfbdb7f830 1073741824 Sep 28 17:35:19 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0f493e9f-f7aa-49a5-b8d7-565f5752114c tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11b81dcc-7a89-42d3-89f2-ff47e8b7bca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:19 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-0f493e9f-f7aa-49a5-b8d7-565f5752114c tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Volume volume-d51f8b0f-024b-47f5-8594-5149480740c9 (d51f8b0f-024b-47f5-8594-5149480740c9): created successfully Sep 28 17:35:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0f493e9f-f7aa-49a5-b8d7-565f5752114c tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11b81dcc-7a89-42d3-89f2-ff47e8b7bca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-0f493e9f-f7aa-49a5-b8d7-565f5752114c tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Flow 'volume_create_manager' (79e44150-1829-4198-8ba0-e21389cbf677) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:19 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-0f493e9f-f7aa-49a5-b8d7-565f5752114c tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Created volume successfully. Sep 28 17:35:20 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-26b1f09b-f7bd-4ece-a1f9-7eb97a274155 tempest-CreateVolumesFromImageTest-192687972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18d5f6f0-a124-42ce-a194-2edfbdb7f830 1073741824" returned: 0 in 0.546s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-26b1f09b-f7bd-4ece-a1f9-7eb97a274155 tempest-CreateVolumesFromImageTest-192687972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18d5f6f0-a124-42ce-a194-2edfbdb7f830 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:20 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18d5f6f0-a124-42ce-a194-2edfbdb7f830 Sep 28 17:35:20 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:20 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-26b1f09b-f7bd-4ece-a1f9-7eb97a274155 tempest-CreateVolumesFromImageTest-192687972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18d5f6f0-a124-42ce-a194-2edfbdb7f830" returned: 0 in 0.309s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-26b1f09b-f7bd-4ece-a1f9-7eb97a274155 tempest-CreateVolumesFromImageTest-192687972 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:35:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-26b1f09b-f7bd-4ece-a1f9-7eb97a274155 tempest-CreateVolumesFromImageTest-192687972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6b62fdb4-0cbd-47ca-961e-14a9ff448d43 tempest-CreateVolumesFromImageTest-192687972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.374s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6b62fdb4-0cbd-47ca-961e-14a9ff448d43 tempest-CreateVolumesFromImageTest-192687972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-699139002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24c1f90-20c9-4a2e-897b-7c96c3dcb26c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4874c78ae548df9c92c97e9d5b9d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:18Z,use_quota=True,user_id='c3c29c44bace42759ede43ac12bea36a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:35:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-6b62fdb4-0cbd-47ca-961e-14a9ff448d43 tempest-CreateVolumesFromImageTest-192687972 None] Creating volume c24c1f90-20c9-4a2e-897b-7c96c3dcb26c {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:35:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6b62fdb4-0cbd-47ca-961e-14a9ff448d43 tempest-CreateVolumesFromImageTest-192687972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6b62fdb4-0cbd-47ca-961e-14a9ff448d43 tempest-CreateVolumesFromImageTest-192687972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6b62fdb4-0cbd-47ca-961e-14a9ff448d43 tempest-CreateVolumesFromImageTest-192687972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6b62fdb4-0cbd-47ca-961e-14a9ff448d43 tempest-CreateVolumesFromImageTest-192687972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6b62fdb4-0cbd-47ca-961e-14a9ff448d43 tempest-CreateVolumesFromImageTest-192687972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6b62fdb4-0cbd-47ca-961e-14a9ff448d43 tempest-CreateVolumesFromImageTest-192687972 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:35:20 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-6b62fdb4-0cbd-47ca-961e-14a9ff448d43 tempest-CreateVolumesFromImageTest-192687972 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:35:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b62fdb4-0cbd-47ca-961e-14a9ff448d43 tempest-CreateVolumesFromImageTest-192687972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c24c1f90-20c9-4a2e-897b-7c96c3dcb26c 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-26b1f09b-f7bd-4ece-a1f9-7eb97a274155 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (782ca73c-9205-426f-b301-c00a0bcf66bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18d5f6f0-a124-42ce-a194-2edfbdb7f830', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-26b1f09b-f7bd-4ece-a1f9-7eb97a274155 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (276f8564-b3e1-433d-ba7f-65aa0e2185d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:20 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c24c1f90-20c9-4a2e-897b-7c96c3dcb26c 1073741824 Sep 28 17:35:20 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:20 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-26b1f09b-f7bd-4ece-a1f9-7eb97a274155 tempest-CreateVolumesFromImageTest-192687972 None] Volume volume-18d5f6f0-a124-42ce-a194-2edfbdb7f830 (18d5f6f0-a124-42ce-a194-2edfbdb7f830): created successfully Sep 28 17:35:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-26b1f09b-f7bd-4ece-a1f9-7eb97a274155 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (276f8564-b3e1-433d-ba7f-65aa0e2185d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-26b1f09b-f7bd-4ece-a1f9-7eb97a274155 tempest-CreateVolumesFromImageTest-192687972 None] Flow 'volume_create_manager' (3d1f39c2-fdd7-4647-94d6-19444dd681e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:20 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-26b1f09b-f7bd-4ece-a1f9-7eb97a274155 tempest-CreateVolumesFromImageTest-192687972 None] Created volume successfully. Sep 28 17:35:20 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:35:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Flow 'volume_create_manager' (4c674774-24cf-41e6-8dfd-c15c6f0bf415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aea64d55-07d6-4f87-b80d-4aa2136d8ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aea64d55-07d6-4f87-b80d-4aa2136d8ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46e88e67-010a-44d8-abe7-2e4228912820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e828bf58d6c4b8cbd621225ded0d312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:21Z,use_quota=True,user_id='6f47ca35a62c44829ecaa23d9c29c903',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3640b2b3-367a-48dc-8f1e-6c45c547a174),volume_type_id=3640b2b3-367a-48dc-8f1e-6c45c547a174)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d103dcf-5c87-4ced-b5ce-19aa88948e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d103dcf-5c87-4ced-b5ce-19aa88948e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:20 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d53d3d-77bd-4c20-99eb-f7bdc73ab02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:20 devstack cinder-volume[86917]: DEBUG cinder.image.glance [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Creating Keystone auth plugin from conf {{(pid=86917) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:35:20 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-890a5fed-8845-40a9-bfbb-27a9913ab8f2 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-890a5fed-8845-40a9-bfbb-27a9913ab8f2 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Flow 'volume_create_manager' (3dcb33d0-44b9-4995-8e45-b12e6a68c11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-890a5fed-8845-40a9-bfbb-27a9913ab8f2 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f044202e-191e-49f1-a501-08e56660b399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-890a5fed-8845-40a9-bfbb-27a9913ab8f2 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f044202e-191e-49f1-a501-08e56660b399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1892578414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faccbdd5-ba10-4daa-8cc1-3a0434d27c08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='713b25778b3249ea9fb111d34096d5c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:21Z,use_quota=True,user_id='239f5a31ee02460b9a4b8bd670f8f600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-890a5fed-8845-40a9-bfbb-27a9913ab8f2 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b288c1a-cb70-4770-8474-cdedf27d7518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-890a5fed-8845-40a9-bfbb-27a9913ab8f2 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b288c1a-cb70-4770-8474-cdedf27d7518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-890a5fed-8845-40a9-bfbb-27a9913ab8f2 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f51e9f9-4078-425b-ac20-b57cf93e8566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-890a5fed-8845-40a9-bfbb-27a9913ab8f2 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f51e9f9-4078-425b-ac20-b57cf93e8566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faccbdd5-ba10-4daa-8cc1-3a0434d27c08', 'volume_name': 'volume-faccbdd5-ba10-4daa-8cc1-3a0434d27c08', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-890a5fed-8845-40a9-bfbb-27a9913ab8f2 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e92d8a99-9680-4159-9f60-aab365efb7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-890a5fed-8845-40a9-bfbb-27a9913ab8f2 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e92d8a99-9680-4159-9f60-aab365efb7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:21 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-890a5fed-8845-40a9-bfbb-27a9913ab8f2 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d4345e3-eab2-4a69-88bb-2acc6bd43997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:21 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-890a5fed-8845-40a9-bfbb-27a9913ab8f2 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Volume faccbdd5-ba10-4daa-8cc1-3a0434d27c08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faccbdd5-ba10-4daa-8cc1-3a0434d27c08', 'volume_size': 1} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-890a5fed-8845-40a9-bfbb-27a9913ab8f2 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b62fdb4-0cbd-47ca-961e-14a9ff448d43 tempest-CreateVolumesFromImageTest-192687972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c24c1f90-20c9-4a2e-897b-7c96c3dcb26c 1073741824" returned: 0 in 0.662s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-eac0e931-a61f-4710-b2d1-4b2193d8ceea tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-eac0e931-a61f-4710-b2d1-4b2193d8ceea tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Flow 'volume_create_manager' (dd958a66-9c43-4012-95af-605bec259ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-eac0e931-a61f-4710-b2d1-4b2193d8ceea tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b5eb3c2-3535-454b-8f67-dc49154803bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-eac0e931-a61f-4710-b2d1-4b2193d8ceea tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b5eb3c2-3535-454b-8f67-dc49154803bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1211432467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=303e7063-e9c2-4a67-a61b-8ad295015a68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='713b25778b3249ea9fb111d34096d5c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:21Z,use_quota=True,user_id='239f5a31ee02460b9a4b8bd670f8f600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-eac0e931-a61f-4710-b2d1-4b2193d8ceea tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc9bb2fa-e71d-4635-9e39-c2d1c562efd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-eac0e931-a61f-4710-b2d1-4b2193d8ceea tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc9bb2fa-e71d-4635-9e39-c2d1c562efd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-eac0e931-a61f-4710-b2d1-4b2193d8ceea tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad3cd14a-fddc-494e-ae1e-6c47ba978489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-eac0e931-a61f-4710-b2d1-4b2193d8ceea tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad3cd14a-fddc-494e-ae1e-6c47ba978489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '303e7063-e9c2-4a67-a61b-8ad295015a68', 'volume_name': 'volume-303e7063-e9c2-4a67-a61b-8ad295015a68', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-eac0e931-a61f-4710-b2d1-4b2193d8ceea tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69de44b9-9c3a-4dab-b9e4-9ebb3a06fc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-eac0e931-a61f-4710-b2d1-4b2193d8ceea tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69de44b9-9c3a-4dab-b9e4-9ebb3a06fc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-eac0e931-a61f-4710-b2d1-4b2193d8ceea tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9be1dbe-f305-4bf0-b70c-24e198132c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:21 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-eac0e931-a61f-4710-b2d1-4b2193d8ceea tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Volume 303e7063-e9c2-4a67-a61b-8ad295015a68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-303e7063-e9c2-4a67-a61b-8ad295015a68', 'volume_size': 1} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-eac0e931-a61f-4710-b2d1-4b2193d8ceea tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b62fdb4-0cbd-47ca-961e-14a9ff448d43 tempest-CreateVolumesFromImageTest-192687972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c24c1f90-20c9-4a2e-897b-7c96c3dcb26c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:21 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c24c1f90-20c9-4a2e-897b-7c96c3dcb26c Sep 28 17:35:21 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-c23df250-9a10-476e-8fdc-a712411f3f3f tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c23df250-9a10-476e-8fdc-a712411f3f3f tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Flow 'volume_create_manager' (31f573a7-f792-4a16-94e6-f5a8e60b46c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c23df250-9a10-476e-8fdc-a712411f3f3f tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b5ce627-e5bc-4fdd-aaf6-38ac59aa7f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d53d3d-77bd-4c20-99eb-f7bdc73ab02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '46e88e67-010a-44d8-abe7-2e4228912820', 'volume_name': 'volume-46e88e67-010a-44d8-abe7-2e4228912820', 'volume_size': 1, 'image_id': '0410ea5c-cf38-40c1-bd9a-f89da3089e32', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0410ea5c-cf38-40c1-bd9a-f89da3089e32', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '59f5b88351cf63bd329a533432e65e26', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6e828bf58d6c4b8cbd621225ded0d312', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a3129af44ebbbe363986c1048be8323369af2a579d65172aab9e85fb638b1ff6afd8374932397303a07ce0a7f0a2d3b6abb8c18a196f79354b68104296d7471f', 'id': '0410ea5c-cf38-40c1-bd9a-f89da3089e32', 'created_at': datetime.datetime(2026, 9, 28, 15, 35, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 35, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0410ea5c-cf38-40c1-bd9a-f89da3089e32/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f5fa71-5167-4303-8e68-bee9cc7432e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f5fa71-5167-4303-8e68-bee9cc7432e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff33623-b766-42cd-ba62-e34b6b7dc61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:21 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Volume 46e88e67-010a-44d8-abe7-2e4228912820: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-46e88e67-010a-44d8-abe7-2e4228912820', 'volume_size': 1, 'image_id': '0410ea5c-cf38-40c1-bd9a-f89da3089e32', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0410ea5c-cf38-40c1-bd9a-f89da3089e32', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '59f5b88351cf63bd329a533432e65e26', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6e828bf58d6c4b8cbd621225ded0d312', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a3129af44ebbbe363986c1048be8323369af2a579d65172aab9e85fb638b1ff6afd8374932397303a07ce0a7f0a2d3b6abb8c18a196f79354b68104296d7471f', 'id': '0410ea5c-cf38-40c1-bd9a-f89da3089e32', 'created_at': datetime.datetime(2026, 9, 28, 15, 35, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 35, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0410ea5c-cf38-40c1-bd9a-f89da3089e32/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Trying to clone 46e88e67-010a-44d8-abe7-2e4228912820 from image 0410ea5c-cf38-40c1-bd9a-f89da3089e32 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0410ea5c-cf38-40c1-bd9a-f89da3089e32', 'metadata': {}}]). {{(pid=86917) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c23df250-9a10-476e-8fdc-a712411f3f3f tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b5ce627-e5bc-4fdd-aaf6-38ac59aa7f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1441467721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b36f51e-d577-48e9-8f5f-d8266251e76c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='713b25778b3249ea9fb111d34096d5c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:21Z,use_quota=True,user_id='239f5a31ee02460b9a4b8bd670f8f600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c23df250-9a10-476e-8fdc-a712411f3f3f tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd19588-1d6a-4b3a-97c5-cf1f11dc28ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c23df250-9a10-476e-8fdc-a712411f3f3f tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd19588-1d6a-4b3a-97c5-cf1f11dc28ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c23df250-9a10-476e-8fdc-a712411f3f3f tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43cdefe2-ad42-47e0-a924-9ccdd1668622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c23df250-9a10-476e-8fdc-a712411f3f3f tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43cdefe2-ad42-47e0-a924-9ccdd1668622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b36f51e-d577-48e9-8f5f-d8266251e76c', 'volume_name': 'volume-3b36f51e-d577-48e9-8f5f-d8266251e76c', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c23df250-9a10-476e-8fdc-a712411f3f3f tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b1b2f2d-4730-4c09-91a3-36b897692d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c23df250-9a10-476e-8fdc-a712411f3f3f tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b1b2f2d-4730-4c09-91a3-36b897692d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c23df250-9a10-476e-8fdc-a712411f3f3f tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b150286-aeb6-446a-85e5-859fa6393a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:21 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-c23df250-9a10-476e-8fdc-a712411f3f3f tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Volume 3b36f51e-d577-48e9-8f5f-d8266251e76c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b36f51e-d577-48e9-8f5f-d8266251e76c', 'volume_size': 1} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c23df250-9a10-476e-8fdc-a712411f3f3f tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:21 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0410ea5c-cf38-40c1-bd9a-f89da3089e32_x8antpn1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86917) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:35:21 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Image download 0.00 MB at 0.00 MB/s Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b62fdb4-0cbd-47ca-961e-14a9ff448d43 tempest-CreateVolumesFromImageTest-192687972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c24c1f90-20c9-4a2e-897b-7c96c3dcb26c" returned: 0 in 0.308s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6b62fdb4-0cbd-47ca-961e-14a9ff448d43 tempest-CreateVolumesFromImageTest-192687972 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6b62fdb4-0cbd-47ca-961e-14a9ff448d43 tempest-CreateVolumesFromImageTest-192687972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2209ada4-3c38-4d63-a931-0739260fd322 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.493s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b62fdb4-0cbd-47ca-961e-14a9ff448d43 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75080acd-4fd5-4dc2-8ccd-60ce9345d75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c24c1f90-20c9-4a2e-897b-7c96c3dcb26c', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b62fdb4-0cbd-47ca-961e-14a9ff448d43 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c77fdcb0-10a7-44ec-9168-3d89ec27c05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-2209ada4-3c38-4d63-a931-0739260fd322 tempest-CreateVolumesFromSnapshotTest-556144415 None] Creating offline snapshot 4a01a5c2-3b72-4dad-a84c-772869745a9e of volume 0c16e5d7-4f44-4277-ba04-fb6134e5291b {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:35:21 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-6b62fdb4-0cbd-47ca-961e-14a9ff448d43 tempest-CreateVolumesFromImageTest-192687972 None] Volume volume-c24c1f90-20c9-4a2e-897b-7c96c3dcb26c (c24c1f90-20c9-4a2e-897b-7c96c3dcb26c): created successfully Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b62fdb4-0cbd-47ca-961e-14a9ff448d43 tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c77fdcb0-10a7-44ec-9168-3d89ec27c05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b62fdb4-0cbd-47ca-961e-14a9ff448d43 tempest-CreateVolumesFromImageTest-192687972 None] Flow 'volume_create_manager' (676f8931-5cfb-4d51-89d7-d905195dcb77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[28528e96-0780-4620-bd97-e4fd3011f126]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0410ea5c-cf38-40c1-bd9a-f89da3089e32_x8antpn1devstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[435b276a-7d31-4de1-92e1-362b2a9bd352]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2209ada4-3c38-4d63-a931-0739260fd322 tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:21 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-6b62fdb4-0cbd-47ca-961e-14a9ff448d43 tempest-CreateVolumesFromImageTest-192687972 None] Created volume successfully. Sep 28 17:35:21 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b Sep 28 17:35:21 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0410ea5c-cf38-40c1-bd9a-f89da3089e32_x8antpn1devstack@QuobyteHD Sep 28 17:35:21 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-1611e80b-9ee3-4088-af6c-008d7c9fe583 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:35:21 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1611e80b-9ee3-4088-af6c-008d7c9fe583 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Flow 'volume_create_manager' (c07ebf79-9517-4cb5-bb37-0623ead6a007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1611e80b-9ee3-4088-af6c-008d7c9fe583 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b6ac47-a42c-4fb1-9309-dc85842d1e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1611e80b-9ee3-4088-af6c-008d7c9fe583 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b6ac47-a42c-4fb1-9309-dc85842d1e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1666268667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=975d802d-c236-48a5-93c4-486b23fd5dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='713b25778b3249ea9fb111d34096d5c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:22Z,use_quota=True,user_id='239f5a31ee02460b9a4b8bd670f8f600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1611e80b-9ee3-4088-af6c-008d7c9fe583 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ee725ea-a11a-47b9-8725-f05dd0afbba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1611e80b-9ee3-4088-af6c-008d7c9fe583 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ee725ea-a11a-47b9-8725-f05dd0afbba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1611e80b-9ee3-4088-af6c-008d7c9fe583 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3523150-1cb9-4f11-a44e-e25d6617f772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1611e80b-9ee3-4088-af6c-008d7c9fe583 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3523150-1cb9-4f11-a44e-e25d6617f772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '975d802d-c236-48a5-93c4-486b23fd5dfa', 'volume_name': 'volume-975d802d-c236-48a5-93c4-486b23fd5dfa', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1611e80b-9ee3-4088-af6c-008d7c9fe583 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87025260-71c0-45b4-bd9f-b4973d2e70a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1611e80b-9ee3-4088-af6c-008d7c9fe583 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87025260-71c0-45b4-bd9f-b4973d2e70a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1611e80b-9ee3-4088-af6c-008d7c9fe583 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0e733c7-2c9f-4253-b495-0005e5344b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:21 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-1611e80b-9ee3-4088-af6c-008d7c9fe583 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Volume 975d802d-c236-48a5-93c4-486b23fd5dfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-975d802d-c236-48a5-93c4-486b23fd5dfa', 'volume_size': 1} Sep 28 17:35:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1611e80b-9ee3-4088-af6c-008d7c9fe583 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:22 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0410ea5c-cf38-40c1-bd9a-f89da3089e32_x8antpn1devstack@QuobyteHD" returned: 0 in 0.467s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0410ea5c-cf38-40c1-bd9a-f89da3089e32_x8antpn1devstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:22 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2209ada4-3c38-4d63-a931-0739260fd322 tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b" returned: 0 in 0.553s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2209ada4-3c38-4d63-a931-0739260fd322 tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b.4a01a5c2-3b72-4dad-a84c-772869745a9e 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:22 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0410ea5c-cf38-40c1-bd9a-f89da3089e32_x8antpn1devstack@QuobyteHD Sep 28 17:35:22 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:22 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b.4a01a5c2-3b72-4dad-a84c-772869745a9e 1G Sep 28 17:35:22 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-28bf6e8c-fe17-46b9-88f8-0b43e0974325 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:35:22 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-28bf6e8c-fe17-46b9-88f8-0b43e0974325 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Flow 'volume_create_manager' (7308b9e7-7da3-475d-8d36-42b7b337c687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-28bf6e8c-fe17-46b9-88f8-0b43e0974325 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f574d19-c386-40b2-bfa1-e4863515e2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-28bf6e8c-fe17-46b9-88f8-0b43e0974325 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f574d19-c386-40b2-bfa1-e4863515e2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1377548583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8158d354-d5a7-4998-bb4e-1272d969db0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='713b25778b3249ea9fb111d34096d5c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:22Z,use_quota=True,user_id='239f5a31ee02460b9a4b8bd670f8f600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-28bf6e8c-fe17-46b9-88f8-0b43e0974325 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49499305-8c42-40f8-8cc7-c5fa2bd90156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-28bf6e8c-fe17-46b9-88f8-0b43e0974325 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49499305-8c42-40f8-8cc7-c5fa2bd90156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-28bf6e8c-fe17-46b9-88f8-0b43e0974325 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a24917-117d-4f59-af9f-d09093773d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-28bf6e8c-fe17-46b9-88f8-0b43e0974325 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a24917-117d-4f59-af9f-d09093773d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8158d354-d5a7-4998-bb4e-1272d969db0f', 'volume_name': 'volume-8158d354-d5a7-4998-bb4e-1272d969db0f', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-28bf6e8c-fe17-46b9-88f8-0b43e0974325 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2daf473e-1d65-40f6-86cb-cea18cec6e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-28bf6e8c-fe17-46b9-88f8-0b43e0974325 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2daf473e-1d65-40f6-86cb-cea18cec6e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-28bf6e8c-fe17-46b9-88f8-0b43e0974325 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91bb1c85-a1ad-46a8-9ab8-a49327247881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:22 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-28bf6e8c-fe17-46b9-88f8-0b43e0974325 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Volume 8158d354-d5a7-4998-bb4e-1272d969db0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8158d354-d5a7-4998-bb4e-1272d969db0f', 'volume_size': 1} Sep 28 17:35:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-28bf6e8c-fe17-46b9-88f8-0b43e0974325 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:22 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0410ea5c-cf38-40c1-bd9a-f89da3089e32_x8antpn1devstack@QuobyteHD" returned: 1 in 0.368s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0410ea5c-cf38-40c1-bd9a-f89da3089e32_x8antpn1devstack@QuobyteHD' failed. Not Retrying. {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:35:22 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Temporary image 0410ea5c-cf38-40c1-bd9a-f89da3089e32 is fetched for user 6f47ca35a62c44829ecaa23d9c29c903. {{(pid=86917) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:35:22 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b96cf28-3a45-4888-8d1b-15e512e39070]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:35:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0410ea5c-cf38-40c1-bd9a-f89da3089e32_x8antpn1devstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:22 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0410ea5c-cf38-40c1-bd9a-f89da3089e32_x8antpn1devstack@QuobyteHD Sep 28 17:35:22 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:22 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2209ada4-3c38-4d63-a931-0739260fd322 tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b.4a01a5c2-3b72-4dad-a84c-772869745a9e 1G" returned: 0 in 0.515s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2209ada4-3c38-4d63-a931-0739260fd322 tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b.4a01a5c2-3b72-4dad-a84c-772869745a9e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:22 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b.4a01a5c2-3b72-4dad-a84c-772869745a9e Sep 28 17:35:22 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:23 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0410ea5c-cf38-40c1-bd9a-f89da3089e32_x8antpn1devstack@QuobyteHD" returned: 0 in 0.384s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0410ea5c-cf38-40c1-bd9a-f89da3089e32_x8antpn1devstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:23 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2209ada4-3c38-4d63-a931-0739260fd322 tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b.4a01a5c2-3b72-4dad-a84c-772869745a9e" returned: 0 in 0.316s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:23 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-2209ada4-3c38-4d63-a931-0739260fd322 tempest-CreateVolumesFromSnapshotTest-556144415 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b.4a01a5c2-3b72-4dad-a84c-772869745a9e is being set with open permissions: ugo+rw Sep 28 17:35:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2209ada4-3c38-4d63-a931-0739260fd322 tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b.4a01a5c2-3b72-4dad-a84c-772869745a9e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:23 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b.4a01a5c2-3b72-4dad-a84c-772869745a9e Sep 28 17:35:23 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0410ea5c-cf38-40c1-bd9a-f89da3089e32_x8antpn1devstack@QuobyteHD Sep 28 17:35:23 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:23 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:23 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2209ada4-3c38-4d63-a931-0739260fd322 tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b.4a01a5c2-3b72-4dad-a84c-772869745a9e" returned: 0 in 0.260s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:23 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0410ea5c-cf38-40c1-bd9a-f89da3089e32_x8antpn1devstack@QuobyteHD" returned: 1 in 0.364s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0410ea5c-cf38-40c1-bd9a-f89da3089e32_x8antpn1devstack@QuobyteHD' failed. Not Retrying. {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:35:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2209ada4-3c38-4d63-a931-0739260fd322 tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:23 devstack sudo[107766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b.info Sep 28 17:35:23 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:23 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2209ada4-3c38-4d63-a931-0739260fd322 tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b.info" returned: 0 in 0.265s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:23 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-2209ada4-3c38-4d63-a931-0739260fd322 tempest-CreateVolumesFromSnapshotTest-556144415 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b.info is being set with open permissions: ugo+rw Sep 28 17:35:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2209ada4-3c38-4d63-a931-0739260fd322 tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:23 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b.info Sep 28 17:35:23 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:23 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2209ada4-3c38-4d63-a931-0739260fd322 tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b.info" returned: 0 in 0.252s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2209ada4-3c38-4d63-a931-0739260fd322 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.353s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b1844412-dc63-4294-b907-1db06adc09ee tempest-CreateVolumesFromImageTest-192687972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.438s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b1844412-dc63-4294-b907-1db06adc09ee tempest-CreateVolumesFromImageTest-192687972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-131010832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=296666e8-41f5-468a-9b1f-8ca17c8d3ce5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4874c78ae548df9c92c97e9d5b9d70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:18Z,use_quota=True,user_id='c3c29c44bace42759ede43ac12bea36a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:35:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-b1844412-dc63-4294-b907-1db06adc09ee tempest-CreateVolumesFromImageTest-192687972 None] Creating volume 296666e8-41f5-468a-9b1f-8ca17c8d3ce5 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:35:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b1844412-dc63-4294-b907-1db06adc09ee tempest-CreateVolumesFromImageTest-192687972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b1844412-dc63-4294-b907-1db06adc09ee tempest-CreateVolumesFromImageTest-192687972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b1844412-dc63-4294-b907-1db06adc09ee tempest-CreateVolumesFromImageTest-192687972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b1844412-dc63-4294-b907-1db06adc09ee tempest-CreateVolumesFromImageTest-192687972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b1844412-dc63-4294-b907-1db06adc09ee tempest-CreateVolumesFromImageTest-192687972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b1844412-dc63-4294-b907-1db06adc09ee tempest-CreateVolumesFromImageTest-192687972 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:35:24 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-b1844412-dc63-4294-b907-1db06adc09ee tempest-CreateVolumesFromImageTest-192687972 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:35:23 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-296666e8-41f5-468a-9b1f-8ca17c8d3ce5 1073741824 Sep 28 17:35:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b1844412-dc63-4294-b907-1db06adc09ee tempest-CreateVolumesFromImageTest-192687972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-296666e8-41f5-468a-9b1f-8ca17c8d3ce5 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:24 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-2209ada4-3c38-4d63-a931-0739260fd322 tempest-CreateVolumesFromSnapshotTest-556144415 None] Create snapshot completed successfully Sep 28 17:35:23 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:24 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b1844412-dc63-4294-b907-1db06adc09ee tempest-CreateVolumesFromImageTest-192687972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-296666e8-41f5-468a-9b1f-8ca17c8d3ce5 1073741824" returned: 0 in 0.473s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b1844412-dc63-4294-b907-1db06adc09ee tempest-CreateVolumesFromImageTest-192687972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-296666e8-41f5-468a-9b1f-8ca17c8d3ce5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:24 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-296666e8-41f5-468a-9b1f-8ca17c8d3ce5 Sep 28 17:35:24 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:24 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b1844412-dc63-4294-b907-1db06adc09ee tempest-CreateVolumesFromImageTest-192687972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-296666e8-41f5-468a-9b1f-8ca17c8d3ce5" returned: 0 in 0.262s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b1844412-dc63-4294-b907-1db06adc09ee tempest-CreateVolumesFromImageTest-192687972 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:35:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b1844412-dc63-4294-b907-1db06adc09ee tempest-CreateVolumesFromImageTest-192687972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-890a5fed-8845-40a9-bfbb-27a9913ab8f2 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.640s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-890a5fed-8845-40a9-bfbb-27a9913ab8f2 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1892578414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faccbdd5-ba10-4daa-8cc1-3a0434d27c08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='713b25778b3249ea9fb111d34096d5c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:21Z,use_quota=True,user_id='239f5a31ee02460b9a4b8bd670f8f600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:35:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-890a5fed-8845-40a9-bfbb-27a9913ab8f2 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Creating volume faccbdd5-ba10-4daa-8cc1-3a0434d27c08 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:35:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-890a5fed-8845-40a9-bfbb-27a9913ab8f2 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-890a5fed-8845-40a9-bfbb-27a9913ab8f2 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-890a5fed-8845-40a9-bfbb-27a9913ab8f2 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-890a5fed-8845-40a9-bfbb-27a9913ab8f2 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-890a5fed-8845-40a9-bfbb-27a9913ab8f2 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-890a5fed-8845-40a9-bfbb-27a9913ab8f2 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:35:24 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-890a5fed-8845-40a9-bfbb-27a9913ab8f2 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:35:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-890a5fed-8845-40a9-bfbb-27a9913ab8f2 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-faccbdd5-ba10-4daa-8cc1-3a0434d27c08 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b1844412-dc63-4294-b907-1db06adc09ee tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a4d972-1d4f-45bd-8d71-f1b11fb3ee44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-296666e8-41f5-468a-9b1f-8ca17c8d3ce5', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:24 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-faccbdd5-ba10-4daa-8cc1-3a0434d27c08 1073741824 Sep 28 17:35:24 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b1844412-dc63-4294-b907-1db06adc09ee tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7140dd5-69a9-49c6-a4d4-0d40883b2054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:24 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-b1844412-dc63-4294-b907-1db06adc09ee tempest-CreateVolumesFromImageTest-192687972 None] Volume volume-296666e8-41f5-468a-9b1f-8ca17c8d3ce5 (296666e8-41f5-468a-9b1f-8ca17c8d3ce5): created successfully Sep 28 17:35:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b1844412-dc63-4294-b907-1db06adc09ee tempest-CreateVolumesFromImageTest-192687972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7140dd5-69a9-49c6-a4d4-0d40883b2054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b1844412-dc63-4294-b907-1db06adc09ee tempest-CreateVolumesFromImageTest-192687972 None] Flow 'volume_create_manager' (e9b9af79-9293-4d93-85d3-e1c30277425e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:24 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-b1844412-dc63-4294-b907-1db06adc09ee tempest-CreateVolumesFromImageTest-192687972 None] Created volume successfully. Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff114b69-308a-4467-bb27-ed3f0b28f6ad tempest-CreateVolumesFromSnapshotTest-556144415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff114b69-308a-4467-bb27-ed3f0b28f6ad tempest-CreateVolumesFromSnapshotTest-556144415 None] Flow 'volume_create_manager' (c49a7689-48cb-4237-898c-00f01e2f9b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff114b69-308a-4467-bb27-ed3f0b28f6ad tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c8b9d7-cdd9-4519-ae5d-493803cbaf3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a8e6fb7f-ef9a-4fb5-8d06-c6d78c106ddd tempest-CreateVolumesFromImageTest-192687972 None] Acquiring lock "cinder-296666e8-41f5-468a-9b1f-8ca17c8d3ce5-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff114b69-308a-4467-bb27-ed3f0b28f6ad tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c8b9d7-cdd9-4519-ae5d-493803cbaf3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-132827636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c12cde6-56e3-4ed3-a1d6-5b227a036a65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e31a8b9f98504508bbf6f0f6308f704d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:25Z,use_quota=True,user_id='53248b61305f4b41a36ac533bdced5e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff114b69-308a-4467-bb27-ed3f0b28f6ad tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da293af3-604c-428b-84bd-c72c16435cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff114b69-308a-4467-bb27-ed3f0b28f6ad tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da293af3-604c-428b-84bd-c72c16435cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff114b69-308a-4467-bb27-ed3f0b28f6ad tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d015533-e1c0-4441-94d7-8ccf4aaadb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff114b69-308a-4467-bb27-ed3f0b28f6ad tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d015533-e1c0-4441-94d7-8ccf4aaadb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c12cde6-56e3-4ed3-a1d6-5b227a036a65', 'volume_name': 'volume-8c12cde6-56e3-4ed3-a1d6-5b227a036a65', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff114b69-308a-4467-bb27-ed3f0b28f6ad tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aab7e9f-8c76-4f2c-b262-b71b0b68b9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff114b69-308a-4467-bb27-ed3f0b28f6ad tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aab7e9f-8c76-4f2c-b262-b71b0b68b9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff114b69-308a-4467-bb27-ed3f0b28f6ad tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21bb1d90-380b-4156-8364-516c3c1e5222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:25 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-ff114b69-308a-4467-bb27-ed3f0b28f6ad tempest-CreateVolumesFromSnapshotTest-556144415 None] Volume 8c12cde6-56e3-4ed3-a1d6-5b227a036a65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c12cde6-56e3-4ed3-a1d6-5b227a036a65', 'volume_size': 1} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ff114b69-308a-4467-bb27-ed3f0b28f6ad tempest-CreateVolumesFromSnapshotTest-556144415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a8e6fb7f-ef9a-4fb5-8d06-c6d78c106ddd tempest-CreateVolumesFromImageTest-192687972 None] Lock "cinder-296666e8-41f5-468a-9b1f-8ca17c8d3ce5-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a8e6fb7f-ef9a-4fb5-8d06-c6d78c106ddd tempest-CreateVolumesFromImageTest-192687972 None] Acquiring lock "cinder-quobyte-296666e8-41f5-468a-9b1f-8ca17c8d3ce5" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a8e6fb7f-ef9a-4fb5-8d06-c6d78c106ddd tempest-CreateVolumesFromImageTest-192687972 None] Lock "cinder-quobyte-296666e8-41f5-468a-9b1f-8ca17c8d3ce5" acquired by "delete_volume" :: waited 0.031s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6617678-0db0-45e5-952b-c6f29f06033a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a8e6fb7f-ef9a-4fb5-8d06-c6d78c106ddd tempest-CreateVolumesFromImageTest-192687972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-296666e8-41f5-468a-9b1f-8ca17c8d3ce5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:25 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-890a5fed-8845-40a9-bfbb-27a9913ab8f2 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-faccbdd5-ba10-4daa-8cc1-3a0434d27c08 1073741824" returned: 0 in 0.683s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-890a5fed-8845-40a9-bfbb-27a9913ab8f2 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-faccbdd5-ba10-4daa-8cc1-3a0434d27c08 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:25 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-296666e8-41f5-468a-9b1f-8ca17c8d3ce5 Sep 28 17:35:25 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:25 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-faccbdd5-ba10-4daa-8cc1-3a0434d27c08 Sep 28 17:35:25 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b9a193a-cd4a-4d5b-8b73-cc2a76248357 tempest-CreateVolumesFromSnapshotTest-556144415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:35:25 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b9a193a-cd4a-4d5b-8b73-cc2a76248357 tempest-CreateVolumesFromSnapshotTest-556144415 None] Flow 'volume_create_manager' (271950e6-1719-43d0-988c-5f7dbec34485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b9a193a-cd4a-4d5b-8b73-cc2a76248357 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f39c1891-8176-49fe-b21f-d36c2269480c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-890a5fed-8845-40a9-bfbb-27a9913ab8f2 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-faccbdd5-ba10-4daa-8cc1-3a0434d27c08" returned: 0 in 0.351s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-890a5fed-8845-40a9-bfbb-27a9913ab8f2 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-890a5fed-8845-40a9-bfbb-27a9913ab8f2 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-eac0e931-a61f-4710-b2d1-4b2193d8ceea tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.592s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:25 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-eac0e931-a61f-4710-b2d1-4b2193d8ceea tempest-CreateVolumesFromSourceVolumeTest-929854129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1211432467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=303e7063-e9c2-4a67-a61b-8ad295015a68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='713b25778b3249ea9fb111d34096d5c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:21Z,use_quota=True,user_id='239f5a31ee02460b9a4b8bd670f8f600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-eac0e931-a61f-4710-b2d1-4b2193d8ceea tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Creating volume 303e7063-e9c2-4a67-a61b-8ad295015a68 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-eac0e931-a61f-4710-b2d1-4b2193d8ceea tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-eac0e931-a61f-4710-b2d1-4b2193d8ceea tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-eac0e931-a61f-4710-b2d1-4b2193d8ceea tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-eac0e931-a61f-4710-b2d1-4b2193d8ceea tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-eac0e931-a61f-4710-b2d1-4b2193d8ceea tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-eac0e931-a61f-4710-b2d1-4b2193d8ceea tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:35:25 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-eac0e931-a61f-4710-b2d1-4b2193d8ceea tempest-CreateVolumesFromSourceVolumeTest-929854129 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-eac0e931-a61f-4710-b2d1-4b2193d8ceea tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-303e7063-e9c2-4a67-a61b-8ad295015a68 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b9a193a-cd4a-4d5b-8b73-cc2a76248357 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f39c1891-8176-49fe-b21f-d36c2269480c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1751565695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=257c658b-f9f9-48d0-b74b-67293af1c8ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e31a8b9f98504508bbf6f0f6308f704d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:26Z,use_quota=True,user_id='53248b61305f4b41a36ac533bdced5e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b9a193a-cd4a-4d5b-8b73-cc2a76248357 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f75be5d-f77d-433f-adeb-4a9b3b9bed9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:25 devstack sudo[107797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-303e7063-e9c2-4a67-a61b-8ad295015a68 1073741824 Sep 28 17:35:25 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b9a193a-cd4a-4d5b-8b73-cc2a76248357 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f75be5d-f77d-433f-adeb-4a9b3b9bed9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b9a193a-cd4a-4d5b-8b73-cc2a76248357 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0458528a-eebb-458d-8124-59d31b83ea12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b9a193a-cd4a-4d5b-8b73-cc2a76248357 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0458528a-eebb-458d-8124-59d31b83ea12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '257c658b-f9f9-48d0-b74b-67293af1c8ce', 'volume_name': 'volume-257c658b-f9f9-48d0-b74b-67293af1c8ce', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b9a193a-cd4a-4d5b-8b73-cc2a76248357 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d091ce3-fe25-4ff7-966a-200521fd6fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b9a193a-cd4a-4d5b-8b73-cc2a76248357 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d091ce3-fe25-4ff7-966a-200521fd6fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b9a193a-cd4a-4d5b-8b73-cc2a76248357 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (414716a2-11d8-4cad-8c77-e184ba84b4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:25 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-6b9a193a-cd4a-4d5b-8b73-cc2a76248357 tempest-CreateVolumesFromSnapshotTest-556144415 None] Volume 257c658b-f9f9-48d0-b74b-67293af1c8ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-257c658b-f9f9-48d0-b74b-67293af1c8ce', 'volume_size': 1} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6b9a193a-cd4a-4d5b-8b73-cc2a76248357 tempest-CreateVolumesFromSnapshotTest-556144415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a8e6fb7f-ef9a-4fb5-8d06-c6d78c106ddd tempest-CreateVolumesFromImageTest-192687972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-296666e8-41f5-468a-9b1f-8ca17c8d3ce5" returned: 0 in 0.548s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a8e6fb7f-ef9a-4fb5-8d06-c6d78c106ddd tempest-CreateVolumesFromImageTest-192687972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-296666e8-41f5-468a-9b1f-8ca17c8d3ce5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-890a5fed-8845-40a9-bfbb-27a9913ab8f2 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d4345e3-eab2-4a69-88bb-2acc6bd43997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faccbdd5-ba10-4daa-8cc1-3a0434d27c08', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:25 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-890a5fed-8845-40a9-bfbb-27a9913ab8f2 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd027f93-01e7-4abe-9947-9be188632287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:25 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-296666e8-41f5-468a-9b1f-8ca17c8d3ce5 Sep 28 17:35:25 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:25 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-890a5fed-8845-40a9-bfbb-27a9913ab8f2 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Volume volume-faccbdd5-ba10-4daa-8cc1-3a0434d27c08 (faccbdd5-ba10-4daa-8cc1-3a0434d27c08): created successfully Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-890a5fed-8845-40a9-bfbb-27a9913ab8f2 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd027f93-01e7-4abe-9947-9be188632287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-890a5fed-8845-40a9-bfbb-27a9913ab8f2 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Flow 'volume_create_manager' (3dcb33d0-44b9-4995-8e45-b12e6a68c11f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:26 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-890a5fed-8845-40a9-bfbb-27a9913ab8f2 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Created volume successfully. Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d86468e-662f-40b9-a183-ab6a0436764f tempest-CreateVolumesFromSnapshotTest-556144415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9d86468e-662f-40b9-a183-ab6a0436764f tempest-CreateVolumesFromSnapshotTest-556144415 None] Flow 'volume_create_manager' (05afe88c-3841-40b5-bc18-d6f2839885e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9d86468e-662f-40b9-a183-ab6a0436764f tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (668caafc-dc1e-48fe-aed1-6212ae2af7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:26 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a8e6fb7f-ef9a-4fb5-8d06-c6d78c106ddd tempest-CreateVolumesFromImageTest-192687972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-296666e8-41f5-468a-9b1f-8ca17c8d3ce5" returned: 0 in 0.371s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9d86468e-662f-40b9-a183-ab6a0436764f tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (668caafc-dc1e-48fe-aed1-6212ae2af7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1365638675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9a341c-0572-4b5e-85b5-dee6911c5c2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e31a8b9f98504508bbf6f0f6308f704d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:26Z,use_quota=True,user_id='53248b61305f4b41a36ac533bdced5e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9d86468e-662f-40b9-a183-ab6a0436764f tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c61507f-9c6f-41fe-9558-f42c117b5411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9d86468e-662f-40b9-a183-ab6a0436764f tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c61507f-9c6f-41fe-9558-f42c117b5411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9d86468e-662f-40b9-a183-ab6a0436764f tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (096f9d03-cf9b-41be-b92f-6b2a906542ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9d86468e-662f-40b9-a183-ab6a0436764f tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (096f9d03-cf9b-41be-b92f-6b2a906542ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd9a341c-0572-4b5e-85b5-dee6911c5c2f', 'volume_name': 'volume-cd9a341c-0572-4b5e-85b5-dee6911c5c2f', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9d86468e-662f-40b9-a183-ab6a0436764f tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16b8c125-8ecb-441f-912c-4fbfe48ab0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9d86468e-662f-40b9-a183-ab6a0436764f tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16b8c125-8ecb-441f-912c-4fbfe48ab0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9d86468e-662f-40b9-a183-ab6a0436764f tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531c7f3d-b7d1-4966-b9b8-801145a4d41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:26 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-9d86468e-662f-40b9-a183-ab6a0436764f tempest-CreateVolumesFromSnapshotTest-556144415 None] Volume cd9a341c-0572-4b5e-85b5-dee6911c5c2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd9a341c-0572-4b5e-85b5-dee6911c5c2f', 'volume_size': 1} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9d86468e-662f-40b9-a183-ab6a0436764f tempest-CreateVolumesFromSnapshotTest-556144415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a8e6fb7f-ef9a-4fb5-8d06-c6d78c106ddd tempest-CreateVolumesFromImageTest-192687972 None] Lock "cinder-quobyte-296666e8-41f5-468a-9b1f-8ca17c8d3ce5" released by "delete_volume" :: held 1.027s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-a8e6fb7f-ef9a-4fb5-8d06-c6d78c106ddd tempest-CreateVolumesFromImageTest-192687972 None] Created reservations ['79148b22-e32a-46df-a63b-83af29c90492', '8aa04840-f9de-43d8-a0a6-135e256e1050', 'c6608f21-b903-49c5-860f-26b0f0e7a33f', '313b0fb8-06b5-45e5-9860-ea1069176e8f'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:35:26 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-eac0e931-a61f-4710-b2d1-4b2193d8ceea tempest-CreateVolumesFromSourceVolumeTest-929854129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-303e7063-e9c2-4a67-a61b-8ad295015a68 1073741824" returned: 0 in 0.684s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a8e6fb7f-ef9a-4fb5-8d06-c6d78c106ddd tempest-CreateVolumesFromImageTest-192687972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a8e6fb7f-ef9a-4fb5-8d06-c6d78c106ddd tempest-CreateVolumesFromImageTest-192687972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a8e6fb7f-ef9a-4fb5-8d06-c6d78c106ddd tempest-CreateVolumesFromImageTest-192687972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a8e6fb7f-ef9a-4fb5-8d06-c6d78c106ddd tempest-CreateVolumesFromImageTest-192687972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a8e6fb7f-ef9a-4fb5-8d06-c6d78c106ddd tempest-CreateVolumesFromImageTest-192687972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a8e6fb7f-ef9a-4fb5-8d06-c6d78c106ddd tempest-CreateVolumesFromImageTest-192687972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:26 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:35:26 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-eac0e931-a61f-4710-b2d1-4b2193d8ceea tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-303e7063-e9c2-4a67-a61b-8ad295015a68 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:26 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-303e7063-e9c2-4a67-a61b-8ad295015a68 Sep 28 17:35:26 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-b73da2c9-78a9-4b9f-b0b4-6c9288cd1f1d tempest-CreateVolumesFromSnapshotTest-556144415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b73da2c9-78a9-4b9f-b0b4-6c9288cd1f1d tempest-CreateVolumesFromSnapshotTest-556144415 None] Flow 'volume_create_manager' (3e5d7613-92fa-4dfa-bb21-3a0ee94b2841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b73da2c9-78a9-4b9f-b0b4-6c9288cd1f1d tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1808db1f-62da-4a6d-888a-9d07f5f07005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b73da2c9-78a9-4b9f-b0b4-6c9288cd1f1d tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1808db1f-62da-4a6d-888a-9d07f5f07005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1072775855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d521da4f-8d53-4ed3-84ce-511617c977f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e31a8b9f98504508bbf6f0f6308f704d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:27Z,use_quota=True,user_id='53248b61305f4b41a36ac533bdced5e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b73da2c9-78a9-4b9f-b0b4-6c9288cd1f1d tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09d7a0b1-fb80-415b-9a6c-cbe9f5481a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b73da2c9-78a9-4b9f-b0b4-6c9288cd1f1d tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09d7a0b1-fb80-415b-9a6c-cbe9f5481a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b73da2c9-78a9-4b9f-b0b4-6c9288cd1f1d tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6fdc25e-d9f0-4696-aa65-4fff41c9c0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b73da2c9-78a9-4b9f-b0b4-6c9288cd1f1d tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6fdc25e-d9f0-4696-aa65-4fff41c9c0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd521da4f-8d53-4ed3-84ce-511617c977f3', 'volume_name': 'volume-d521da4f-8d53-4ed3-84ce-511617c977f3', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b73da2c9-78a9-4b9f-b0b4-6c9288cd1f1d tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69e51571-deb3-40bb-a2a6-7a151fed587a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b73da2c9-78a9-4b9f-b0b4-6c9288cd1f1d tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69e51571-deb3-40bb-a2a6-7a151fed587a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b73da2c9-78a9-4b9f-b0b4-6c9288cd1f1d tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dbe77d7-3765-4c63-b29d-9d115f1664aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:26 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-b73da2c9-78a9-4b9f-b0b4-6c9288cd1f1d tempest-CreateVolumesFromSnapshotTest-556144415 None] Volume d521da4f-8d53-4ed3-84ce-511617c977f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d521da4f-8d53-4ed3-84ce-511617c977f3', 'volume_size': 1} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b73da2c9-78a9-4b9f-b0b4-6c9288cd1f1d tempest-CreateVolumesFromSnapshotTest-556144415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:26 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a8e6fb7f-ef9a-4fb5-8d06-c6d78c106ddd tempest-CreateVolumesFromImageTest-192687972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.359s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-a8e6fb7f-ef9a-4fb5-8d06-c6d78c106ddd tempest-CreateVolumesFromImageTest-192687972 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:35:26 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-a8e6fb7f-ef9a-4fb5-8d06-c6d78c106ddd tempest-CreateVolumesFromImageTest-192687972 None] Deleted volume successfully. Sep 28 17:35:26 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a8e6fb7f-ef9a-4fb5-8d06-c6d78c106ddd tempest-CreateVolumesFromImageTest-192687972 None] Lock "cinder-296666e8-41f5-468a-9b1f-8ca17c8d3ce5-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-eac0e931-a61f-4710-b2d1-4b2193d8ceea tempest-CreateVolumesFromSourceVolumeTest-929854129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-303e7063-e9c2-4a67-a61b-8ad295015a68" returned: 0 in 0.360s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-eac0e931-a61f-4710-b2d1-4b2193d8ceea tempest-CreateVolumesFromSourceVolumeTest-929854129 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-eac0e931-a61f-4710-b2d1-4b2193d8ceea tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c23df250-9a10-476e-8fdc-a712411f3f3f tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.490s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c23df250-9a10-476e-8fdc-a712411f3f3f tempest-CreateVolumesFromSourceVolumeTest-929854129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1441467721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b36f51e-d577-48e9-8f5f-d8266251e76c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='713b25778b3249ea9fb111d34096d5c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:21Z,use_quota=True,user_id='239f5a31ee02460b9a4b8bd670f8f600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-c23df250-9a10-476e-8fdc-a712411f3f3f tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Creating volume 3b36f51e-d577-48e9-8f5f-d8266251e76c {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c23df250-9a10-476e-8fdc-a712411f3f3f tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c23df250-9a10-476e-8fdc-a712411f3f3f tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:26 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c23df250-9a10-476e-8fdc-a712411f3f3f tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c23df250-9a10-476e-8fdc-a712411f3f3f tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c23df250-9a10-476e-8fdc-a712411f3f3f tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c23df250-9a10-476e-8fdc-a712411f3f3f tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:35:27 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-c23df250-9a10-476e-8fdc-a712411f3f3f tempest-CreateVolumesFromSourceVolumeTest-929854129 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c23df250-9a10-476e-8fdc-a712411f3f3f tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3b36f51e-d577-48e9-8f5f-d8266251e76c 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-eac0e931-a61f-4710-b2d1-4b2193d8ceea tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9be1dbe-f305-4bf0-b70c-24e198132c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-303e7063-e9c2-4a67-a61b-8ad295015a68', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-eac0e931-a61f-4710-b2d1-4b2193d8ceea tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e6e1cd-6245-4b1e-8b10-c239fec1d66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:27 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3b36f51e-d577-48e9-8f5f-d8266251e76c 1073741824 Sep 28 17:35:27 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:27 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-eac0e931-a61f-4710-b2d1-4b2193d8ceea tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Volume volume-303e7063-e9c2-4a67-a61b-8ad295015a68 (303e7063-e9c2-4a67-a61b-8ad295015a68): created successfully Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-eac0e931-a61f-4710-b2d1-4b2193d8ceea tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e6e1cd-6245-4b1e-8b10-c239fec1d66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-eac0e931-a61f-4710-b2d1-4b2193d8ceea tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Flow 'volume_create_manager' (dd958a66-9c43-4012-95af-605bec259ec2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:27 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-eac0e931-a61f-4710-b2d1-4b2193d8ceea tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Created volume successfully. Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b9e921b-6ab3-4b59-9748-9c85d4a08907 tempest-CreateVolumesFromSnapshotTest-556144415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7b9e921b-6ab3-4b59-9748-9c85d4a08907 tempest-CreateVolumesFromSnapshotTest-556144415 None] Flow 'volume_create_manager' (8eddb44c-49f8-41ad-9cac-7c2af74f3842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7b9e921b-6ab3-4b59-9748-9c85d4a08907 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b12de5c-8013-48a4-90c1-ce459942a47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7b9e921b-6ab3-4b59-9748-9c85d4a08907 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b12de5c-8013-48a4-90c1-ce459942a47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2135707291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77c70c5e-76dc-4cad-a5ae-f2cd63223130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e31a8b9f98504508bbf6f0f6308f704d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:27Z,use_quota=True,user_id='53248b61305f4b41a36ac533bdced5e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7b9e921b-6ab3-4b59-9748-9c85d4a08907 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e166cb2-d173-4a19-b3f7-eb547c253167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7b9e921b-6ab3-4b59-9748-9c85d4a08907 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e166cb2-d173-4a19-b3f7-eb547c253167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7b9e921b-6ab3-4b59-9748-9c85d4a08907 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b3108f3-d01e-49a7-8a20-decd56d4eb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7b9e921b-6ab3-4b59-9748-9c85d4a08907 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b3108f3-d01e-49a7-8a20-decd56d4eb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77c70c5e-76dc-4cad-a5ae-f2cd63223130', 'volume_name': 'volume-77c70c5e-76dc-4cad-a5ae-f2cd63223130', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7b9e921b-6ab3-4b59-9748-9c85d4a08907 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fbbada6-b5d2-4235-80e8-229d1b78fa29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7b9e921b-6ab3-4b59-9748-9c85d4a08907 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fbbada6-b5d2-4235-80e8-229d1b78fa29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7b9e921b-6ab3-4b59-9748-9c85d4a08907 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4bd3300-bd31-40e8-a489-a7eb091809b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:27 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-7b9e921b-6ab3-4b59-9748-9c85d4a08907 tempest-CreateVolumesFromSnapshotTest-556144415 None] Volume 77c70c5e-76dc-4cad-a5ae-f2cd63223130: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77c70c5e-76dc-4cad-a5ae-f2cd63223130', 'volume_size': 1} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7b9e921b-6ab3-4b59-9748-9c85d4a08907 tempest-CreateVolumesFromSnapshotTest-556144415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d1f2161d-b37f-4e74-9425-22db3d2b36dc tempest-CreateVolumesFromImageTest-192687972 None] Acquiring lock "cinder-c24c1f90-20c9-4a2e-897b-7c96c3dcb26c-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d1f2161d-b37f-4e74-9425-22db3d2b36dc tempest-CreateVolumesFromImageTest-192687972 None] Lock "cinder-c24c1f90-20c9-4a2e-897b-7c96c3dcb26c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:27 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c23df250-9a10-476e-8fdc-a712411f3f3f tempest-CreateVolumesFromSourceVolumeTest-929854129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3b36f51e-d577-48e9-8f5f-d8266251e76c 1073741824" returned: 0 in 0.489s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d1f2161d-b37f-4e74-9425-22db3d2b36dc tempest-CreateVolumesFromImageTest-192687972 None] Acquiring lock "cinder-quobyte-c24c1f90-20c9-4a2e-897b-7c96c3dcb26c" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d1f2161d-b37f-4e74-9425-22db3d2b36dc tempest-CreateVolumesFromImageTest-192687972 None] Lock "cinder-quobyte-c24c1f90-20c9-4a2e-897b-7c96c3dcb26c" acquired by "delete_volume" :: waited 0.023s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c23df250-9a10-476e-8fdc-a712411f3f3f tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3b36f51e-d577-48e9-8f5f-d8266251e76c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da73a88-dedd-49c5-a355-8cce959a6691]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d1f2161d-b37f-4e74-9425-22db3d2b36dc tempest-CreateVolumesFromImageTest-192687972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c24c1f90-20c9-4a2e-897b-7c96c3dcb26c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:27 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3b36f51e-d577-48e9-8f5f-d8266251e76c Sep 28 17:35:27 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:27 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c24c1f90-20c9-4a2e-897b-7c96c3dcb26c Sep 28 17:35:27 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:27 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c23df250-9a10-476e-8fdc-a712411f3f3f tempest-CreateVolumesFromSourceVolumeTest-929854129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3b36f51e-d577-48e9-8f5f-d8266251e76c" returned: 0 in 0.273s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c23df250-9a10-476e-8fdc-a712411f3f3f tempest-CreateVolumesFromSourceVolumeTest-929854129 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c23df250-9a10-476e-8fdc-a712411f3f3f tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1611e80b-9ee3-4088-af6c-008d7c9fe583 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.875s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-1611e80b-9ee3-4088-af6c-008d7c9fe583 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1666268667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=975d802d-c236-48a5-93c4-486b23fd5dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='713b25778b3249ea9fb111d34096d5c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:22Z,use_quota=True,user_id='239f5a31ee02460b9a4b8bd670f8f600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-1611e80b-9ee3-4088-af6c-008d7c9fe583 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Creating volume 975d802d-c236-48a5-93c4-486b23fd5dfa {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1611e80b-9ee3-4088-af6c-008d7c9fe583 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1611e80b-9ee3-4088-af6c-008d7c9fe583 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-1611e80b-9ee3-4088-af6c-008d7c9fe583 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-1611e80b-9ee3-4088-af6c-008d7c9fe583 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1611e80b-9ee3-4088-af6c-008d7c9fe583 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-1611e80b-9ee3-4088-af6c-008d7c9fe583 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:35:27 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-1611e80b-9ee3-4088-af6c-008d7c9fe583 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1611e80b-9ee3-4088-af6c-008d7c9fe583 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-975d802d-c236-48a5-93c4-486b23fd5dfa 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c23df250-9a10-476e-8fdc-a712411f3f3f tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b150286-aeb6-446a-85e5-859fa6393a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b36f51e-d577-48e9-8f5f-d8266251e76c', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c23df250-9a10-476e-8fdc-a712411f3f3f tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (787b584b-0ba0-40f0-8b9a-400409b7c347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:27 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-975d802d-c236-48a5-93c4-486b23fd5dfa 1073741824 Sep 28 17:35:27 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:27 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-c23df250-9a10-476e-8fdc-a712411f3f3f tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Volume volume-3b36f51e-d577-48e9-8f5f-d8266251e76c (3b36f51e-d577-48e9-8f5f-d8266251e76c): created successfully Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c23df250-9a10-476e-8fdc-a712411f3f3f tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (787b584b-0ba0-40f0-8b9a-400409b7c347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c23df250-9a10-476e-8fdc-a712411f3f3f tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Flow 'volume_create_manager' (31f573a7-f792-4a16-94e6-f5a8e60b46c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:27 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-c23df250-9a10-476e-8fdc-a712411f3f3f tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Created volume successfully. Sep 28 17:35:27 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d1f2161d-b37f-4e74-9425-22db3d2b36dc tempest-CreateVolumesFromImageTest-192687972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c24c1f90-20c9-4a2e-897b-7c96c3dcb26c" returned: 0 in 0.406s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d1f2161d-b37f-4e74-9425-22db3d2b36dc tempest-CreateVolumesFromImageTest-192687972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c24c1f90-20c9-4a2e-897b-7c96c3dcb26c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:28 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c24c1f90-20c9-4a2e-897b-7c96c3dcb26c Sep 28 17:35:28 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:28 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d1f2161d-b37f-4e74-9425-22db3d2b36dc tempest-CreateVolumesFromImageTest-192687972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-c24c1f90-20c9-4a2e-897b-7c96c3dcb26c" returned: 0 in 0.284s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d1f2161d-b37f-4e74-9425-22db3d2b36dc tempest-CreateVolumesFromImageTest-192687972 None] Lock "cinder-quobyte-c24c1f90-20c9-4a2e-897b-7c96c3dcb26c" released by "delete_volume" :: held 0.748s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:28 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1611e80b-9ee3-4088-af6c-008d7c9fe583 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-975d802d-c236-48a5-93c4-486b23fd5dfa 1073741824" returned: 0 in 0.475s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-d1f2161d-b37f-4e74-9425-22db3d2b36dc tempest-CreateVolumesFromImageTest-192687972 None] Created reservations ['b77cac94-e59f-4193-95d1-c1b8045d3e4e', '3f23c5ae-b192-4221-9fdb-19613feedcef', '90e7a164-c583-42b1-b524-956b30b9e701', '43a2d35a-05a7-47cb-8786-ba4ad719866d'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1611e80b-9ee3-4088-af6c-008d7c9fe583 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-975d802d-c236-48a5-93c4-486b23fd5dfa {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:28 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-975d802d-c236-48a5-93c4-486b23fd5dfa Sep 28 17:35:28 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d1f2161d-b37f-4e74-9425-22db3d2b36dc tempest-CreateVolumesFromImageTest-192687972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d1f2161d-b37f-4e74-9425-22db3d2b36dc tempest-CreateVolumesFromImageTest-192687972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d1f2161d-b37f-4e74-9425-22db3d2b36dc tempest-CreateVolumesFromImageTest-192687972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d1f2161d-b37f-4e74-9425-22db3d2b36dc tempest-CreateVolumesFromImageTest-192687972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d1f2161d-b37f-4e74-9425-22db3d2b36dc tempest-CreateVolumesFromImageTest-192687972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d1f2161d-b37f-4e74-9425-22db3d2b36dc tempest-CreateVolumesFromImageTest-192687972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:28 devstack sudo[107837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:35:28 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-4c565b7e-59c0-460d-86c2-689d50b5c7ac tempest-CreateVolumesFromImageTest-192687972 None] Acquiring lock "cinder-18d5f6f0-a124-42ce-a194-2edfbdb7f830-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:28 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1611e80b-9ee3-4088-af6c-008d7c9fe583 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-975d802d-c236-48a5-93c4-486b23fd5dfa" returned: 0 in 0.315s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-1611e80b-9ee3-4088-af6c-008d7c9fe583 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1611e80b-9ee3-4088-af6c-008d7c9fe583 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-28bf6e8c-fe17-46b9-88f8-0b43e0974325 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.318s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-28bf6e8c-fe17-46b9-88f8-0b43e0974325 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1377548583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8158d354-d5a7-4998-bb4e-1272d969db0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='713b25778b3249ea9fb111d34096d5c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:22Z,use_quota=True,user_id='239f5a31ee02460b9a4b8bd670f8f600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-28bf6e8c-fe17-46b9-88f8-0b43e0974325 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Creating volume 8158d354-d5a7-4998-bb4e-1272d969db0f {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-28bf6e8c-fe17-46b9-88f8-0b43e0974325 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-28bf6e8c-fe17-46b9-88f8-0b43e0974325 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-28bf6e8c-fe17-46b9-88f8-0b43e0974325 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-28bf6e8c-fe17-46b9-88f8-0b43e0974325 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-28bf6e8c-fe17-46b9-88f8-0b43e0974325 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-28bf6e8c-fe17-46b9-88f8-0b43e0974325 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:35:28 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-28bf6e8c-fe17-46b9-88f8-0b43e0974325 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-28bf6e8c-fe17-46b9-88f8-0b43e0974325 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8158d354-d5a7-4998-bb4e-1272d969db0f 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-4c565b7e-59c0-460d-86c2-689d50b5c7ac tempest-CreateVolumesFromImageTest-192687972 None] Lock "cinder-18d5f6f0-a124-42ce-a194-2edfbdb7f830-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:28 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8158d354-d5a7-4998-bb4e-1272d969db0f 1073741824 Sep 28 17:35:28 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1611e80b-9ee3-4088-af6c-008d7c9fe583 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0e733c7-2c9f-4253-b495-0005e5344b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-975d802d-c236-48a5-93c4-486b23fd5dfa', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1611e80b-9ee3-4088-af6c-008d7c9fe583 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c032f46-8d9e-4521-918a-fbc2818757dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:28 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-1611e80b-9ee3-4088-af6c-008d7c9fe583 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Volume volume-975d802d-c236-48a5-93c4-486b23fd5dfa (975d802d-c236-48a5-93c4-486b23fd5dfa): created successfully Sep 28 17:35:28 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1611e80b-9ee3-4088-af6c-008d7c9fe583 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c032f46-8d9e-4521-918a-fbc2818757dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-1611e80b-9ee3-4088-af6c-008d7c9fe583 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Flow 'volume_create_manager' (c07ebf79-9517-4cb5-bb37-0623ead6a007) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d1f2161d-b37f-4e74-9425-22db3d2b36dc tempest-CreateVolumesFromImageTest-192687972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.357s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-d1f2161d-b37f-4e74-9425-22db3d2b36dc tempest-CreateVolumesFromImageTest-192687972 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:35:28 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-d1f2161d-b37f-4e74-9425-22db3d2b36dc tempest-CreateVolumesFromImageTest-192687972 None] Deleted volume successfully. Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-4c565b7e-59c0-460d-86c2-689d50b5c7ac tempest-CreateVolumesFromImageTest-192687972 None] Acquiring lock "cinder-quobyte-18d5f6f0-a124-42ce-a194-2edfbdb7f830" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:28 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-1611e80b-9ee3-4088-af6c-008d7c9fe583 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Created volume successfully. Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-4c565b7e-59c0-460d-86c2-689d50b5c7ac tempest-CreateVolumesFromImageTest-192687972 None] Lock "cinder-quobyte-18d5f6f0-a124-42ce-a194-2edfbdb7f830" acquired by "delete_volume" :: waited 0.028s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d1f2161d-b37f-4e74-9425-22db3d2b36dc tempest-CreateVolumesFromImageTest-192687972 None] Lock "cinder-c24c1f90-20c9-4a2e-897b-7c96c3dcb26c-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c70127-4958-4a03-b00e-2c75cd766d48]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:35:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4c565b7e-59c0-460d-86c2-689d50b5c7ac tempest-CreateVolumesFromImageTest-192687972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18d5f6f0-a124-42ce-a194-2edfbdb7f830 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:29 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18d5f6f0-a124-42ce-a194-2edfbdb7f830 Sep 28 17:35:29 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:29 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-28bf6e8c-fe17-46b9-88f8-0b43e0974325 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8158d354-d5a7-4998-bb4e-1272d969db0f 1073741824" returned: 0 in 0.554s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:29 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4c565b7e-59c0-460d-86c2-689d50b5c7ac tempest-CreateVolumesFromImageTest-192687972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18d5f6f0-a124-42ce-a194-2edfbdb7f830" returned: 0 in 0.412s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4c565b7e-59c0-460d-86c2-689d50b5c7ac tempest-CreateVolumesFromImageTest-192687972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18d5f6f0-a124-42ce-a194-2edfbdb7f830 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-28bf6e8c-fe17-46b9-88f8-0b43e0974325 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8158d354-d5a7-4998-bb4e-1272d969db0f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:29 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18d5f6f0-a124-42ce-a194-2edfbdb7f830 Sep 28 17:35:29 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:29 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8158d354-d5a7-4998-bb4e-1272d969db0f Sep 28 17:35:29 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:29 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4c565b7e-59c0-460d-86c2-689d50b5c7ac tempest-CreateVolumesFromImageTest-192687972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-18d5f6f0-a124-42ce-a194-2edfbdb7f830" returned: 0 in 0.265s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:29 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-28bf6e8c-fe17-46b9-88f8-0b43e0974325 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8158d354-d5a7-4998-bb4e-1272d969db0f" returned: 0 in 0.264s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-28bf6e8c-fe17-46b9-88f8-0b43e0974325 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:35:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-28bf6e8c-fe17-46b9-88f8-0b43e0974325 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-4c565b7e-59c0-460d-86c2-689d50b5c7ac tempest-CreateVolumesFromImageTest-192687972 None] Lock "cinder-quobyte-18d5f6f0-a124-42ce-a194-2edfbdb7f830" released by "delete_volume" :: held 0.734s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.210s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46e88e67-010a-44d8-abe7-2e4228912820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e828bf58d6c4b8cbd621225ded0d312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:21Z,use_quota=True,user_id='6f47ca35a62c44829ecaa23d9c29c903',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3640b2b3-367a-48dc-8f1e-6c45c547a174),volume_type_id=3640b2b3-367a-48dc-8f1e-6c45c547a174)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:35:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Creating volume 46e88e67-010a-44d8-abe7-2e4228912820 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:35:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:35:29 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:35:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-46e88e67-010a-44d8-abe7-2e4228912820 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:29 devstack sudo[107857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-46e88e67-010a-44d8-abe7-2e4228912820 1073741824 Sep 28 17:35:29 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-28bf6e8c-fe17-46b9-88f8-0b43e0974325 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91bb1c85-a1ad-46a8-9ab8-a49327247881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8158d354-d5a7-4998-bb4e-1272d969db0f', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-28bf6e8c-fe17-46b9-88f8-0b43e0974325 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d2fd5e-938e-4bae-84ca-2638cc905319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:29 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-28bf6e8c-fe17-46b9-88f8-0b43e0974325 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Volume volume-8158d354-d5a7-4998-bb4e-1272d969db0f (8158d354-d5a7-4998-bb4e-1272d969db0f): created successfully Sep 28 17:35:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-28bf6e8c-fe17-46b9-88f8-0b43e0974325 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d2fd5e-938e-4bae-84ca-2638cc905319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-28bf6e8c-fe17-46b9-88f8-0b43e0974325 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Flow 'volume_create_manager' (7308b9e7-7da3-475d-8d36-42b7b337c687) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:29 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-28bf6e8c-fe17-46b9-88f8-0b43e0974325 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Created volume successfully. Sep 28 17:35:29 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-4c565b7e-59c0-460d-86c2-689d50b5c7ac tempest-CreateVolumesFromImageTest-192687972 None] Created reservations ['7393b2f7-e654-48a4-a6e7-ab7f84384414', 'd4723b66-22ea-4c5e-a102-5002c1929813', '3e327fba-ff93-4df7-a5de-2269107e5c33', '8382179a-9b93-483f-a988-0be5e04a9c2b'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:35:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4c565b7e-59c0-460d-86c2-689d50b5c7ac tempest-CreateVolumesFromImageTest-192687972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4c565b7e-59c0-460d-86c2-689d50b5c7ac tempest-CreateVolumesFromImageTest-192687972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4c565b7e-59c0-460d-86c2-689d50b5c7ac tempest-CreateVolumesFromImageTest-192687972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4c565b7e-59c0-460d-86c2-689d50b5c7ac tempest-CreateVolumesFromImageTest-192687972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4c565b7e-59c0-460d-86c2-689d50b5c7ac tempest-CreateVolumesFromImageTest-192687972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4c565b7e-59c0-460d-86c2-689d50b5c7ac tempest-CreateVolumesFromImageTest-192687972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:29 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:35:29 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-64cec13a-b385-40e9-98e1-640d568969b2 tempest-CreateVolumesFromImageTest-192687972 None] Acquiring lock "cinder-e03364eb-953a-4d44-89c8-c16bb2766740-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-64cec13a-b385-40e9-98e1-640d568969b2 tempest-CreateVolumesFromImageTest-192687972 None] Lock "cinder-e03364eb-953a-4d44-89c8-c16bb2766740-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-64cec13a-b385-40e9-98e1-640d568969b2 tempest-CreateVolumesFromImageTest-192687972 None] Acquiring lock "cinder-quobyte-e03364eb-953a-4d44-89c8-c16bb2766740" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-64cec13a-b385-40e9-98e1-640d568969b2 tempest-CreateVolumesFromImageTest-192687972 None] Lock "cinder-quobyte-e03364eb-953a-4d44-89c8-c16bb2766740" acquired by "delete_volume" :: waited 0.028s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[85495075-6d25-483c-ab54-2040203818b7]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-64cec13a-b385-40e9-98e1-640d568969b2 tempest-CreateVolumesFromImageTest-192687972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e03364eb-953a-4d44-89c8-c16bb2766740 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:30 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:30 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e03364eb-953a-4d44-89c8-c16bb2766740 Sep 28 17:35:30 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d09711f4-c5e0-4398-a73c-fcfd2f061e31 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Acquiring lock "cinder-8158d354-d5a7-4998-bb4e-1272d969db0f-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4c565b7e-59c0-460d-86c2-689d50b5c7ac tempest-CreateVolumesFromImageTest-192687972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.403s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-4c565b7e-59c0-460d-86c2-689d50b5c7ac tempest-CreateVolumesFromImageTest-192687972 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:35:30 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-4c565b7e-59c0-460d-86c2-689d50b5c7ac tempest-CreateVolumesFromImageTest-192687972 None] Deleted volume successfully. Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d09711f4-c5e0-4398-a73c-fcfd2f061e31 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "cinder-8158d354-d5a7-4998-bb4e-1272d969db0f-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-4c565b7e-59c0-460d-86c2-689d50b5c7ac tempest-CreateVolumesFromImageTest-192687972 None] Lock "cinder-18d5f6f0-a124-42ce-a194-2edfbdb7f830-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d09711f4-c5e0-4398-a73c-fcfd2f061e31 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Acquiring lock "cinder-quobyte-8158d354-d5a7-4998-bb4e-1272d969db0f" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d09711f4-c5e0-4398-a73c-fcfd2f061e31 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "cinder-quobyte-8158d354-d5a7-4998-bb4e-1272d969db0f" acquired by "delete_volume" :: waited 0.021s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:30 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-46e88e67-010a-44d8-abe7-2e4228912820 1073741824" returned: 0 in 0.720s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f5db2d-cb22-42f1-b94b-7dd65f1afb13]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d09711f4-c5e0-4398-a73c-fcfd2f061e31 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8158d354-d5a7-4998-bb4e-1272d969db0f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-46e88e67-010a-44d8-abe7-2e4228912820 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:30 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-46e88e67-010a-44d8-abe7-2e4228912820 Sep 28 17:35:30 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:30 devstack sudo[107867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8158d354-d5a7-4998-bb4e-1272d969db0f Sep 28 17:35:30 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:30 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-64cec13a-b385-40e9-98e1-640d568969b2 tempest-CreateVolumesFromImageTest-192687972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e03364eb-953a-4d44-89c8-c16bb2766740" returned: 0 in 0.510s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-64cec13a-b385-40e9-98e1-640d568969b2 tempest-CreateVolumesFromImageTest-192687972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e03364eb-953a-4d44-89c8-c16bb2766740 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:30 devstack sudo[107875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e03364eb-953a-4d44-89c8-c16bb2766740 Sep 28 17:35:30 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:30 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-46e88e67-010a-44d8-abe7-2e4228912820" returned: 0 in 0.279s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ff114b69-308a-4467-bb27-ed3f0b28f6ad tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.412s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ff114b69-308a-4467-bb27-ed3f0b28f6ad tempest-CreateVolumesFromSnapshotTest-556144415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-132827636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c12cde6-56e3-4ed3-a1d6-5b227a036a65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e31a8b9f98504508bbf6f0f6308f704d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:25Z,use_quota=True,user_id='53248b61305f4b41a36ac533bdced5e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-ff114b69-308a-4467-bb27-ed3f0b28f6ad tempest-CreateVolumesFromSnapshotTest-556144415 None] Creating volume 8c12cde6-56e3-4ed3-a1d6-5b227a036a65 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ff114b69-308a-4467-bb27-ed3f0b28f6ad tempest-CreateVolumesFromSnapshotTest-556144415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ff114b69-308a-4467-bb27-ed3f0b28f6ad tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ff114b69-308a-4467-bb27-ed3f0b28f6ad tempest-CreateVolumesFromSnapshotTest-556144415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ff114b69-308a-4467-bb27-ed3f0b28f6ad tempest-CreateVolumesFromSnapshotTest-556144415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ff114b69-308a-4467-bb27-ed3f0b28f6ad tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ff114b69-308a-4467-bb27-ed3f0b28f6ad tempest-CreateVolumesFromSnapshotTest-556144415 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:35:30 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-ff114b69-308a-4467-bb27-ed3f0b28f6ad tempest-CreateVolumesFromSnapshotTest-556144415 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ff114b69-308a-4467-bb27-ed3f0b28f6ad tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8c12cde6-56e3-4ed3-a1d6-5b227a036a65 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:30 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8c12cde6-56e3-4ed3-a1d6-5b227a036a65 1073741824 Sep 28 17:35:30 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG cinder.volume.volume_utils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Attempting download of 0410ea5c-cf38-40c1-bd9a-f89da3089e32 ((None, [{'url': 'file:///opt/stack/data/glance/images/0410ea5c-cf38-40c1-bd9a-f89da3089e32', 'metadata': {}}])) to volume 46e88e67-010a-44d8-abe7-2e4228912820. {{(pid=86917) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:35:30 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d09711f4-c5e0-4398-a73c-fcfd2f061e31 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8158d354-d5a7-4998-bb4e-1272d969db0f" returned: 0 in 0.463s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d09711f4-c5e0-4398-a73c-fcfd2f061e31 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8158d354-d5a7-4998-bb4e-1272d969db0f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f9ed2d-fb1b-4daa-84aa-884d09a012b6]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0410ea5c-cf38-40c1-bd9a-f89da3089e32_v47qpipt {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:30 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-64cec13a-b385-40e9-98e1-640d568969b2 tempest-CreateVolumesFromImageTest-192687972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e03364eb-953a-4d44-89c8-c16bb2766740" returned: 0 in 0.315s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:30 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8158d354-d5a7-4998-bb4e-1272d969db0f Sep 28 17:35:30 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-64cec13a-b385-40e9-98e1-640d568969b2 tempest-CreateVolumesFromImageTest-192687972 None] Lock "cinder-quobyte-e03364eb-953a-4d44-89c8-c16bb2766740" released by "delete_volume" :: held 0.892s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:30 devstack sudo[107885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0410ea5c-cf38-40c1-bd9a-f89da3089e32_v47qpipt Sep 28 17:35:30 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-64cec13a-b385-40e9-98e1-640d568969b2 tempest-CreateVolumesFromImageTest-192687972 None] Created reservations ['e192d642-bab4-4b16-85d4-c9ea20177fb8', '4462e019-4657-4f16-8638-59d104c1d846', '47ab4a10-a7fd-4c19-bb78-420958014621', '75bdeb35-8a84-4b5e-b88c-ce1e6efe6bbb'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:35:30 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-64cec13a-b385-40e9-98e1-640d568969b2 tempest-CreateVolumesFromImageTest-192687972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-64cec13a-b385-40e9-98e1-640d568969b2 tempest-CreateVolumesFromImageTest-192687972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-64cec13a-b385-40e9-98e1-640d568969b2 tempest-CreateVolumesFromImageTest-192687972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-64cec13a-b385-40e9-98e1-640d568969b2 tempest-CreateVolumesFromImageTest-192687972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-64cec13a-b385-40e9-98e1-640d568969b2 tempest-CreateVolumesFromImageTest-192687972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-64cec13a-b385-40e9-98e1-640d568969b2 tempest-CreateVolumesFromImageTest-192687972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:31 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:35:31 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:31 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d09711f4-c5e0-4398-a73c-fcfd2f061e31 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8158d354-d5a7-4998-bb4e-1272d969db0f" returned: 0 in 0.457s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d09711f4-c5e0-4398-a73c-fcfd2f061e31 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "cinder-quobyte-8158d354-d5a7-4998-bb4e-1272d969db0f" released by "delete_volume" :: held 0.978s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:31 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0410ea5c-cf38-40c1-bd9a-f89da3089e32_v47qpipt" returned: 0 in 0.489s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0410ea5c-cf38-40c1-bd9a-f89da3089e32_v47qpipt {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-d09711f4-c5e0-4398-a73c-fcfd2f061e31 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Created reservations ['c84df117-c00f-4be2-ad6a-ed5b464fcdcf', 'ee496adf-f2fe-4608-8ddc-baa051b4df12', '3ce4df5f-22ad-4cbe-8e84-ffb1581ab24f', '6e8c2773-8da7-4a8d-a1d1-43ff9a4511ac'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:35:31 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ff114b69-308a-4467-bb27-ed3f0b28f6ad tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8c12cde6-56e3-4ed3-a1d6-5b227a036a65 1073741824" returned: 0 in 0.717s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ff114b69-308a-4467-bb27-ed3f0b28f6ad tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8c12cde6-56e3-4ed3-a1d6-5b227a036a65 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:31 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0410ea5c-cf38-40c1-bd9a-f89da3089e32_v47qpipt Sep 28 17:35:31 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:31 devstack sudo[107912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8c12cde6-56e3-4ed3-a1d6-5b227a036a65 Sep 28 17:35:31 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d09711f4-c5e0-4398-a73c-fcfd2f061e31 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d09711f4-c5e0-4398-a73c-fcfd2f061e31 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d09711f4-c5e0-4398-a73c-fcfd2f061e31 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d09711f4-c5e0-4398-a73c-fcfd2f061e31 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d09711f4-c5e0-4398-a73c-fcfd2f061e31 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d09711f4-c5e0-4398-a73c-fcfd2f061e31 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:31 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-64cec13a-b385-40e9-98e1-640d568969b2 tempest-CreateVolumesFromImageTest-192687972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.446s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-64cec13a-b385-40e9-98e1-640d568969b2 tempest-CreateVolumesFromImageTest-192687972 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:35:31 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-64cec13a-b385-40e9-98e1-640d568969b2 tempest-CreateVolumesFromImageTest-192687972 None] Deleted volume successfully. Sep 28 17:35:31 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:35:31 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-64cec13a-b385-40e9-98e1-640d568969b2 tempest-CreateVolumesFromImageTest-192687972 None] Lock "cinder-e03364eb-953a-4d44-89c8-c16bb2766740-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:31 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0410ea5c-cf38-40c1-bd9a-f89da3089e32_v47qpipt" returned: 1 in 0.500s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0410ea5c-cf38-40c1-bd9a-f89da3089e32_v47qpipt' failed. Not Retrying. {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b85f6a-6220-438c-a8a1-6bc01e5663c2]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0410ea5c-cf38-40c1-bd9a-f89da3089e32_x8antpn1devstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:31 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ff114b69-308a-4467-bb27-ed3f0b28f6ad tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8c12cde6-56e3-4ed3-a1d6-5b227a036a65" returned: 0 in 0.388s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ff114b69-308a-4467-bb27-ed3f0b28f6ad tempest-CreateVolumesFromSnapshotTest-556144415 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ff114b69-308a-4467-bb27-ed3f0b28f6ad tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6b9a193a-cd4a-4d5b-8b73-cc2a76248357 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.915s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6b9a193a-cd4a-4d5b-8b73-cc2a76248357 tempest-CreateVolumesFromSnapshotTest-556144415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1751565695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=257c658b-f9f9-48d0-b74b-67293af1c8ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e31a8b9f98504508bbf6f0f6308f704d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:26Z,use_quota=True,user_id='53248b61305f4b41a36ac533bdced5e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-6b9a193a-cd4a-4d5b-8b73-cc2a76248357 tempest-CreateVolumesFromSnapshotTest-556144415 None] Creating volume 257c658b-f9f9-48d0-b74b-67293af1c8ce {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6b9a193a-cd4a-4d5b-8b73-cc2a76248357 tempest-CreateVolumesFromSnapshotTest-556144415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6b9a193a-cd4a-4d5b-8b73-cc2a76248357 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6b9a193a-cd4a-4d5b-8b73-cc2a76248357 tempest-CreateVolumesFromSnapshotTest-556144415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6b9a193a-cd4a-4d5b-8b73-cc2a76248357 tempest-CreateVolumesFromSnapshotTest-556144415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6b9a193a-cd4a-4d5b-8b73-cc2a76248357 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6b9a193a-cd4a-4d5b-8b73-cc2a76248357 tempest-CreateVolumesFromSnapshotTest-556144415 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:35:31 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-6b9a193a-cd4a-4d5b-8b73-cc2a76248357 tempest-CreateVolumesFromSnapshotTest-556144415 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b9a193a-cd4a-4d5b-8b73-cc2a76248357 tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-257c658b-f9f9-48d0-b74b-67293af1c8ce 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:31 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d09711f4-c5e0-4398-a73c-fcfd2f061e31 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.339s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-d09711f4-c5e0-4398-a73c-fcfd2f061e31 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff114b69-308a-4467-bb27-ed3f0b28f6ad tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21bb1d90-380b-4156-8364-516c3c1e5222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c12cde6-56e3-4ed3-a1d6-5b227a036a65', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff114b69-308a-4467-bb27-ed3f0b28f6ad tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ccebd8c-e66a-4055-bb73-a98b34370301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:31 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-257c658b-f9f9-48d0-b74b-67293af1c8ce 1073741824 Sep 28 17:35:31 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:31 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-d09711f4-c5e0-4398-a73c-fcfd2f061e31 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Deleted volume successfully. Sep 28 17:35:31 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-ff114b69-308a-4467-bb27-ed3f0b28f6ad tempest-CreateVolumesFromSnapshotTest-556144415 None] Volume volume-8c12cde6-56e3-4ed3-a1d6-5b227a036a65 (8c12cde6-56e3-4ed3-a1d6-5b227a036a65): created successfully Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff114b69-308a-4467-bb27-ed3f0b28f6ad tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ccebd8c-e66a-4055-bb73-a98b34370301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-ff114b69-308a-4467-bb27-ed3f0b28f6ad tempest-CreateVolumesFromSnapshotTest-556144415 None] Flow 'volume_create_manager' (c49a7689-48cb-4237-898c-00f01e2f9b93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:31 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d09711f4-c5e0-4398-a73c-fcfd2f061e31 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "cinder-8158d354-d5a7-4998-bb4e-1272d969db0f-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:31 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-ff114b69-308a-4467-bb27-ed3f0b28f6ad tempest-CreateVolumesFromSnapshotTest-556144415 None] Created volume successfully. Sep 28 17:35:31 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0410ea5c-cf38-40c1-bd9a-f89da3089e32_x8antpn1devstack@QuobyteHD Sep 28 17:35:31 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:32 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a95278f6-e953-4611-b213-d75f1533bc5e tempest-CreateVolumesFromImageTest-192687972 None] Acquiring lock "cinder-e9a0b6a1-31e7-463f-a633-34e21d08ebd7-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0410ea5c-cf38-40c1-bd9a-f89da3089e32_x8antpn1devstack@QuobyteHD" returned: 0 in 0.421s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0410ea5c-cf38-40c1-bd9a-f89da3089e32_x8antpn1devstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a95278f6-e953-4611-b213-d75f1533bc5e tempest-CreateVolumesFromImageTest-192687972 None] Lock "cinder-e9a0b6a1-31e7-463f-a633-34e21d08ebd7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a95278f6-e953-4611-b213-d75f1533bc5e tempest-CreateVolumesFromImageTest-192687972 None] Acquiring lock "cinder-quobyte-e9a0b6a1-31e7-463f-a633-34e21d08ebd7" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a95278f6-e953-4611-b213-d75f1533bc5e tempest-CreateVolumesFromImageTest-192687972 None] Lock "cinder-quobyte-e9a0b6a1-31e7-463f-a633-34e21d08ebd7" acquired by "delete_volume" :: waited 0.029s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce84e23-4a14-466f-b147-ddfe3a2926ef]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a95278f6-e953-4611-b213-d75f1533bc5e tempest-CreateVolumesFromImageTest-192687972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9a0b6a1-31e7-463f-a633-34e21d08ebd7 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:32 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0410ea5c-cf38-40c1-bd9a-f89da3089e32_x8antpn1devstack@QuobyteHD Sep 28 17:35:32 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:32 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b9a193a-cd4a-4d5b-8b73-cc2a76248357 tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-257c658b-f9f9-48d0-b74b-67293af1c8ce 1073741824" returned: 0 in 0.632s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b4aa46f4-4cb4-49bf-bad5-d067afeb28e7 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Acquiring lock "cinder-975d802d-c236-48a5-93c4-486b23fd5dfa-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b4aa46f4-4cb4-49bf-bad5-d067afeb28e7 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "cinder-975d802d-c236-48a5-93c4-486b23fd5dfa-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:32 devstack sudo[107954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9a0b6a1-31e7-463f-a633-34e21d08ebd7 Sep 28 17:35:32 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b9a193a-cd4a-4d5b-8b73-cc2a76248357 tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-257c658b-f9f9-48d0-b74b-67293af1c8ce {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:32 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-257c658b-f9f9-48d0-b74b-67293af1c8ce Sep 28 17:35:32 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b4aa46f4-4cb4-49bf-bad5-d067afeb28e7 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Acquiring lock "cinder-quobyte-975d802d-c236-48a5-93c4-486b23fd5dfa" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b4aa46f4-4cb4-49bf-bad5-d067afeb28e7 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "cinder-quobyte-975d802d-c236-48a5-93c4-486b23fd5dfa" acquired by "delete_volume" :: waited 0.022s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3340374a-6d96-42e3-9a9f-fe7ee7b5267f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b4aa46f4-4cb4-49bf-bad5-d067afeb28e7 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-975d802d-c236-48a5-93c4-486b23fd5dfa {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:32 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0410ea5c-cf38-40c1-bd9a-f89da3089e32_x8antpn1devstack@QuobyteHD" returned: 1 in 0.463s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0410ea5c-cf38-40c1-bd9a-f89da3089e32_x8antpn1devstack@QuobyteHD' failed. Not Retrying. {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] 0410ea5c-cf38-40c1-bd9a-f89da3089e32 was raw, converting to qcow2 {{(pid=86917) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0410ea5c-cf38-40c1-bd9a-f89da3089e32_x8antpn1devstack@QuobyteHD /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-46e88e67-010a-44d8-abe7-2e4228912820 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:32 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0410ea5c-cf38-40c1-bd9a-f89da3089e32_x8antpn1devstack@QuobyteHD /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-46e88e67-010a-44d8-abe7-2e4228912820 Sep 28 17:35:32 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:32 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-975d802d-c236-48a5-93c4-486b23fd5dfa Sep 28 17:35:32 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:32 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6b9a193a-cd4a-4d5b-8b73-cc2a76248357 tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-257c658b-f9f9-48d0-b74b-67293af1c8ce" returned: 0 in 0.299s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6b9a193a-cd4a-4d5b-8b73-cc2a76248357 tempest-CreateVolumesFromSnapshotTest-556144415 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6b9a193a-cd4a-4d5b-8b73-cc2a76248357 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9d86468e-662f-40b9-a183-ab6a0436764f tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.509s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-9d86468e-662f-40b9-a183-ab6a0436764f tempest-CreateVolumesFromSnapshotTest-556144415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1365638675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9a341c-0572-4b5e-85b5-dee6911c5c2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e31a8b9f98504508bbf6f0f6308f704d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:26Z,use_quota=True,user_id='53248b61305f4b41a36ac533bdced5e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-9d86468e-662f-40b9-a183-ab6a0436764f tempest-CreateVolumesFromSnapshotTest-556144415 None] Creating volume cd9a341c-0572-4b5e-85b5-dee6911c5c2f {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9d86468e-662f-40b9-a183-ab6a0436764f tempest-CreateVolumesFromSnapshotTest-556144415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9d86468e-662f-40b9-a183-ab6a0436764f tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-9d86468e-662f-40b9-a183-ab6a0436764f tempest-CreateVolumesFromSnapshotTest-556144415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:32 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-9d86468e-662f-40b9-a183-ab6a0436764f tempest-CreateVolumesFromSnapshotTest-556144415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9d86468e-662f-40b9-a183-ab6a0436764f tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-9d86468e-662f-40b9-a183-ab6a0436764f tempest-CreateVolumesFromSnapshotTest-556144415 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:35:32 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-9d86468e-662f-40b9-a183-ab6a0436764f tempest-CreateVolumesFromSnapshotTest-556144415 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9d86468e-662f-40b9-a183-ab6a0436764f tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cd9a341c-0572-4b5e-85b5-dee6911c5c2f 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a95278f6-e953-4611-b213-d75f1533bc5e tempest-CreateVolumesFromImageTest-192687972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9a0b6a1-31e7-463f-a633-34e21d08ebd7" returned: 0 in 0.545s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a95278f6-e953-4611-b213-d75f1533bc5e tempest-CreateVolumesFromImageTest-192687972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9a0b6a1-31e7-463f-a633-34e21d08ebd7 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:32 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cd9a341c-0572-4b5e-85b5-dee6911c5c2f 1073741824 Sep 28 17:35:32 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b9a193a-cd4a-4d5b-8b73-cc2a76248357 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (414716a2-11d8-4cad-8c77-e184ba84b4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-257c658b-f9f9-48d0-b74b-67293af1c8ce', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b9a193a-cd4a-4d5b-8b73-cc2a76248357 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b625b1f-b872-43cc-801a-ec86cbd667bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:32 devstack sudo[107972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9a0b6a1-31e7-463f-a633-34e21d08ebd7 Sep 28 17:35:32 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:32 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-6b9a193a-cd4a-4d5b-8b73-cc2a76248357 tempest-CreateVolumesFromSnapshotTest-556144415 None] Volume volume-257c658b-f9f9-48d0-b74b-67293af1c8ce (257c658b-f9f9-48d0-b74b-67293af1c8ce): created successfully Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b9a193a-cd4a-4d5b-8b73-cc2a76248357 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b625b1f-b872-43cc-801a-ec86cbd667bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6b9a193a-cd4a-4d5b-8b73-cc2a76248357 tempest-CreateVolumesFromSnapshotTest-556144415 None] Flow 'volume_create_manager' (271950e6-1719-43d0-988c-5f7dbec34485) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:33 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-6b9a193a-cd4a-4d5b-8b73-cc2a76248357 tempest-CreateVolumesFromSnapshotTest-556144415 None] Created volume successfully. Sep 28 17:35:33 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b4aa46f4-4cb4-49bf-bad5-d067afeb28e7 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-975d802d-c236-48a5-93c4-486b23fd5dfa" returned: 0 in 0.471s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b4aa46f4-4cb4-49bf-bad5-d067afeb28e7 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-975d802d-c236-48a5-93c4-486b23fd5dfa {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:33 devstack sudo[107982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-975d802d-c236-48a5-93c4-486b23fd5dfa Sep 28 17:35:33 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:33 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a95278f6-e953-4611-b213-d75f1533bc5e tempest-CreateVolumesFromImageTest-192687972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e9a0b6a1-31e7-463f-a633-34e21d08ebd7" returned: 0 in 0.345s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a95278f6-e953-4611-b213-d75f1533bc5e tempest-CreateVolumesFromImageTest-192687972 None] Lock "cinder-quobyte-e9a0b6a1-31e7-463f-a633-34e21d08ebd7" released by "delete_volume" :: held 0.950s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:33 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0410ea5c-cf38-40c1-bd9a-f89da3089e32_x8antpn1devstack@QuobyteHD /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-46e88e67-010a-44d8-abe7-2e4228912820" returned: 0 in 0.618s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0410ea5c-cf38-40c1-bd9a-f89da3089e32_x8antpn1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-46e88e67-010a-44d8-abe7-2e4228912820 {{(pid=86917) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:35:33 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-46e88e67-010a-44d8-abe7-2e4228912820 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:33 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-46e88e67-010a-44d8-abe7-2e4228912820 1G Sep 28 17:35:33 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-a95278f6-e953-4611-b213-d75f1533bc5e tempest-CreateVolumesFromImageTest-192687972 None] Created reservations ['2e57e6ff-3cb2-4226-b0e5-40e7ed3b0e6c', '4fc3c8e7-e875-425d-8fe4-c0a2837fb543', 'e7b63a44-b3c8-4ea3-b4e4-2ea45d82e938', '966b04fa-9a2e-4974-b19b-393c2d85965f'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a95278f6-e953-4611-b213-d75f1533bc5e tempest-CreateVolumesFromImageTest-192687972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a95278f6-e953-4611-b213-d75f1533bc5e tempest-CreateVolumesFromImageTest-192687972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a95278f6-e953-4611-b213-d75f1533bc5e tempest-CreateVolumesFromImageTest-192687972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a95278f6-e953-4611-b213-d75f1533bc5e tempest-CreateVolumesFromImageTest-192687972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a95278f6-e953-4611-b213-d75f1533bc5e tempest-CreateVolumesFromImageTest-192687972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a95278f6-e953-4611-b213-d75f1533bc5e tempest-CreateVolumesFromImageTest-192687972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:33 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9d86468e-662f-40b9-a183-ab6a0436764f tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cd9a341c-0572-4b5e-85b5-dee6911c5c2f 1073741824" returned: 0 in 0.622s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:33 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:33 devstack sudo[107992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b4aa46f4-4cb4-49bf-bad5-d067afeb28e7 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-975d802d-c236-48a5-93c4-486b23fd5dfa" returned: 0 in 0.396s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:33 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b4aa46f4-4cb4-49bf-bad5-d067afeb28e7 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "cinder-quobyte-975d802d-c236-48a5-93c4-486b23fd5dfa" released by "delete_volume" :: held 0.938s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9d86468e-662f-40b9-a183-ab6a0436764f tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cd9a341c-0572-4b5e-85b5-dee6911c5c2f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:33 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cd9a341c-0572-4b5e-85b5-dee6911c5c2f Sep 28 17:35:33 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-b4aa46f4-4cb4-49bf-bad5-d067afeb28e7 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Created reservations ['62a5bc03-07f5-4a0c-8939-fc7ee526c395', '6c71d475-e1e8-4343-8680-cf1b2dc31a79', '54d24dc9-120b-4809-b4fd-0164b8ff8831', '8f39091b-287a-4f80-a69d-62f069aa2180'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b4aa46f4-4cb4-49bf-bad5-d067afeb28e7 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b4aa46f4-4cb4-49bf-bad5-d067afeb28e7 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b4aa46f4-4cb4-49bf-bad5-d067afeb28e7 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b4aa46f4-4cb4-49bf-bad5-d067afeb28e7 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b4aa46f4-4cb4-49bf-bad5-d067afeb28e7 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b4aa46f4-4cb4-49bf-bad5-d067afeb28e7 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:33 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-46e88e67-010a-44d8-abe7-2e4228912820 1G" returned: 0 in 0.490s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG cinder.volume.volume_utils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Downloaded image 0410ea5c-cf38-40c1-bd9a-f89da3089e32 ((None, [{'url': 'file:///opt/stack/data/glance/images/0410ea5c-cf38-40c1-bd9a-f89da3089e32', 'metadata': {}}])) to volume 46e88e67-010a-44d8-abe7-2e4228912820 successfully. {{(pid=86917) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Temporary image 0410ea5c-cf38-40c1-bd9a-f89da3089e32 for user 6f47ca35a62c44829ecaa23d9c29c903 is deleted. {{(pid=86917) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG cinder.volume.volume_utils [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Marking volume 46e88e67-010a-44d8-abe7-2e4228912820 as bootable. {{(pid=86917) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:35:33 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:35:33 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Copying metadata from image 0410ea5c-cf38-40c1-bd9a-f89da3089e32 to 46e88e67-010a-44d8-abe7-2e4228912820. {{(pid=86917) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Creating volume glance metadata for volume 46e88e67-010a-44d8-abe7-2e4228912820 backed by image 0410ea5c-cf38-40c1-bd9a-f89da3089e32 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '0410ea5c-cf38-40c1-bd9a-f89da3089e32', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '59f5b88351cf63bd329a533432e65e26', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86917) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:35:33 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a95278f6-e953-4611-b213-d75f1533bc5e tempest-CreateVolumesFromImageTest-192687972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.355s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-a95278f6-e953-4611-b213-d75f1533bc5e tempest-CreateVolumesFromImageTest-192687972 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:35:33 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-a95278f6-e953-4611-b213-d75f1533bc5e tempest-CreateVolumesFromImageTest-192687972 None] Deleted volume successfully. Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a95278f6-e953-4611-b213-d75f1533bc5e tempest-CreateVolumesFromImageTest-192687972 None] Lock "cinder-e9a0b6a1-31e7-463f-a633-34e21d08ebd7-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff33623-b766-42cd-ba62-e34b6b7dc61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46e88e67-010a-44d8-abe7-2e4228912820', 'volume_size': 1, 'image_id': '0410ea5c-cf38-40c1-bd9a-f89da3089e32', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0410ea5c-cf38-40c1-bd9a-f89da3089e32', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '59f5b88351cf63bd329a533432e65e26', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6e828bf58d6c4b8cbd621225ded0d312', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a3129af44ebbbe363986c1048be8323369af2a579d65172aab9e85fb638b1ff6afd8374932397303a07ce0a7f0a2d3b6abb8c18a196f79354b68104296d7471f', 'id': '0410ea5c-cf38-40c1-bd9a-f89da3089e32', 'created_at': datetime.datetime(2026, 9, 28, 15, 35, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 35, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0410ea5c-cf38-40c1-bd9a-f89da3089e32/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20dea89b-84a8-4498-9a97-caa31e71cc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:33 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Volume volume-46e88e67-010a-44d8-abe7-2e4228912820 (46e88e67-010a-44d8-abe7-2e4228912820): created successfully Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20dea89b-84a8-4498-9a97-caa31e71cc96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:33 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Flow 'volume_create_manager' (4c674774-24cf-41e6-8dfd-c15c6f0bf415) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9d86468e-662f-40b9-a183-ab6a0436764f tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cd9a341c-0572-4b5e-85b5-dee6911c5c2f" returned: 0 in 0.358s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-9d86468e-662f-40b9-a183-ab6a0436764f tempest-CreateVolumesFromSnapshotTest-556144415 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9d86468e-662f-40b9-a183-ab6a0436764f tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b73da2c9-78a9-4b9f-b0b4-6c9288cd1f1d tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.138s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b73da2c9-78a9-4b9f-b0b4-6c9288cd1f1d tempest-CreateVolumesFromSnapshotTest-556144415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1072775855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d521da4f-8d53-4ed3-84ce-511617c977f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e31a8b9f98504508bbf6f0f6308f704d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:27Z,use_quota=True,user_id='53248b61305f4b41a36ac533bdced5e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-b73da2c9-78a9-4b9f-b0b4-6c9288cd1f1d tempest-CreateVolumesFromSnapshotTest-556144415 None] Creating volume d521da4f-8d53-4ed3-84ce-511617c977f3 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b73da2c9-78a9-4b9f-b0b4-6c9288cd1f1d tempest-CreateVolumesFromSnapshotTest-556144415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b73da2c9-78a9-4b9f-b0b4-6c9288cd1f1d tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b73da2c9-78a9-4b9f-b0b4-6c9288cd1f1d tempest-CreateVolumesFromSnapshotTest-556144415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b73da2c9-78a9-4b9f-b0b4-6c9288cd1f1d tempest-CreateVolumesFromSnapshotTest-556144415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b73da2c9-78a9-4b9f-b0b4-6c9288cd1f1d tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b73da2c9-78a9-4b9f-b0b4-6c9288cd1f1d tempest-CreateVolumesFromSnapshotTest-556144415 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:35:33 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-b73da2c9-78a9-4b9f-b0b4-6c9288cd1f1d tempest-CreateVolumesFromSnapshotTest-556144415 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:35:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b73da2c9-78a9-4b9f-b0b4-6c9288cd1f1d tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d521da4f-8d53-4ed3-84ce-511617c977f3 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:34 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-4e1f5a73-9a55-487b-b950-27ecc416a9f1 tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Created volume successfully. Sep 28 17:35:34 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9d86468e-662f-40b9-a183-ab6a0436764f tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531c7f3d-b7d1-4966-b9b8-801145a4d41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd9a341c-0572-4b5e-85b5-dee6911c5c2f', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:34 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d521da4f-8d53-4ed3-84ce-511617c977f3 1073741824 Sep 28 17:35:34 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9d86468e-662f-40b9-a183-ab6a0436764f tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bbb2b29-fcbd-442e-a961-a93f4306fd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:34 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:34 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-9d86468e-662f-40b9-a183-ab6a0436764f tempest-CreateVolumesFromSnapshotTest-556144415 None] Volume volume-cd9a341c-0572-4b5e-85b5-dee6911c5c2f (cd9a341c-0572-4b5e-85b5-dee6911c5c2f): created successfully Sep 28 17:35:34 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9d86468e-662f-40b9-a183-ab6a0436764f tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bbb2b29-fcbd-442e-a961-a93f4306fd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:34 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9d86468e-662f-40b9-a183-ab6a0436764f tempest-CreateVolumesFromSnapshotTest-556144415 None] Flow 'volume_create_manager' (05afe88c-3841-40b5-bc18-d6f2839885e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:34 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-9d86468e-662f-40b9-a183-ab6a0436764f tempest-CreateVolumesFromSnapshotTest-556144415 None] Created volume successfully. Sep 28 17:35:34 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b4aa46f4-4cb4-49bf-bad5-d067afeb28e7 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.296s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:34 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-b4aa46f4-4cb4-49bf-bad5-d067afeb28e7 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:35:34 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-b4aa46f4-4cb4-49bf-bad5-d067afeb28e7 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Deleted volume successfully. Sep 28 17:35:34 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b4aa46f4-4cb4-49bf-bad5-d067afeb28e7 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "cinder-975d802d-c236-48a5-93c4-486b23fd5dfa-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:34 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b73da2c9-78a9-4b9f-b0b4-6c9288cd1f1d tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d521da4f-8d53-4ed3-84ce-511617c977f3 1073741824" returned: 0 in 0.451s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b73da2c9-78a9-4b9f-b0b4-6c9288cd1f1d tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d521da4f-8d53-4ed3-84ce-511617c977f3 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:34 devstack sudo[108010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d521da4f-8d53-4ed3-84ce-511617c977f3 Sep 28 17:35:34 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:34 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-317e3a1d-dd7d-4c67-80d0-f8bc02116eda tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Acquiring lock "cinder-46e88e67-010a-44d8-abe7-2e4228912820-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:34 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-317e3a1d-dd7d-4c67-80d0-f8bc02116eda tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Lock "cinder-46e88e67-010a-44d8-abe7-2e4228912820-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:34 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-317e3a1d-dd7d-4c67-80d0-f8bc02116eda tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Acquiring lock "cinder-quobyte-46e88e67-010a-44d8-abe7-2e4228912820" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:34 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-317e3a1d-dd7d-4c67-80d0-f8bc02116eda tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Lock "cinder-quobyte-46e88e67-010a-44d8-abe7-2e4228912820" acquired by "delete_volume" :: waited 0.022s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:34 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b73da2c9-78a9-4b9f-b0b4-6c9288cd1f1d tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d521da4f-8d53-4ed3-84ce-511617c977f3" returned: 0 in 0.280s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:34 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b73da2c9-78a9-4b9f-b0b4-6c9288cd1f1d tempest-CreateVolumesFromSnapshotTest-556144415 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:35:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b73da2c9-78a9-4b9f-b0b4-6c9288cd1f1d tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7b9e921b-6ab3-4b59-9748-9c85d4a08907 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.514s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:34 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-7b9e921b-6ab3-4b59-9748-9c85d4a08907 tempest-CreateVolumesFromSnapshotTest-556144415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2135707291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77c70c5e-76dc-4cad-a5ae-f2cd63223130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e31a8b9f98504508bbf6f0f6308f704d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:27Z,use_quota=True,user_id='53248b61305f4b41a36ac533bdced5e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:35:34 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-7b9e921b-6ab3-4b59-9748-9c85d4a08907 tempest-CreateVolumesFromSnapshotTest-556144415 None] Creating volume 77c70c5e-76dc-4cad-a5ae-f2cd63223130 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:35:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7b9e921b-6ab3-4b59-9748-9c85d4a08907 tempest-CreateVolumesFromSnapshotTest-556144415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7b9e921b-6ab3-4b59-9748-9c85d4a08907 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:34 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-7b9e921b-6ab3-4b59-9748-9c85d4a08907 tempest-CreateVolumesFromSnapshotTest-556144415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:34 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-7b9e921b-6ab3-4b59-9748-9c85d4a08907 tempest-CreateVolumesFromSnapshotTest-556144415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7b9e921b-6ab3-4b59-9748-9c85d4a08907 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:34 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-7b9e921b-6ab3-4b59-9748-9c85d4a08907 tempest-CreateVolumesFromSnapshotTest-556144415 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:35:34 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-7b9e921b-6ab3-4b59-9748-9c85d4a08907 tempest-CreateVolumesFromSnapshotTest-556144415 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:35:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7b9e921b-6ab3-4b59-9748-9c85d4a08907 tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-77c70c5e-76dc-4cad-a5ae-f2cd63223130 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:34 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[848c1d39-53b6-49e8-94c8-92a74151444d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:35:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-317e3a1d-dd7d-4c67-80d0-f8bc02116eda tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-46e88e67-010a-44d8-abe7-2e4228912820 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:34 devstack sudo[108013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-77c70c5e-76dc-4cad-a5ae-f2cd63223130 1073741824 Sep 28 17:35:34 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:34 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5870b3af-7ce3-4636-82f7-596bb481c4d6 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Acquiring lock "cinder-3b36f51e-d577-48e9-8f5f-d8266251e76c-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:34 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b73da2c9-78a9-4b9f-b0b4-6c9288cd1f1d tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dbe77d7-3765-4c63-b29d-9d115f1664aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d521da4f-8d53-4ed3-84ce-511617c977f3', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:34 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b73da2c9-78a9-4b9f-b0b4-6c9288cd1f1d tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (196c0453-ca71-4c31-9714-99d245b32ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:34 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5870b3af-7ce3-4636-82f7-596bb481c4d6 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "cinder-3b36f51e-d577-48e9-8f5f-d8266251e76c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:34 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-b73da2c9-78a9-4b9f-b0b4-6c9288cd1f1d tempest-CreateVolumesFromSnapshotTest-556144415 None] Volume volume-d521da4f-8d53-4ed3-84ce-511617c977f3 (d521da4f-8d53-4ed3-84ce-511617c977f3): created successfully Sep 28 17:35:34 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b73da2c9-78a9-4b9f-b0b4-6c9288cd1f1d tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (196c0453-ca71-4c31-9714-99d245b32ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:34 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b73da2c9-78a9-4b9f-b0b4-6c9288cd1f1d tempest-CreateVolumesFromSnapshotTest-556144415 None] Flow 'volume_create_manager' (3e5d7613-92fa-4dfa-bb21-3a0ee94b2841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:34 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-b73da2c9-78a9-4b9f-b0b4-6c9288cd1f1d tempest-CreateVolumesFromSnapshotTest-556144415 None] Created volume successfully. Sep 28 17:35:34 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5870b3af-7ce3-4636-82f7-596bb481c4d6 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Acquiring lock "cinder-quobyte-3b36f51e-d577-48e9-8f5f-d8266251e76c" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:34 devstack sudo[108014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-46e88e67-010a-44d8-abe7-2e4228912820 Sep 28 17:35:35 devstack sudo[108014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:35 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5870b3af-7ce3-4636-82f7-596bb481c4d6 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "cinder-quobyte-3b36f51e-d577-48e9-8f5f-d8266251e76c" acquired by "delete_volume" :: waited 0.030s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:35 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f780ea7-d53f-4d0c-b090-f07d5b0d8872]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:35:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5870b3af-7ce3-4636-82f7-596bb481c4d6 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3b36f51e-d577-48e9-8f5f-d8266251e76c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:35 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3b36f51e-d577-48e9-8f5f-d8266251e76c Sep 28 17:35:35 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:35 devstack sudo[108014]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-317e3a1d-dd7d-4c67-80d0-f8bc02116eda tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-46e88e67-010a-44d8-abe7-2e4228912820" returned: 0 in 0.552s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-317e3a1d-dd7d-4c67-80d0-f8bc02116eda tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-46e88e67-010a-44d8-abe7-2e4228912820 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:35 devstack sudo[108027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-46e88e67-010a-44d8-abe7-2e4228912820 Sep 28 17:35:35 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:35 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7b9e921b-6ab3-4b59-9748-9c85d4a08907 tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-77c70c5e-76dc-4cad-a5ae-f2cd63223130 1073741824" returned: 0 in 0.612s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7b9e921b-6ab3-4b59-9748-9c85d4a08907 tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-77c70c5e-76dc-4cad-a5ae-f2cd63223130 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:35 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-77c70c5e-76dc-4cad-a5ae-f2cd63223130 Sep 28 17:35:35 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:35 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5870b3af-7ce3-4636-82f7-596bb481c4d6 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3b36f51e-d577-48e9-8f5f-d8266251e76c" returned: 0 in 0.468s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5870b3af-7ce3-4636-82f7-596bb481c4d6 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3b36f51e-d577-48e9-8f5f-d8266251e76c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:35 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3b36f51e-d577-48e9-8f5f-d8266251e76c Sep 28 17:35:35 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:35 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-317e3a1d-dd7d-4c67-80d0-f8bc02116eda tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-46e88e67-010a-44d8-abe7-2e4228912820" returned: 0 in 0.384s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:35 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-317e3a1d-dd7d-4c67-80d0-f8bc02116eda tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Lock "cinder-quobyte-46e88e67-010a-44d8-abe7-2e4228912820" released by "delete_volume" :: held 1.028s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:35 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7b9e921b-6ab3-4b59-9748-9c85d4a08907 tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-77c70c5e-76dc-4cad-a5ae-f2cd63223130" returned: 0 in 0.358s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:35 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-7b9e921b-6ab3-4b59-9748-9c85d4a08907 tempest-CreateVolumesFromSnapshotTest-556144415 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:35:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7b9e921b-6ab3-4b59-9748-9c85d4a08907 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:35 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7b9e921b-6ab3-4b59-9748-9c85d4a08907 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4bd3300-bd31-40e8-a489-a7eb091809b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77c70c5e-76dc-4cad-a5ae-f2cd63223130', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:35 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7b9e921b-6ab3-4b59-9748-9c85d4a08907 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45be8027-f6f4-4d26-98fd-2d94fe18cea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:35 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-7b9e921b-6ab3-4b59-9748-9c85d4a08907 tempest-CreateVolumesFromSnapshotTest-556144415 None] Volume volume-77c70c5e-76dc-4cad-a5ae-f2cd63223130 (77c70c5e-76dc-4cad-a5ae-f2cd63223130): created successfully Sep 28 17:35:35 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7b9e921b-6ab3-4b59-9748-9c85d4a08907 tempest-CreateVolumesFromSnapshotTest-556144415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45be8027-f6f4-4d26-98fd-2d94fe18cea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:35 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:35 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-7b9e921b-6ab3-4b59-9748-9c85d4a08907 tempest-CreateVolumesFromSnapshotTest-556144415 None] Flow 'volume_create_manager' (8eddb44c-49f8-41ad-9cac-7c2af74f3842) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5870b3af-7ce3-4636-82f7-596bb481c4d6 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3b36f51e-d577-48e9-8f5f-d8266251e76c" returned: 0 in 0.408s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:35 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5870b3af-7ce3-4636-82f7-596bb481c4d6 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "cinder-quobyte-3b36f51e-d577-48e9-8f5f-d8266251e76c" released by "delete_volume" :: held 0.959s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:35 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-7b9e921b-6ab3-4b59-9748-9c85d4a08907 tempest-CreateVolumesFromSnapshotTest-556144415 None] Created volume successfully. Sep 28 17:35:36 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-317e3a1d-dd7d-4c67-80d0-f8bc02116eda tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Created reservations ['81cc64e6-fc06-4e1c-a80a-8545b74cee71', '321ad9dd-5744-4abf-8ee6-744563fa538e', '76d01721-8d48-49f1-8b1d-0cf8e40ef288', '8e5edac8-a073-48f8-ac84-242e315d54e0'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:35:36 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-5870b3af-7ce3-4636-82f7-596bb481c4d6 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Created reservations ['fc36a0ee-90cb-40cc-85c9-318bb811967b', 'cd811a80-e235-44b6-8257-24fcd20f526e', 'a0b5951e-94d3-4ecc-8fba-221ece1d56ed', 'dea872fe-284d-498e-9fff-9e26bce352bc'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:35:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-317e3a1d-dd7d-4c67-80d0-f8bc02116eda tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-317e3a1d-dd7d-4c67-80d0-f8bc02116eda tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:36 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-317e3a1d-dd7d-4c67-80d0-f8bc02116eda tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:36 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-317e3a1d-dd7d-4c67-80d0-f8bc02116eda tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-317e3a1d-dd7d-4c67-80d0-f8bc02116eda tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-317e3a1d-dd7d-4c67-80d0-f8bc02116eda tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:36 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:35:36 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5870b3af-7ce3-4636-82f7-596bb481c4d6 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5870b3af-7ce3-4636-82f7-596bb481c4d6 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:36 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-5870b3af-7ce3-4636-82f7-596bb481c4d6 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:36 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-5870b3af-7ce3-4636-82f7-596bb481c4d6 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5870b3af-7ce3-4636-82f7-596bb481c4d6 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5870b3af-7ce3-4636-82f7-596bb481c4d6 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:36 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-26ae65ed-9894-4aa4-a738-c1fda1d4b154 tempest-CreateVolumesFromSnapshotTest-556144415 None] Acquiring lock "cinder-77c70c5e-76dc-4cad-a5ae-f2cd63223130-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:36 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:35:36 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:36 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-26ae65ed-9894-4aa4-a738-c1fda1d4b154 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "cinder-77c70c5e-76dc-4cad-a5ae-f2cd63223130-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:36 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-26ae65ed-9894-4aa4-a738-c1fda1d4b154 tempest-CreateVolumesFromSnapshotTest-556144415 None] Acquiring lock "cinder-quobyte-77c70c5e-76dc-4cad-a5ae-f2cd63223130" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:36 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-26ae65ed-9894-4aa4-a738-c1fda1d4b154 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "cinder-quobyte-77c70c5e-76dc-4cad-a5ae-f2cd63223130" acquired by "delete_volume" :: waited 0.024s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:36 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddafc49-fc45-4143-862e-0141814cd030]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:35:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-26ae65ed-9894-4aa4-a738-c1fda1d4b154 tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-77c70c5e-76dc-4cad-a5ae-f2cd63223130 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:36 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-317e3a1d-dd7d-4c67-80d0-f8bc02116eda tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.389s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:36 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-317e3a1d-dd7d-4c67-80d0-f8bc02116eda tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:35:36 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-317e3a1d-dd7d-4c67-80d0-f8bc02116eda tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Deleted volume successfully. Sep 28 17:35:36 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-317e3a1d-dd7d-4c67-80d0-f8bc02116eda tempest-VolumeAndVolumeTypeFromImageTest-1112025157 None] Lock "cinder-46e88e67-010a-44d8-abe7-2e4228912820-delete_volume" released by "delete_volume" :: held 1.936s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:36 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5870b3af-7ce3-4636-82f7-596bb481c4d6 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.360s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:36 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-5870b3af-7ce3-4636-82f7-596bb481c4d6 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:35:36 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-77c70c5e-76dc-4cad-a5ae-f2cd63223130 Sep 28 17:35:36 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:36 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-5870b3af-7ce3-4636-82f7-596bb481c4d6 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Deleted volume successfully. Sep 28 17:35:36 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5870b3af-7ce3-4636-82f7-596bb481c4d6 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "cinder-3b36f51e-d577-48e9-8f5f-d8266251e76c-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:36 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-26ae65ed-9894-4aa4-a738-c1fda1d4b154 tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-77c70c5e-76dc-4cad-a5ae-f2cd63223130" returned: 0 in 0.455s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-26ae65ed-9894-4aa4-a738-c1fda1d4b154 tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-77c70c5e-76dc-4cad-a5ae-f2cd63223130 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:36 devstack sudo[108052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-77c70c5e-76dc-4cad-a5ae-f2cd63223130 Sep 28 17:35:36 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:37 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-26ae65ed-9894-4aa4-a738-c1fda1d4b154 tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-77c70c5e-76dc-4cad-a5ae-f2cd63223130" returned: 0 in 0.312s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:37 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-9075fac7-041b-4662-bdc0-0d62ea70357a tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Acquiring lock "cinder-303e7063-e9c2-4a67-a61b-8ad295015a68-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:37 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-26ae65ed-9894-4aa4-a738-c1fda1d4b154 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "cinder-quobyte-77c70c5e-76dc-4cad-a5ae-f2cd63223130" released by "delete_volume" :: held 0.845s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:37 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-9075fac7-041b-4662-bdc0-0d62ea70357a tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "cinder-303e7063-e9c2-4a67-a61b-8ad295015a68-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:37 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-9075fac7-041b-4662-bdc0-0d62ea70357a tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Acquiring lock "cinder-quobyte-303e7063-e9c2-4a67-a61b-8ad295015a68" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:37 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-26ae65ed-9894-4aa4-a738-c1fda1d4b154 tempest-CreateVolumesFromSnapshotTest-556144415 None] Created reservations ['69ddc3b5-6e24-432c-9c6e-55a265b08908', '9104bddf-92cf-4052-bde9-c0ef71f6868b', 'e0900102-0754-4215-aa56-64ec3c65d50b', '2c8f96df-00f5-4d25-baae-d9feff8dc1eb'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:35:37 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-9075fac7-041b-4662-bdc0-0d62ea70357a tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "cinder-quobyte-303e7063-e9c2-4a67-a61b-8ad295015a68" acquired by "delete_volume" :: waited 0.036s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:37 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ef5574-ebe4-422f-b90b-5441ca576712]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:35:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9075fac7-041b-4662-bdc0-0d62ea70357a tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-303e7063-e9c2-4a67-a61b-8ad295015a68 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-26ae65ed-9894-4aa4-a738-c1fda1d4b154 tempest-CreateVolumesFromSnapshotTest-556144415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-26ae65ed-9894-4aa4-a738-c1fda1d4b154 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:37 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-26ae65ed-9894-4aa4-a738-c1fda1d4b154 tempest-CreateVolumesFromSnapshotTest-556144415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:37 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-26ae65ed-9894-4aa4-a738-c1fda1d4b154 tempest-CreateVolumesFromSnapshotTest-556144415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-26ae65ed-9894-4aa4-a738-c1fda1d4b154 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-26ae65ed-9894-4aa4-a738-c1fda1d4b154 tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:37 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:35:37 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:37 devstack sudo[108055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-303e7063-e9c2-4a67-a61b-8ad295015a68 Sep 28 17:35:37 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:37 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-26ae65ed-9894-4aa4-a738-c1fda1d4b154 tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.276s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:37 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-26ae65ed-9894-4aa4-a738-c1fda1d4b154 tempest-CreateVolumesFromSnapshotTest-556144415 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:35:37 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-26ae65ed-9894-4aa4-a738-c1fda1d4b154 tempest-CreateVolumesFromSnapshotTest-556144415 None] Deleted volume successfully. Sep 28 17:35:37 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-26ae65ed-9894-4aa4-a738-c1fda1d4b154 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "cinder-77c70c5e-76dc-4cad-a5ae-f2cd63223130-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:37 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9075fac7-041b-4662-bdc0-0d62ea70357a tempest-CreateVolumesFromSourceVolumeTest-929854129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-303e7063-e9c2-4a67-a61b-8ad295015a68" returned: 0 in 0.456s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9075fac7-041b-4662-bdc0-0d62ea70357a tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-303e7063-e9c2-4a67-a61b-8ad295015a68 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:37 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-303e7063-e9c2-4a67-a61b-8ad295015a68 Sep 28 17:35:37 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:38 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9075fac7-041b-4662-bdc0-0d62ea70357a tempest-CreateVolumesFromSourceVolumeTest-929854129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-303e7063-e9c2-4a67-a61b-8ad295015a68" returned: 0 in 0.262s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-9075fac7-041b-4662-bdc0-0d62ea70357a tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "cinder-quobyte-303e7063-e9c2-4a67-a61b-8ad295015a68" released by "delete_volume" :: held 0.790s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-9075fac7-041b-4662-bdc0-0d62ea70357a tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Created reservations ['d5e3f8e3-adb2-41c6-bd51-ae990abf4a10', 'af5a69a9-117f-468f-8571-69346b493531', '4122276d-20e0-4646-8fa9-7362a8953c6d', '93e62855-cf2b-4b27-bb1d-fbabbe21c070'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9075fac7-041b-4662-bdc0-0d62ea70357a tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9075fac7-041b-4662-bdc0-0d62ea70357a tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-9075fac7-041b-4662-bdc0-0d62ea70357a tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-9075fac7-041b-4662-bdc0-0d62ea70357a tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9075fac7-041b-4662-bdc0-0d62ea70357a tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9075fac7-041b-4662-bdc0-0d62ea70357a tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:38 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:35:38 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-80c33622-2154-4eb6-9d98-8eadab6b2af5 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Acquiring lock "cinder-faccbdd5-ba10-4daa-8cc1-3a0434d27c08-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-80c33622-2154-4eb6-9d98-8eadab6b2af5 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "cinder-faccbdd5-ba10-4daa-8cc1-3a0434d27c08-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-80c33622-2154-4eb6-9d98-8eadab6b2af5 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Acquiring lock "cinder-quobyte-faccbdd5-ba10-4daa-8cc1-3a0434d27c08" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-80c33622-2154-4eb6-9d98-8eadab6b2af5 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "cinder-quobyte-faccbdd5-ba10-4daa-8cc1-3a0434d27c08" acquired by "delete_volume" :: waited 0.037s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d6db67c8-9b40-4808-89c2-fc43a4a57e26 tempest-CreateVolumesFromSnapshotTest-556144415 None] Acquiring lock "cinder-d521da4f-8d53-4ed3-84ce-511617c977f3-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d6db67c8-9b40-4808-89c2-fc43a4a57e26 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "cinder-d521da4f-8d53-4ed3-84ce-511617c977f3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a478dd-b647-42f8-9975-7ac55d7b1278]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-80c33622-2154-4eb6-9d98-8eadab6b2af5 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-faccbdd5-ba10-4daa-8cc1-3a0434d27c08 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d6db67c8-9b40-4808-89c2-fc43a4a57e26 tempest-CreateVolumesFromSnapshotTest-556144415 None] Acquiring lock "cinder-quobyte-d521da4f-8d53-4ed3-84ce-511617c977f3" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:38 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9075fac7-041b-4662-bdc0-0d62ea70357a tempest-CreateVolumesFromSourceVolumeTest-929854129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.487s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-9075fac7-041b-4662-bdc0-0d62ea70357a tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:35:38 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-9075fac7-041b-4662-bdc0-0d62ea70357a tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Deleted volume successfully. Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d6db67c8-9b40-4808-89c2-fc43a4a57e26 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "cinder-quobyte-d521da4f-8d53-4ed3-84ce-511617c977f3" acquired by "delete_volume" :: waited 0.059s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-853d70a1-8ea0-4ba7-980b-59697c2d720c tempest-VolumeDependencyTests-276100199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-853d70a1-8ea0-4ba7-980b-59697c2d720c tempest-VolumeDependencyTests-276100199 None] Flow 'volume_create_manager' (f470f21e-b60f-46b8-8d8f-f8279fc0c671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-853d70a1-8ea0-4ba7-980b-59697c2d720c tempest-VolumeDependencyTests-276100199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6745306-ce09-41d9-b4ff-97c0d5089a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbdba43-9b03-4764-a99b-b0f95707b28c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d6db67c8-9b40-4808-89c2-fc43a4a57e26 tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d521da4f-8d53-4ed3-84ce-511617c977f3 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:38 devstack sudo[108068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-faccbdd5-ba10-4daa-8cc1-3a0434d27c08 Sep 28 17:35:38 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-853d70a1-8ea0-4ba7-980b-59697c2d720c tempest-VolumeDependencyTests-276100199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6745306-ce09-41d9-b4ff-97c0d5089a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1872821871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00810319-eb06-4d53-8c45-2aaf3d12fbf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6097ca4bfec4db6baa714121c3a5875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:39Z,use_quota=True,user_id='eeb62bab249844d79772f1b8f12cdd8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-853d70a1-8ea0-4ba7-980b-59697c2d720c tempest-VolumeDependencyTests-276100199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0607dc9b-b301-4e52-b607-5cc0e984a3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-853d70a1-8ea0-4ba7-980b-59697c2d720c tempest-VolumeDependencyTests-276100199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0607dc9b-b301-4e52-b607-5cc0e984a3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-853d70a1-8ea0-4ba7-980b-59697c2d720c tempest-VolumeDependencyTests-276100199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06886d38-458c-4b9c-820d-4f424f57f243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-853d70a1-8ea0-4ba7-980b-59697c2d720c tempest-VolumeDependencyTests-276100199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06886d38-458c-4b9c-820d-4f424f57f243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00810319-eb06-4d53-8c45-2aaf3d12fbf9', 'volume_name': 'volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-853d70a1-8ea0-4ba7-980b-59697c2d720c tempest-VolumeDependencyTests-276100199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d99b64b-bf2e-4ad1-b661-07e3f37efbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-853d70a1-8ea0-4ba7-980b-59697c2d720c tempest-VolumeDependencyTests-276100199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d99b64b-bf2e-4ad1-b661-07e3f37efbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-853d70a1-8ea0-4ba7-980b-59697c2d720c tempest-VolumeDependencyTests-276100199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d314432e-90a2-4028-9737-d53667ab300d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:38 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-853d70a1-8ea0-4ba7-980b-59697c2d720c tempest-VolumeDependencyTests-276100199 None] Volume 00810319-eb06-4d53-8c45-2aaf3d12fbf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9', 'volume_size': 1} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-853d70a1-8ea0-4ba7-980b-59697c2d720c tempest-VolumeDependencyTests-276100199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-853d70a1-8ea0-4ba7-980b-59697c2d720c tempest-VolumeDependencyTests-276100199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-853d70a1-8ea0-4ba7-980b-59697c2d720c tempest-VolumeDependencyTests-276100199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1872821871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00810319-eb06-4d53-8c45-2aaf3d12fbf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6097ca4bfec4db6baa714121c3a5875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:39Z,use_quota=True,user_id='eeb62bab249844d79772f1b8f12cdd8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-853d70a1-8ea0-4ba7-980b-59697c2d720c tempest-VolumeDependencyTests-276100199 None] Creating volume 00810319-eb06-4d53-8c45-2aaf3d12fbf9 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-853d70a1-8ea0-4ba7-980b-59697c2d720c tempest-VolumeDependencyTests-276100199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-853d70a1-8ea0-4ba7-980b-59697c2d720c tempest-VolumeDependencyTests-276100199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-853d70a1-8ea0-4ba7-980b-59697c2d720c tempest-VolumeDependencyTests-276100199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-853d70a1-8ea0-4ba7-980b-59697c2d720c tempest-VolumeDependencyTests-276100199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-853d70a1-8ea0-4ba7-980b-59697c2d720c tempest-VolumeDependencyTests-276100199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-853d70a1-8ea0-4ba7-980b-59697c2d720c tempest-VolumeDependencyTests-276100199 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:35:38 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-853d70a1-8ea0-4ba7-980b-59697c2d720c tempest-VolumeDependencyTests-276100199 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:35:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-853d70a1-8ea0-4ba7-980b-59697c2d720c tempest-VolumeDependencyTests-276100199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:39 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-9075fac7-041b-4662-bdc0-0d62ea70357a tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "cinder-303e7063-e9c2-4a67-a61b-8ad295015a68-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:39 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9 1073741824 Sep 28 17:35:39 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:39 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d521da4f-8d53-4ed3-84ce-511617c977f3 Sep 28 17:35:39 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:39 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-80c33622-2154-4eb6-9d98-8eadab6b2af5 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-faccbdd5-ba10-4daa-8cc1-3a0434d27c08" returned: 0 in 0.551s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-80c33622-2154-4eb6-9d98-8eadab6b2af5 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-faccbdd5-ba10-4daa-8cc1-3a0434d27c08 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:39 devstack sudo[108082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-faccbdd5-ba10-4daa-8cc1-3a0434d27c08 Sep 28 17:35:39 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:39 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d6db67c8-9b40-4808-89c2-fc43a4a57e26 tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d521da4f-8d53-4ed3-84ce-511617c977f3" returned: 0 in 0.492s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d6db67c8-9b40-4808-89c2-fc43a4a57e26 tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d521da4f-8d53-4ed3-84ce-511617c977f3 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:39 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d521da4f-8d53-4ed3-84ce-511617c977f3 Sep 28 17:35:39 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:39 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-853d70a1-8ea0-4ba7-980b-59697c2d720c tempest-VolumeDependencyTests-276100199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9 1073741824" returned: 0 in 0.580s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:39 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-80c33622-2154-4eb6-9d98-8eadab6b2af5 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-faccbdd5-ba10-4daa-8cc1-3a0434d27c08" returned: 0 in 0.328s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:39 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-80c33622-2154-4eb6-9d98-8eadab6b2af5 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "cinder-quobyte-faccbdd5-ba10-4daa-8cc1-3a0434d27c08" released by "delete_volume" :: held 0.983s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-853d70a1-8ea0-4ba7-980b-59697c2d720c tempest-VolumeDependencyTests-276100199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:39 devstack sudo[108091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9 Sep 28 17:35:39 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:39 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-80c33622-2154-4eb6-9d98-8eadab6b2af5 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Created reservations ['533acd3d-9ee2-41a6-b82e-f7b7eb80c5cd', '55f5c3bb-0fe0-4061-8cc6-eef13897a6c4', 'd081007f-5f82-4316-bf8b-cff1e26758da', '6259bb11-3e8d-4257-9a6e-99cec7acdc72'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:35:39 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d6db67c8-9b40-4808-89c2-fc43a4a57e26 tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d521da4f-8d53-4ed3-84ce-511617c977f3" returned: 0 in 0.346s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:39 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d6db67c8-9b40-4808-89c2-fc43a4a57e26 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "cinder-quobyte-d521da4f-8d53-4ed3-84ce-511617c977f3" released by "delete_volume" :: held 0.919s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-80c33622-2154-4eb6-9d98-8eadab6b2af5 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-80c33622-2154-4eb6-9d98-8eadab6b2af5 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:39 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-80c33622-2154-4eb6-9d98-8eadab6b2af5 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:39 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-80c33622-2154-4eb6-9d98-8eadab6b2af5 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-80c33622-2154-4eb6-9d98-8eadab6b2af5 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-80c33622-2154-4eb6-9d98-8eadab6b2af5 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:39 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-d6db67c8-9b40-4808-89c2-fc43a4a57e26 tempest-CreateVolumesFromSnapshotTest-556144415 None] Created reservations ['81c7436a-da3c-4976-b7c3-e23557c33333', 'f3bb3462-b497-4ff9-9733-1af976f225cd', '0d20f8d4-fab0-4fc0-b7e0-ebbc66f89253', '5a256c6c-2db7-4b82-b94d-2eb00ccc3739'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:35:39 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:35:39 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:39 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d6db67c8-9b40-4808-89c2-fc43a4a57e26 tempest-CreateVolumesFromSnapshotTest-556144415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d6db67c8-9b40-4808-89c2-fc43a4a57e26 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:40 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d6db67c8-9b40-4808-89c2-fc43a4a57e26 tempest-CreateVolumesFromSnapshotTest-556144415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:40 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-d6db67c8-9b40-4808-89c2-fc43a4a57e26 tempest-CreateVolumesFromSnapshotTest-556144415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-d6db67c8-9b40-4808-89c2-fc43a4a57e26 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d6db67c8-9b40-4808-89c2-fc43a4a57e26 tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-853d70a1-8ea0-4ba7-980b-59697c2d720c tempest-VolumeDependencyTests-276100199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9" returned: 0 in 0.384s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:40 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-853d70a1-8ea0-4ba7-980b-59697c2d720c tempest-VolumeDependencyTests-276100199 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:35:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-853d70a1-8ea0-4ba7-980b-59697c2d720c tempest-VolumeDependencyTests-276100199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-853d70a1-8ea0-4ba7-980b-59697c2d720c tempest-VolumeDependencyTests-276100199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d314432e-90a2-4028-9737-d53667ab300d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:40 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:35:40 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-853d70a1-8ea0-4ba7-980b-59697c2d720c tempest-VolumeDependencyTests-276100199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82569529-182b-4631-9528-d6924d2ee725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:40 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-853d70a1-8ea0-4ba7-980b-59697c2d720c tempest-VolumeDependencyTests-276100199 None] Volume volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9 (00810319-eb06-4d53-8c45-2aaf3d12fbf9): created successfully Sep 28 17:35:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-853d70a1-8ea0-4ba7-980b-59697c2d720c tempest-VolumeDependencyTests-276100199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82569529-182b-4631-9528-d6924d2ee725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-853d70a1-8ea0-4ba7-980b-59697c2d720c tempest-VolumeDependencyTests-276100199 None] Flow 'volume_create_manager' (f470f21e-b60f-46b8-8d8f-f8279fc0c671) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:40 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-853d70a1-8ea0-4ba7-980b-59697c2d720c tempest-VolumeDependencyTests-276100199 None] Created volume successfully. Sep 28 17:35:40 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-80c33622-2154-4eb6-9d98-8eadab6b2af5 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.388s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:40 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-80c33622-2154-4eb6-9d98-8eadab6b2af5 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:35:40 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-80c33622-2154-4eb6-9d98-8eadab6b2af5 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Deleted volume successfully. Sep 28 17:35:40 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-80c33622-2154-4eb6-9d98-8eadab6b2af5 tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "cinder-faccbdd5-ba10-4daa-8cc1-3a0434d27c08-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:40 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d6db67c8-9b40-4808-89c2-fc43a4a57e26 tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.286s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:40 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-d6db67c8-9b40-4808-89c2-fc43a4a57e26 tempest-CreateVolumesFromSnapshotTest-556144415 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:35:40 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-d6db67c8-9b40-4808-89c2-fc43a4a57e26 tempest-CreateVolumesFromSnapshotTest-556144415 None] Deleted volume successfully. Sep 28 17:35:40 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d6db67c8-9b40-4808-89c2-fc43a4a57e26 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "cinder-d521da4f-8d53-4ed3-84ce-511617c977f3-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:40 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5930dbcc-f625-4a7f-a08b-1299fafeebdd tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Acquiring lock "cinder-d51f8b0f-024b-47f5-8594-5149480740c9-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:40 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5930dbcc-f625-4a7f-a08b-1299fafeebdd tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "cinder-d51f8b0f-024b-47f5-8594-5149480740c9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:40 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5930dbcc-f625-4a7f-a08b-1299fafeebdd tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Acquiring lock "cinder-quobyte-d51f8b0f-024b-47f5-8594-5149480740c9" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:40 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5930dbcc-f625-4a7f-a08b-1299fafeebdd tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "cinder-quobyte-d51f8b0f-024b-47f5-8594-5149480740c9" acquired by "delete_volume" :: waited 0.025s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:40 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[de09b790-f563-4fdd-a092-797f46806009]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:35:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5930dbcc-f625-4a7f-a08b-1299fafeebdd tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d51f8b0f-024b-47f5-8594-5149480740c9 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:41 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-adebf02e-85cd-46b2-b873-c399513a3aee tempest-CreateVolumesFromSnapshotTest-556144415 None] Acquiring lock "cinder-cd9a341c-0572-4b5e-85b5-dee6911c5c2f-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:41 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-adebf02e-85cd-46b2-b873-c399513a3aee tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "cinder-cd9a341c-0572-4b5e-85b5-dee6911c5c2f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:41 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-adebf02e-85cd-46b2-b873-c399513a3aee tempest-CreateVolumesFromSnapshotTest-556144415 None] Acquiring lock "cinder-quobyte-cd9a341c-0572-4b5e-85b5-dee6911c5c2f" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:41 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-adebf02e-85cd-46b2-b873-c399513a3aee tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "cinder-quobyte-cd9a341c-0572-4b5e-85b5-dee6911c5c2f" acquired by "delete_volume" :: waited 0.033s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:41 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d51f8b0f-024b-47f5-8594-5149480740c9 Sep 28 17:35:41 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:41 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb1368f-42ed-4fe4-8405-35057476fd41]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:35:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-adebf02e-85cd-46b2-b873-c399513a3aee tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cd9a341c-0572-4b5e-85b5-dee6911c5c2f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-033ef2a1-6d25-4199-85c9-f3cba3e9d1d6 tempest-VolumeDependencyTests-276100199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-033ef2a1-6d25-4199-85c9-f3cba3e9d1d6 tempest-VolumeDependencyTests-276100199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:41 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-033ef2a1-6d25-4199-85c9-f3cba3e9d1d6 tempest-VolumeDependencyTests-276100199 None] Creating offline snapshot 16fb6f8e-314b-4e5b-9bf9-28bb5c75449a of volume 00810319-eb06-4d53-8c45-2aaf3d12fbf9 {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:35:41 devstack sudo[108102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cd9a341c-0572-4b5e-85b5-dee6911c5c2f Sep 28 17:35:41 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:41 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c7c204-f29f-4bd8-bdc4-bba798fb1d94]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:35:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-033ef2a1-6d25-4199-85c9-f3cba3e9d1d6 tempest-VolumeDependencyTests-276100199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:41 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9 Sep 28 17:35:41 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:41 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5930dbcc-f625-4a7f-a08b-1299fafeebdd tempest-CreateVolumesFromSourceVolumeTest-929854129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d51f8b0f-024b-47f5-8594-5149480740c9" returned: 0 in 0.611s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5930dbcc-f625-4a7f-a08b-1299fafeebdd tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d51f8b0f-024b-47f5-8594-5149480740c9 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:41 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d51f8b0f-024b-47f5-8594-5149480740c9 Sep 28 17:35:41 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:41 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-adebf02e-85cd-46b2-b873-c399513a3aee tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cd9a341c-0572-4b5e-85b5-dee6911c5c2f" returned: 0 in 0.432s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-adebf02e-85cd-46b2-b873-c399513a3aee tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cd9a341c-0572-4b5e-85b5-dee6911c5c2f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:41 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cd9a341c-0572-4b5e-85b5-dee6911c5c2f Sep 28 17:35:41 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:41 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5930dbcc-f625-4a7f-a08b-1299fafeebdd tempest-CreateVolumesFromSourceVolumeTest-929854129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d51f8b0f-024b-47f5-8594-5149480740c9" returned: 0 in 0.280s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:41 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:41 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5930dbcc-f625-4a7f-a08b-1299fafeebdd tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "cinder-quobyte-d51f8b0f-024b-47f5-8594-5149480740c9" released by "delete_volume" :: held 0.969s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-033ef2a1-6d25-4199-85c9-f3cba3e9d1d6 tempest-VolumeDependencyTests-276100199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9" returned: 0 in 0.491s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-033ef2a1-6d25-4199-85c9-f3cba3e9d1d6 tempest-VolumeDependencyTests-276100199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9.16fb6f8e-314b-4e5b-9bf9-28bb5c75449a 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:41 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9.16fb6f8e-314b-4e5b-9bf9-28bb5c75449a 1G Sep 28 17:35:41 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:41 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-adebf02e-85cd-46b2-b873-c399513a3aee tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cd9a341c-0572-4b5e-85b5-dee6911c5c2f" returned: 0 in 0.307s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:41 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-5930dbcc-f625-4a7f-a08b-1299fafeebdd tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Created reservations ['01b0eb3c-13a9-4c83-9c3a-941131dc0cc1', 'd3e79bc6-fe19-4c2b-8fc0-ee8e876800fd', '0cbc189e-dc85-4a07-8638-cc3fee33b166', '7ada850c-3b00-40db-85f9-a2d51bf78228'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:35:41 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-adebf02e-85cd-46b2-b873-c399513a3aee tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "cinder-quobyte-cd9a341c-0572-4b5e-85b5-dee6911c5c2f" released by "delete_volume" :: held 0.808s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5930dbcc-f625-4a7f-a08b-1299fafeebdd tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5930dbcc-f625-4a7f-a08b-1299fafeebdd tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:42 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-5930dbcc-f625-4a7f-a08b-1299fafeebdd tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:42 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-5930dbcc-f625-4a7f-a08b-1299fafeebdd tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5930dbcc-f625-4a7f-a08b-1299fafeebdd tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5930dbcc-f625-4a7f-a08b-1299fafeebdd tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:42 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-adebf02e-85cd-46b2-b873-c399513a3aee tempest-CreateVolumesFromSnapshotTest-556144415 None] Created reservations ['e7835383-6ec0-4166-8d6e-928ddcecc9e6', '7276557d-902a-44f3-9255-5cd8574386dc', '4d95fc66-ac3c-4068-a615-3c7141871888', '0caa6c19-cd43-4f29-8298-5ff8a0344e48'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:35:42 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:35:42 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-adebf02e-85cd-46b2-b873-c399513a3aee tempest-CreateVolumesFromSnapshotTest-556144415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-adebf02e-85cd-46b2-b873-c399513a3aee tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:42 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-adebf02e-85cd-46b2-b873-c399513a3aee tempest-CreateVolumesFromSnapshotTest-556144415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:42 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-adebf02e-85cd-46b2-b873-c399513a3aee tempest-CreateVolumesFromSnapshotTest-556144415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-adebf02e-85cd-46b2-b873-c399513a3aee tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-adebf02e-85cd-46b2-b873-c399513a3aee tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:42 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:35:42 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:42 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-bcd4f33c-2436-499d-bc52-33cd73e1b583 tempest-CreateVolumesFromSnapshotTest-556144415 None] Acquiring lock "cinder-257c658b-f9f9-48d0-b74b-67293af1c8ce-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:42 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-bcd4f33c-2436-499d-bc52-33cd73e1b583 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "cinder-257c658b-f9f9-48d0-b74b-67293af1c8ce-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:42 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5930dbcc-f625-4a7f-a08b-1299fafeebdd tempest-CreateVolumesFromSourceVolumeTest-929854129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.357s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:42 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-5930dbcc-f625-4a7f-a08b-1299fafeebdd tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:35:42 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-5930dbcc-f625-4a7f-a08b-1299fafeebdd tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Deleted volume successfully. Sep 28 17:35:42 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-bcd4f33c-2436-499d-bc52-33cd73e1b583 tempest-CreateVolumesFromSnapshotTest-556144415 None] Acquiring lock "cinder-quobyte-257c658b-f9f9-48d0-b74b-67293af1c8ce" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:42 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5930dbcc-f625-4a7f-a08b-1299fafeebdd tempest-CreateVolumesFromSourceVolumeTest-929854129 None] Lock "cinder-d51f8b0f-024b-47f5-8594-5149480740c9-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:42 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-bcd4f33c-2436-499d-bc52-33cd73e1b583 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "cinder-quobyte-257c658b-f9f9-48d0-b74b-67293af1c8ce" acquired by "delete_volume" :: waited 0.025s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:42 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:42 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a307dd-699c-47e8-83e0-a5ff74479e60]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:35:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bcd4f33c-2436-499d-bc52-33cd73e1b583 tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-257c658b-f9f9-48d0-b74b-67293af1c8ce {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-033ef2a1-6d25-4199-85c9-f3cba3e9d1d6 tempest-VolumeDependencyTests-276100199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9.16fb6f8e-314b-4e5b-9bf9-28bb5c75449a 1G" returned: 0 in 0.656s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-033ef2a1-6d25-4199-85c9-f3cba3e9d1d6 tempest-VolumeDependencyTests-276100199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9.16fb6f8e-314b-4e5b-9bf9-28bb5c75449a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:42 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9.16fb6f8e-314b-4e5b-9bf9-28bb5c75449a Sep 28 17:35:42 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:42 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-adebf02e-85cd-46b2-b873-c399513a3aee tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.385s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:42 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-adebf02e-85cd-46b2-b873-c399513a3aee tempest-CreateVolumesFromSnapshotTest-556144415 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:35:42 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-adebf02e-85cd-46b2-b873-c399513a3aee tempest-CreateVolumesFromSnapshotTest-556144415 None] Deleted volume successfully. Sep 28 17:35:42 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-adebf02e-85cd-46b2-b873-c399513a3aee tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "cinder-cd9a341c-0572-4b5e-85b5-dee6911c5c2f-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:42 devstack sudo[108134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-257c658b-f9f9-48d0-b74b-67293af1c8ce Sep 28 17:35:42 devstack sudo[108134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:42 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-033ef2a1-6d25-4199-85c9-f3cba3e9d1d6 tempest-VolumeDependencyTests-276100199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9.16fb6f8e-314b-4e5b-9bf9-28bb5c75449a" returned: 0 in 0.359s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:42 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-033ef2a1-6d25-4199-85c9-f3cba3e9d1d6 tempest-VolumeDependencyTests-276100199 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9.16fb6f8e-314b-4e5b-9bf9-28bb5c75449a is being set with open permissions: ugo+rw Sep 28 17:35:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-033ef2a1-6d25-4199-85c9-f3cba3e9d1d6 tempest-VolumeDependencyTests-276100199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9.16fb6f8e-314b-4e5b-9bf9-28bb5c75449a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:42 devstack sudo[108145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9.16fb6f8e-314b-4e5b-9bf9-28bb5c75449a Sep 28 17:35:42 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:42 devstack sudo[108134]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bcd4f33c-2436-499d-bc52-33cd73e1b583 tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-257c658b-f9f9-48d0-b74b-67293af1c8ce" returned: 0 in 0.431s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bcd4f33c-2436-499d-bc52-33cd73e1b583 tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-257c658b-f9f9-48d0-b74b-67293af1c8ce {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:42 devstack sudo[108148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-257c658b-f9f9-48d0-b74b-67293af1c8ce Sep 28 17:35:42 devstack sudo[108148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:43 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-033ef2a1-6d25-4199-85c9-f3cba3e9d1d6 tempest-VolumeDependencyTests-276100199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9.16fb6f8e-314b-4e5b-9bf9-28bb5c75449a" returned: 0 in 0.274s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-033ef2a1-6d25-4199-85c9-f3cba3e9d1d6 tempest-VolumeDependencyTests-276100199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:43 devstack sudo[108148]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bcd4f33c-2436-499d-bc52-33cd73e1b583 tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-257c658b-f9f9-48d0-b74b-67293af1c8ce" returned: 0 in 0.285s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:43 devstack sudo[108152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9.info Sep 28 17:35:43 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:43 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-bcd4f33c-2436-499d-bc52-33cd73e1b583 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "cinder-quobyte-257c658b-f9f9-48d0-b74b-67293af1c8ce" released by "delete_volume" :: held 0.788s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:43 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-bcd4f33c-2436-499d-bc52-33cd73e1b583 tempest-CreateVolumesFromSnapshotTest-556144415 None] Created reservations ['6908793c-bcc6-4b09-96fd-94cf804ee02c', 'db38503d-e744-4dbc-8f49-237808ecb222', '0279f594-a05e-42b8-82c9-4ed7ea464d42', 'a40ea4b2-2f3d-4321-ad6b-f5134b34eda4'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:35:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-bcd4f33c-2436-499d-bc52-33cd73e1b583 tempest-CreateVolumesFromSnapshotTest-556144415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-bcd4f33c-2436-499d-bc52-33cd73e1b583 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:43 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-bcd4f33c-2436-499d-bc52-33cd73e1b583 tempest-CreateVolumesFromSnapshotTest-556144415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:43 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-bcd4f33c-2436-499d-bc52-33cd73e1b583 tempest-CreateVolumesFromSnapshotTest-556144415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-bcd4f33c-2436-499d-bc52-33cd73e1b583 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bcd4f33c-2436-499d-bc52-33cd73e1b583 tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:43 devstack sudo[108155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:35:43 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:43 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8d4133b6-17a9-4093-93f4-9749c48ce1c9 tempest-CreateVolumesFromSnapshotTest-556144415 None] Acquiring lock "cinder-8c12cde6-56e3-4ed3-a1d6-5b227a036a65-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:43 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:43 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8d4133b6-17a9-4093-93f4-9749c48ce1c9 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "cinder-8c12cde6-56e3-4ed3-a1d6-5b227a036a65-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-033ef2a1-6d25-4199-85c9-f3cba3e9d1d6 tempest-VolumeDependencyTests-276100199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9.info" returned: 0 in 0.426s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:43 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-033ef2a1-6d25-4199-85c9-f3cba3e9d1d6 tempest-VolumeDependencyTests-276100199 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9.info is being set with open permissions: ugo+rw Sep 28 17:35:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-033ef2a1-6d25-4199-85c9-f3cba3e9d1d6 tempest-VolumeDependencyTests-276100199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:43 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9.info Sep 28 17:35:43 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:43 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8d4133b6-17a9-4093-93f4-9749c48ce1c9 tempest-CreateVolumesFromSnapshotTest-556144415 None] Acquiring lock "cinder-quobyte-8c12cde6-56e3-4ed3-a1d6-5b227a036a65" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:43 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8d4133b6-17a9-4093-93f4-9749c48ce1c9 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "cinder-quobyte-8c12cde6-56e3-4ed3-a1d6-5b227a036a65" acquired by "delete_volume" :: waited 0.037s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:43 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f21226-2f54-437f-ba83-28e092288d99]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:35:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8d4133b6-17a9-4093-93f4-9749c48ce1c9 tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8c12cde6-56e3-4ed3-a1d6-5b227a036a65 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:43 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-bcd4f33c-2436-499d-bc52-33cd73e1b583 tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.488s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:43 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-bcd4f33c-2436-499d-bc52-33cd73e1b583 tempest-CreateVolumesFromSnapshotTest-556144415 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:35:43 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-bcd4f33c-2436-499d-bc52-33cd73e1b583 tempest-CreateVolumesFromSnapshotTest-556144415 None] Deleted volume successfully. Sep 28 17:35:43 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-bcd4f33c-2436-499d-bc52-33cd73e1b583 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "cinder-257c658b-f9f9-48d0-b74b-67293af1c8ce-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:43 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-033ef2a1-6d25-4199-85c9-f3cba3e9d1d6 tempest-VolumeDependencyTests-276100199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9.info" returned: 0 in 0.351s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:43 devstack sudo[108161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8c12cde6-56e3-4ed3-a1d6-5b227a036a65 Sep 28 17:35:43 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-033ef2a1-6d25-4199-85c9-f3cba3e9d1d6 tempest-VolumeDependencyTests-276100199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.697s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:44 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-033ef2a1-6d25-4199-85c9-f3cba3e9d1d6 tempest-VolumeDependencyTests-276100199 None] Create snapshot completed successfully Sep 28 17:35:44 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8d4133b6-17a9-4093-93f4-9749c48ce1c9 tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8c12cde6-56e3-4ed3-a1d6-5b227a036a65" returned: 0 in 0.490s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8d4133b6-17a9-4093-93f4-9749c48ce1c9 tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8c12cde6-56e3-4ed3-a1d6-5b227a036a65 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:44 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8c12cde6-56e3-4ed3-a1d6-5b227a036a65 Sep 28 17:35:44 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:44 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8d4133b6-17a9-4093-93f4-9749c48ce1c9 tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8c12cde6-56e3-4ed3-a1d6-5b227a036a65" returned: 0 in 0.322s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:44 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8d4133b6-17a9-4093-93f4-9749c48ce1c9 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "cinder-quobyte-8c12cde6-56e3-4ed3-a1d6-5b227a036a65" released by "delete_volume" :: held 0.909s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:44 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-8d4133b6-17a9-4093-93f4-9749c48ce1c9 tempest-CreateVolumesFromSnapshotTest-556144415 None] Created reservations ['5d6fc0b5-a23a-48c7-87fa-fd5b1769f186', '12276bea-c8a8-40d0-93f8-e46baa051320', 'fb7f1f87-9c61-4c77-9ae1-12a366fef591', '5781aaa8-fffc-4437-b7f3-261dc5e8a1da'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:35:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8d4133b6-17a9-4093-93f4-9749c48ce1c9 tempest-CreateVolumesFromSnapshotTest-556144415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8d4133b6-17a9-4093-93f4-9749c48ce1c9 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:44 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-8d4133b6-17a9-4093-93f4-9749c48ce1c9 tempest-CreateVolumesFromSnapshotTest-556144415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:44 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-8d4133b6-17a9-4093-93f4-9749c48ce1c9 tempest-CreateVolumesFromSnapshotTest-556144415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8d4133b6-17a9-4093-93f4-9749c48ce1c9 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8d4133b6-17a9-4093-93f4-9749c48ce1c9 tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:44 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:35:44 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c1561bca-fc4e-415e-a484-fcb8365f1e4c tempest-CreateVolumesFromSnapshotTest-556144415 None] Acquiring lock "cinder-4a01a5c2-3b72-4dad-a84c-772869745a9e-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c1561bca-fc4e-415e-a484-fcb8365f1e4c tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "cinder-4a01a5c2-3b72-4dad-a84c-772869745a9e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c1561bca-fc4e-415e-a484-fcb8365f1e4c tempest-CreateVolumesFromSnapshotTest-556144415 None] Acquiring lock "cinder-quobyte-0c16e5d7-4f44-4277-ba04-fb6134e5291b" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c1561bca-fc4e-415e-a484-fcb8365f1e4c tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "cinder-quobyte-0c16e5d7-4f44-4277-ba04-fb6134e5291b" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c1561bca-fc4e-415e-a484-fcb8365f1e4c tempest-CreateVolumesFromSnapshotTest-556144415 None] Acquiring lock "cinder-quobyte-4a01a5c2-3b72-4dad-a84c-772869745a9e" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c1561bca-fc4e-415e-a484-fcb8365f1e4c tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "cinder-quobyte-4a01a5c2-3b72-4dad-a84c-772869745a9e" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-c1561bca-fc4e-415e-a484-fcb8365f1e4c tempest-CreateVolumesFromSnapshotTest-556144415 None] Deleting offline snapshot 4a01a5c2-3b72-4dad-a84c-772869745a9e of volume 0c16e5d7-4f44-4277-ba04-fb6134e5291b {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-c1561bca-fc4e-415e-a484-fcb8365f1e4c tempest-CreateVolumesFromSnapshotTest-556144415 None] snapshot_file for this snap is: volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b.4a01a5c2-3b72-4dad-a84c-772869745a9e {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84ef20a-d6fb-4d86-9d69-2af8871a68a5]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c1561bca-fc4e-415e-a484-fcb8365f1e4c tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b.4a01a5c2-3b72-4dad-a84c-772869745a9e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:35:45 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8d4133b6-17a9-4093-93f4-9749c48ce1c9 tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.423s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-8d4133b6-17a9-4093-93f4-9749c48ce1c9 tempest-CreateVolumesFromSnapshotTest-556144415 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:35:45 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-8d4133b6-17a9-4093-93f4-9749c48ce1c9 tempest-CreateVolumesFromSnapshotTest-556144415 None] Deleted volume successfully. Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Flow 'volume_create_manager' (60e02723-de01-42b5-901d-86654e230bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:45 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b.4a01a5c2-3b72-4dad-a84c-772869745a9e Sep 28 17:35:45 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc5e51d-f9a1-4dac-b81e-d1e0aead5e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8d4133b6-17a9-4093-93f4-9749c48ce1c9 tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "cinder-8c12cde6-56e3-4ed3-a1d6-5b227a036a65-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bc5e51d-f9a1-4dac-b81e-d1e0aead5e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1984133041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6097ca4bfec4db6baa714121c3a5875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=16fb6f8e-314b-4e5b-9bf9-28bb5c75449a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:45Z,use_quota=True,user_id='eeb62bab249844d79772f1b8f12cdd8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09b3d192-b20b-4bd4-b7f2-1e8b85687ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09b3d192-b20b-4bd4-b7f2-1e8b85687ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee5c17d2-e1bf-4268-a63d-85ac3206df48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee5c17d2-e1bf-4268-a63d-85ac3206df48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c', 'volume_name': 'volume-1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c', 'volume_size': 1, 'snapshot_id': '16fb6f8e-314b-4e5b-9bf9-28bb5c75449a'}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fdf7a8b-2caf-4d99-b7d7-931067e41212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fdf7a8b-2caf-4d99-b7d7-931067e41212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824c8475-0d03-45e2-b5cd-a12ed8081fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:45 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Volume 1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c', 'volume_size': 1, 'snapshot_id': '16fb6f8e-314b-4e5b-9bf9-28bb5c75449a'} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Acquiring lock "cinder-quobyte-16fb6f8e-314b-4e5b-9bf9-28bb5c75449a-1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c" by "_create_volume_from_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Lock "cinder-quobyte-16fb6f8e-314b-4e5b-9bf9-28bb5c75449a-1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Creating volume 1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c from snapshot 16fb6f8e-314b-4e5b-9bf9-28bb5c75449a {{(pid=86917) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Acquiring lock "cinder-quobyte-1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c" by "_copy_volume_from_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Lock "cinder-quobyte-1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] snapshot: 16fb6f8e-314b-4e5b-9bf9-28bb5c75449a, volume: 1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c, {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c76fed-2798-4f92-9c98-776f8410b5ec]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9.16fb6f8e-314b-4e5b-9bf9-28bb5c75449a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:45 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9.16fb6f8e-314b-4e5b-9bf9-28bb5c75449a Sep 28 17:35:45 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:45 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c1561bca-fc4e-415e-a484-fcb8365f1e4c tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b.4a01a5c2-3b72-4dad-a84c-772869745a9e" returned: 0 in 0.564s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-c1561bca-fc4e-415e-a484-fcb8365f1e4c tempest-CreateVolumesFromSnapshotTest-556144415 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[75836b7b-818a-44c3-8ee0-1e2cbf4c5e39]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:35:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c1561bca-fc4e-415e-a484-fcb8365f1e4c tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:45 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b Sep 28 17:35:45 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:46 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9.16fb6f8e-314b-4e5b-9bf9-28bb5c75449a" returned: 0 in 0.441s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:46 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:35:46 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52a3830-1a09-4a7c-8cb8-a5c582f6c226]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:35:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:46 devstack sudo[108188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9 Sep 28 17:35:46 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:46 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c1561bca-fc4e-415e-a484-fcb8365f1e4c tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b" returned: 0 in 0.571s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c1561bca-fc4e-415e-a484-fcb8365f1e4c tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b.4a01a5c2-3b72-4dad-a84c-772869745a9e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:46 devstack sudo[108194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b.4a01a5c2-3b72-4dad-a84c-772869745a9e Sep 28 17:35:46 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:46 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9" returned: 0 in 0.456s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:46 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9 {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:35:46 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Creating direct copy from snapshot {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:35:46 devstack cinder-volume[86917]: DEBUG cinder.utils [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Path /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c not found in is_blk_device check {{(pid=86917) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:35:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:46 devstack sudo[108199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c Sep 28 17:35:46 devstack sudo[108199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:46 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c1561bca-fc4e-415e-a484-fcb8365f1e4c tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b.4a01a5c2-3b72-4dad-a84c-772869745a9e" returned: 0 in 0.490s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c1561bca-fc4e-415e-a484-fcb8365f1e4c tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b.4a01a5c2-3b72-4dad-a84c-772869745a9e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:46 devstack sudo[108208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b.4a01a5c2-3b72-4dad-a84c-772869745a9e Sep 28 17:35:46 devstack sudo[108208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:47 devstack sudo[108208]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c1561bca-fc4e-415e-a484-fcb8365f1e4c tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b.4a01a5c2-3b72-4dad-a84c-772869745a9e" returned: 0 in 0.434s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:47 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c1561bca-fc4e-415e-a484-fcb8365f1e4c tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "cinder-quobyte-4a01a5c2-3b72-4dad-a84c-772869745a9e" released by "_delete_snapshot" :: held 2.336s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:47 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c1561bca-fc4e-415e-a484-fcb8365f1e4c tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "cinder-quobyte-0c16e5d7-4f44-4277-ba04-fb6134e5291b" released by "delete_snapshot" :: held 2.397s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:47 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-c1561bca-fc4e-415e-a484-fcb8365f1e4c tempest-CreateVolumesFromSnapshotTest-556144415 None] Created reservations ['845b409a-e86b-4620-9cda-a3c32af67cfc', 'e7355ccc-f400-4f0e-80c0-26b98af468d7', 'c1d44d7c-8c52-421b-9177-8b147d7125c1', '75956c8e-a8cc-469f-a0f9-739b673fae72'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:35:47 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-c1561bca-fc4e-415e-a484-fcb8365f1e4c tempest-CreateVolumesFromSnapshotTest-556144415 None] Delete snapshot completed successfully. Sep 28 17:35:47 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c1561bca-fc4e-415e-a484-fcb8365f1e4c tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "cinder-4a01a5c2-3b72-4dad-a84c-772869745a9e-delete_snapshot" released by "delete_snapshot" :: held 2.813s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-3ace2c66-a20c-4afb-bf5d-2b07b80dd416 tempest-ProjectAdminTests-2009242453 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1098976135254, 'free_capacity_gb': 1775.1098976135254, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86917) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 17:35:48 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2d3b96a7-79be-46b9-befa-3f6f4f5c437e tempest-CreateVolumesFromSnapshotTest-556144415 None] Acquiring lock "cinder-0c16e5d7-4f44-4277-ba04-fb6134e5291b-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:48 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2d3b96a7-79be-46b9-befa-3f6f4f5c437e tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "cinder-0c16e5d7-4f44-4277-ba04-fb6134e5291b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:48 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2d3b96a7-79be-46b9-befa-3f6f4f5c437e tempest-CreateVolumesFromSnapshotTest-556144415 None] Acquiring lock "cinder-quobyte-0c16e5d7-4f44-4277-ba04-fb6134e5291b" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:48 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2d3b96a7-79be-46b9-befa-3f6f4f5c437e tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "cinder-quobyte-0c16e5d7-4f44-4277-ba04-fb6134e5291b" acquired by "delete_volume" :: waited 0.040s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:48 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae643ef-16f1-45a4-81b1-8ca388aba2a6]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:35:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2d3b96a7-79be-46b9-befa-3f6f4f5c437e tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:49 devstack sudo[108218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b Sep 28 17:35:49 devstack sudo[108218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:35:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:49 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:35:49 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:49 devstack sudo[108218]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2d3b96a7-79be-46b9-befa-3f6f4f5c437e tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b" returned: 0 in 1.087s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2d3b96a7-79be-46b9-befa-3f6f4f5c437e tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:49 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b Sep 28 17:35:49 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:50 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.532s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:50 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:35:50 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager._thread_info {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:35:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread count: 28 {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:35:50 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread info: [<_MainThread(MainThread, started 132915553284224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:35:50 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2d3b96a7-79be-46b9-befa-3f6f4f5c437e tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-0c16e5d7-4f44-4277-ba04-fb6134e5291b" returned: 0 in 0.418s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:50 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2d3b96a7-79be-46b9-befa-3f6f4f5c437e tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "cinder-quobyte-0c16e5d7-4f44-4277-ba04-fb6134e5291b" released by "delete_volume" :: held 1.682s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:50 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-2d3b96a7-79be-46b9-befa-3f6f4f5c437e tempest-CreateVolumesFromSnapshotTest-556144415 None] Created reservations ['c9761c70-ba69-4cc9-8cff-82634a720970', 'c6091ee1-9a5a-40d4-8941-673aa4cd973a', 'df6dd3a7-3af8-45c0-b13f-1113b945d1ce', '350b86f5-b92f-4040-8e0d-794f23426afc'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:35:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2d3b96a7-79be-46b9-befa-3f6f4f5c437e tempest-CreateVolumesFromSnapshotTest-556144415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2d3b96a7-79be-46b9-befa-3f6f4f5c437e tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:50 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-2d3b96a7-79be-46b9-befa-3f6f4f5c437e tempest-CreateVolumesFromSnapshotTest-556144415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:50 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-2d3b96a7-79be-46b9-befa-3f6f4f5c437e tempest-CreateVolumesFromSnapshotTest-556144415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2d3b96a7-79be-46b9-befa-3f6f4f5c437e tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2d3b96a7-79be-46b9-befa-3f6f4f5c437e tempest-CreateVolumesFromSnapshotTest-556144415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:50 devstack sudo[108230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:35:50 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:51 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2d3b96a7-79be-46b9-befa-3f6f4f5c437e tempest-CreateVolumesFromSnapshotTest-556144415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.606s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:51 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-2d3b96a7-79be-46b9-befa-3f6f4f5c437e tempest-CreateVolumesFromSnapshotTest-556144415 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:35:51 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-2d3b96a7-79be-46b9-befa-3f6f4f5c437e tempest-CreateVolumesFromSnapshotTest-556144415 None] Deleted volume successfully. Sep 28 17:35:51 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2d3b96a7-79be-46b9-befa-3f6f4f5c437e tempest-CreateVolumesFromSnapshotTest-556144415 None] Lock "cinder-0c16e5d7-4f44-4277-ba04-fb6134e5291b-delete_volume" released by "delete_volume" :: held 2.845s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:55 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbc4d907-c27b-4370-b4fa-2a2c0edcd0c9 tempest-ProjectReaderTests-1993964986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:35:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-fbc4d907-c27b-4370-b4fa-2a2c0edcd0c9 tempest-ProjectReaderTests-1993964986 None] Flow 'volume_create_manager' (10488b81-631e-4c83-903e-c9b37126a0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-fbc4d907-c27b-4370-b4fa-2a2c0edcd0c9 tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed8ebfd5-d216-435a-ad51-4e6c5fab8803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-fbc4d907-c27b-4370-b4fa-2a2c0edcd0c9 tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed8ebfd5-d216-435a-ad51-4e6c5fab8803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1684230154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e15f4882-3f0e-4a86-be1f-f4522283972e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41af83b5b027437e89b26236a6526fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:55Z,use_quota=True,user_id='7f9cff10023b415f845cab0cad31dd8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-fbc4d907-c27b-4370-b4fa-2a2c0edcd0c9 tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76cd770b-3a99-4acd-8b49-ffbdf06b97ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-fbc4d907-c27b-4370-b4fa-2a2c0edcd0c9 tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76cd770b-3a99-4acd-8b49-ffbdf06b97ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-fbc4d907-c27b-4370-b4fa-2a2c0edcd0c9 tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c20dfc-1ea5-4d4d-a5a0-16826caaf379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-fbc4d907-c27b-4370-b4fa-2a2c0edcd0c9 tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c20dfc-1ea5-4d4d-a5a0-16826caaf379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e15f4882-3f0e-4a86-be1f-f4522283972e', 'volume_name': 'volume-e15f4882-3f0e-4a86-be1f-f4522283972e', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-fbc4d907-c27b-4370-b4fa-2a2c0edcd0c9 tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e97f6919-d5c6-40fc-9b63-59ab31d31c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-fbc4d907-c27b-4370-b4fa-2a2c0edcd0c9 tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e97f6919-d5c6-40fc-9b63-59ab31d31c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-fbc4d907-c27b-4370-b4fa-2a2c0edcd0c9 tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a34c74a-24c0-459f-a4e9-251b31abbae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:55 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-fbc4d907-c27b-4370-b4fa-2a2c0edcd0c9 tempest-ProjectReaderTests-1993964986 None] Volume e15f4882-3f0e-4a86-be1f-f4522283972e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e15f4882-3f0e-4a86-be1f-f4522283972e', 'volume_size': 1} Sep 28 17:35:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-fbc4d907-c27b-4370-b4fa-2a2c0edcd0c9 tempest-ProjectReaderTests-1993964986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:56 devstack sudo[108199]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c" returned: 0 in 9.532s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:56 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Image conversion details: src /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9, size 1024.00 MB, duration 9.53 sec, destination /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c {{(pid=86917) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:35:56 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Converted 1024.00 MB image at 107.41 MB/s Sep 28 17:35:56 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c is being set with open permissions: ugo+rw Sep 28 17:35:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:56 devstack sudo[108234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c Sep 28 17:35:56 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:56 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c" returned: 0 in 0.258s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:56 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Lock "cinder-quobyte-1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c" released by "_copy_volume_from_snapshot" :: held 10.801s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:56 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Lock "cinder-quobyte-16fb6f8e-314b-4e5b-9bf9-28bb5c75449a-1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c" released by "_create_volume_from_snapshot" :: held 10.884s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.909s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-fbc4d907-c27b-4370-b4fa-2a2c0edcd0c9 tempest-ProjectReaderTests-1993964986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.861s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:56 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-fbc4d907-c27b-4370-b4fa-2a2c0edcd0c9 tempest-ProjectReaderTests-1993964986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1684230154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e15f4882-3f0e-4a86-be1f-f4522283972e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41af83b5b027437e89b26236a6526fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:35:55Z,use_quota=True,user_id='7f9cff10023b415f845cab0cad31dd8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:35:56 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-fbc4d907-c27b-4370-b4fa-2a2c0edcd0c9 tempest-ProjectReaderTests-1993964986 None] Creating volume e15f4882-3f0e-4a86-be1f-f4522283972e {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:35:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-fbc4d907-c27b-4370-b4fa-2a2c0edcd0c9 tempest-ProjectReaderTests-1993964986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-fbc4d907-c27b-4370-b4fa-2a2c0edcd0c9 tempest-ProjectReaderTests-1993964986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:56 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-fbc4d907-c27b-4370-b4fa-2a2c0edcd0c9 tempest-ProjectReaderTests-1993964986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:56 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-fbc4d907-c27b-4370-b4fa-2a2c0edcd0c9 tempest-ProjectReaderTests-1993964986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-fbc4d907-c27b-4370-b4fa-2a2c0edcd0c9 tempest-ProjectReaderTests-1993964986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:56 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-fbc4d907-c27b-4370-b4fa-2a2c0edcd0c9 tempest-ProjectReaderTests-1993964986 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:35:56 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-fbc4d907-c27b-4370-b4fa-2a2c0edcd0c9 tempest-ProjectReaderTests-1993964986 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:35:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fbc4d907-c27b-4370-b4fa-2a2c0edcd0c9 tempest-ProjectReaderTests-1993964986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e15f4882-3f0e-4a86-be1f-f4522283972e 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:56 devstack sudo[108237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e15f4882-3f0e-4a86-be1f-f4522283972e 1073741824 Sep 28 17:35:56 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:56 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824c8475-0d03-45e2-b5cd-a12ed8081fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c', 'volume_size': 1, 'snapshot_id': '16fb6f8e-314b-4e5b-9bf9-28bb5c75449a'}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:56 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5c675c7-9d35-40f9-b5ef-312e5cb725fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:56 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Volume volume-1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c (1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c): created successfully Sep 28 17:35:56 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5c675c7-9d35-40f9-b5ef-312e5cb725fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:56 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Flow 'volume_create_manager' (60e02723-de01-42b5-901d-86654e230bf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:56 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-6a033c03-f045-4e5f-8b2d-147f71369ff6 tempest-VolumeDependencyTests-276100199 None] Created volume successfully. Sep 28 17:35:56 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-368dcc20-8890-486e-b7e1-70c227f51bf7 tempest-VolumeDependencyTests-276100199 None] Acquiring lock "cinder-16fb6f8e-314b-4e5b-9bf9-28bb5c75449a-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:56 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-368dcc20-8890-486e-b7e1-70c227f51bf7 tempest-VolumeDependencyTests-276100199 None] Lock "cinder-16fb6f8e-314b-4e5b-9bf9-28bb5c75449a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:56 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-368dcc20-8890-486e-b7e1-70c227f51bf7 tempest-VolumeDependencyTests-276100199 None] Acquiring lock "cinder-quobyte-00810319-eb06-4d53-8c45-2aaf3d12fbf9" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:56 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-368dcc20-8890-486e-b7e1-70c227f51bf7 tempest-VolumeDependencyTests-276100199 None] Lock "cinder-quobyte-00810319-eb06-4d53-8c45-2aaf3d12fbf9" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:56 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-368dcc20-8890-486e-b7e1-70c227f51bf7 tempest-VolumeDependencyTests-276100199 None] Acquiring lock "cinder-quobyte-16fb6f8e-314b-4e5b-9bf9-28bb5c75449a" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:56 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-368dcc20-8890-486e-b7e1-70c227f51bf7 tempest-VolumeDependencyTests-276100199 None] Lock "cinder-quobyte-16fb6f8e-314b-4e5b-9bf9-28bb5c75449a" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:56 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-368dcc20-8890-486e-b7e1-70c227f51bf7 tempest-VolumeDependencyTests-276100199 None] Deleting offline snapshot 16fb6f8e-314b-4e5b-9bf9-28bb5c75449a of volume 00810319-eb06-4d53-8c45-2aaf3d12fbf9 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:35:56 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-368dcc20-8890-486e-b7e1-70c227f51bf7 tempest-VolumeDependencyTests-276100199 None] snapshot_file for this snap is: volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9.16fb6f8e-314b-4e5b-9bf9-28bb5c75449a {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:35:57 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fa6e07-8977-404a-abef-1d8789ceba26]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:35:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-368dcc20-8890-486e-b7e1-70c227f51bf7 tempest-VolumeDependencyTests-276100199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9.16fb6f8e-314b-4e5b-9bf9-28bb5c75449a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:57 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fbc4d907-c27b-4370-b4fa-2a2c0edcd0c9 tempest-ProjectReaderTests-1993964986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e15f4882-3f0e-4a86-be1f-f4522283972e 1073741824" returned: 0 in 0.628s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fbc4d907-c27b-4370-b4fa-2a2c0edcd0c9 tempest-ProjectReaderTests-1993964986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e15f4882-3f0e-4a86-be1f-f4522283972e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:57 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e15f4882-3f0e-4a86-be1f-f4522283972e Sep 28 17:35:57 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:57 devstack sudo[108243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9.16fb6f8e-314b-4e5b-9bf9-28bb5c75449a Sep 28 17:35:57 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:57 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fbc4d907-c27b-4370-b4fa-2a2c0edcd0c9 tempest-ProjectReaderTests-1993964986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e15f4882-3f0e-4a86-be1f-f4522283972e" returned: 0 in 0.291s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:57 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-fbc4d907-c27b-4370-b4fa-2a2c0edcd0c9 tempest-ProjectReaderTests-1993964986 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:35:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-fbc4d907-c27b-4370-b4fa-2a2c0edcd0c9 tempest-ProjectReaderTests-1993964986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:57 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-fbc4d907-c27b-4370-b4fa-2a2c0edcd0c9 tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a34c74a-24c0-459f-a4e9-251b31abbae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e15f4882-3f0e-4a86-be1f-f4522283972e', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:57 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-fbc4d907-c27b-4370-b4fa-2a2c0edcd0c9 tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (444f2dda-a53b-4b8c-8683-9f592bf6836e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:35:57 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-fbc4d907-c27b-4370-b4fa-2a2c0edcd0c9 tempest-ProjectReaderTests-1993964986 None] Volume volume-e15f4882-3f0e-4a86-be1f-f4522283972e (e15f4882-3f0e-4a86-be1f-f4522283972e): created successfully Sep 28 17:35:57 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-fbc4d907-c27b-4370-b4fa-2a2c0edcd0c9 tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (444f2dda-a53b-4b8c-8683-9f592bf6836e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:35:57 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-fbc4d907-c27b-4370-b4fa-2a2c0edcd0c9 tempest-ProjectReaderTests-1993964986 None] Flow 'volume_create_manager' (10488b81-631e-4c83-903e-c9b37126a0d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:35:57 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-fbc4d907-c27b-4370-b4fa-2a2c0edcd0c9 tempest-ProjectReaderTests-1993964986 None] Created volume successfully. Sep 28 17:35:57 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-368dcc20-8890-486e-b7e1-70c227f51bf7 tempest-VolumeDependencyTests-276100199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9.16fb6f8e-314b-4e5b-9bf9-28bb5c75449a" returned: 0 in 0.522s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:57 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-368dcc20-8890-486e-b7e1-70c227f51bf7 tempest-VolumeDependencyTests-276100199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:35:57 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fe72c2-e9c9-427f-b4c8-793ca065e332]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:35:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-368dcc20-8890-486e-b7e1-70c227f51bf7 tempest-VolumeDependencyTests-276100199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:57 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9 Sep 28 17:35:57 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:58 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-368dcc20-8890-486e-b7e1-70c227f51bf7 tempest-VolumeDependencyTests-276100199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9" returned: 0 in 0.594s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-368dcc20-8890-486e-b7e1-70c227f51bf7 tempest-VolumeDependencyTests-276100199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9.16fb6f8e-314b-4e5b-9bf9-28bb5c75449a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:58 devstack sudo[108256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9.16fb6f8e-314b-4e5b-9bf9-28bb5c75449a Sep 28 17:35:58 devstack sudo[108256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:58 devstack sudo[108256]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-368dcc20-8890-486e-b7e1-70c227f51bf7 tempest-VolumeDependencyTests-276100199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9.16fb6f8e-314b-4e5b-9bf9-28bb5c75449a" returned: 0 in 0.393s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-368dcc20-8890-486e-b7e1-70c227f51bf7 tempest-VolumeDependencyTests-276100199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9.16fb6f8e-314b-4e5b-9bf9-28bb5c75449a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:58 devstack sudo[108261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9.16fb6f8e-314b-4e5b-9bf9-28bb5c75449a Sep 28 17:35:58 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:58 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-7650fde5-5e28-4e72-a5d5-fc062dd01258 tempest-ProjectReaderTests-1993964986 None] Acquiring lock "cinder-e15f4882-3f0e-4a86-be1f-f4522283972e-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:58 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-7650fde5-5e28-4e72-a5d5-fc062dd01258 tempest-ProjectReaderTests-1993964986 None] Lock "cinder-e15f4882-3f0e-4a86-be1f-f4522283972e-delete_volume" acquired by "delete_volume" :: waited 0.120s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:58 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-7650fde5-5e28-4e72-a5d5-fc062dd01258 tempest-ProjectReaderTests-1993964986 None] Acquiring lock "cinder-quobyte-e15f4882-3f0e-4a86-be1f-f4522283972e" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:35:58 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-7650fde5-5e28-4e72-a5d5-fc062dd01258 tempest-ProjectReaderTests-1993964986 None] Lock "cinder-quobyte-e15f4882-3f0e-4a86-be1f-f4522283972e" acquired by "delete_volume" :: waited 0.021s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:35:58 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dce722c-f3da-4bad-9a15-02a8922d4ce6]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:35:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7650fde5-5e28-4e72-a5d5-fc062dd01258 tempest-ProjectReaderTests-1993964986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e15f4882-3f0e-4a86-be1f-f4522283972e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:58 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-368dcc20-8890-486e-b7e1-70c227f51bf7 tempest-VolumeDependencyTests-276100199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9.16fb6f8e-314b-4e5b-9bf9-28bb5c75449a" returned: 0 in 0.383s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:59 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-368dcc20-8890-486e-b7e1-70c227f51bf7 tempest-VolumeDependencyTests-276100199 None] Lock "cinder-quobyte-16fb6f8e-314b-4e5b-9bf9-28bb5c75449a" released by "_delete_snapshot" :: held 2.067s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:59 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-368dcc20-8890-486e-b7e1-70c227f51bf7 tempest-VolumeDependencyTests-276100199 None] Lock "cinder-quobyte-00810319-eb06-4d53-8c45-2aaf3d12fbf9" released by "delete_snapshot" :: held 2.113s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:59 devstack sudo[108264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e15f4882-3f0e-4a86-be1f-f4522283972e Sep 28 17:35:59 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:59 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-368dcc20-8890-486e-b7e1-70c227f51bf7 tempest-VolumeDependencyTests-276100199 None] Created reservations ['9d36d7b7-a78f-4bd1-9975-563a009731ad', 'b7fadb03-2d89-4d0f-ba55-8e6f504ab013', 'b52346a8-0953-4278-b1e1-455bdd30f7d1', '2f2478c5-892d-4bc9-8dff-cca9614051cb'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:35:59 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-368dcc20-8890-486e-b7e1-70c227f51bf7 tempest-VolumeDependencyTests-276100199 None] Delete snapshot completed successfully. Sep 28 17:35:59 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-368dcc20-8890-486e-b7e1-70c227f51bf7 tempest-VolumeDependencyTests-276100199 None] Lock "cinder-16fb6f8e-314b-4e5b-9bf9-28bb5c75449a-delete_snapshot" released by "delete_snapshot" :: held 2.297s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:59 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7650fde5-5e28-4e72-a5d5-fc062dd01258 tempest-ProjectReaderTests-1993964986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e15f4882-3f0e-4a86-be1f-f4522283972e" returned: 0 in 0.481s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7650fde5-5e28-4e72-a5d5-fc062dd01258 tempest-ProjectReaderTests-1993964986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e15f4882-3f0e-4a86-be1f-f4522283972e {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:59 devstack sudo[108269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e15f4882-3f0e-4a86-be1f-f4522283972e Sep 28 17:35:59 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:35:59 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root Sep 28 17:35:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7650fde5-5e28-4e72-a5d5-fc062dd01258 tempest-ProjectReaderTests-1993964986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e15f4882-3f0e-4a86-be1f-f4522283972e" returned: 0 in 0.306s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:35:59 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-7650fde5-5e28-4e72-a5d5-fc062dd01258 tempest-ProjectReaderTests-1993964986 None] Lock "cinder-quobyte-e15f4882-3f0e-4a86-be1f-f4522283972e" released by "delete_volume" :: held 0.854s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:35:59 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-7650fde5-5e28-4e72-a5d5-fc062dd01258 tempest-ProjectReaderTests-1993964986 None] Created reservations ['72ba7b5d-d789-4742-87bf-de2b7ee05580', '985499b9-e510-4278-b4dd-67d0c71cc4d2', '15bb9832-f640-492e-ac64-7339b58a130a', '5c425ac3-4201-41e0-a91c-c4adf13893d0'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:35:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7650fde5-5e28-4e72-a5d5-fc062dd01258 tempest-ProjectReaderTests-1993964986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:35:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7650fde5-5e28-4e72-a5d5-fc062dd01258 tempest-ProjectReaderTests-1993964986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:35:59 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-7650fde5-5e28-4e72-a5d5-fc062dd01258 tempest-ProjectReaderTests-1993964986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:35:59 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-7650fde5-5e28-4e72-a5d5-fc062dd01258 tempest-ProjectReaderTests-1993964986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:35:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7650fde5-5e28-4e72-a5d5-fc062dd01258 tempest-ProjectReaderTests-1993964986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:35:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7650fde5-5e28-4e72-a5d5-fc062dd01258 tempest-ProjectReaderTests-1993964986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:35:59 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:35:59 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:00 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-66a68d39-82e7-435c-9c58-6c23f4989254 tempest-VolumeDependencyTests-276100199 None] Acquiring lock "cinder-00810319-eb06-4d53-8c45-2aaf3d12fbf9-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:00 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-66a68d39-82e7-435c-9c58-6c23f4989254 tempest-VolumeDependencyTests-276100199 None] Lock "cinder-00810319-eb06-4d53-8c45-2aaf3d12fbf9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:00 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-66a68d39-82e7-435c-9c58-6c23f4989254 tempest-VolumeDependencyTests-276100199 None] Acquiring lock "cinder-quobyte-00810319-eb06-4d53-8c45-2aaf3d12fbf9" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:00 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-66a68d39-82e7-435c-9c58-6c23f4989254 tempest-VolumeDependencyTests-276100199 None] Lock "cinder-quobyte-00810319-eb06-4d53-8c45-2aaf3d12fbf9" acquired by "delete_volume" :: waited 0.034s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:00 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7650fde5-5e28-4e72-a5d5-fc062dd01258 tempest-ProjectReaderTests-1993964986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.422s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:00 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-7650fde5-5e28-4e72-a5d5-fc062dd01258 tempest-ProjectReaderTests-1993964986 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:36:00 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-7650fde5-5e28-4e72-a5d5-fc062dd01258 tempest-ProjectReaderTests-1993964986 None] Deleted volume successfully. Sep 28 17:36:00 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b5392b-4b98-4f58-a524-fb084385e277]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-66a68d39-82e7-435c-9c58-6c23f4989254 tempest-VolumeDependencyTests-276100199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:00 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-7650fde5-5e28-4e72-a5d5-fc062dd01258 tempest-ProjectReaderTests-1993964986 None] Lock "cinder-e15f4882-3f0e-4a86-be1f-f4522283972e-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:00 devstack sudo[108275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9 Sep 28 17:36:00 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:00 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:36:00 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Flow 'volume_create_manager' (c8b4f45a-352f-4fe4-a379-c97743d5e48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:36:00 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945c1134-235e-4276-ad68-403fdb2eb95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:00 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945c1134-235e-4276-ad68-403fdb2eb95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a8d88ab-5506-4daa-81af-1073421d9df2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce0ef04b03f4f4194af0ae59bdbb111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:36:01Z,use_quota=True,user_id='dabec5bb8e9249a59544a581675e5614',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:00 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb423233-904a-420a-9c28-253c93324f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:00 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb423233-904a-420a-9c28-253c93324f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:00 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77390106-7680-4869-8acc-f8d9c97d933f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:00 devstack cinder-volume[86917]: DEBUG cinder.image.glance [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Creating Keystone auth plugin from conf {{(pid=86917) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:36:00 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-66a68d39-82e7-435c-9c58-6c23f4989254 tempest-VolumeDependencyTests-276100199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9" returned: 0 in 0.457s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-66a68d39-82e7-435c-9c58-6c23f4989254 tempest-VolumeDependencyTests-276100199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:00 devstack sudo[108281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9 Sep 28 17:36:00 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77390106-7680-4869-8acc-f8d9c97d933f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8a8d88ab-5506-4daa-81af-1073421d9df2', 'volume_name': 'volume-8a8d88ab-5506-4daa-81af-1073421d9df2', 'volume_size': 1, 'image_id': 'c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4cccc21c9cc83f8c6e4331d7e2705804', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7ce0ef04b03f4f4194af0ae59bdbb111', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '95e72e9e919cd259c79eeeda046ea8ac00ddcd5aeae053feffc2da1a5c5771c4d833cac19b206ece2a7df80309ac1cc70a78435821242186027e9c34c449417b', 'id': 'c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e', 'created_at': datetime.datetime(2026, 9, 28, 15, 35, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 35, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e/file', 'properties': {}}, 'image_service': }' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a3f4f4-0ca8-415c-9833-f2a9951296fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:01 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a3f4f4-0ca8-415c-9833-f2a9951296fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a948495d-f2b9-4526-8662-029425d8a6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:01 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Volume 8a8d88ab-5506-4daa-81af-1073421d9df2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8a8d88ab-5506-4daa-81af-1073421d9df2', 'volume_size': 1, 'image_id': 'c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4cccc21c9cc83f8c6e4331d7e2705804', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7ce0ef04b03f4f4194af0ae59bdbb111', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '95e72e9e919cd259c79eeeda046ea8ac00ddcd5aeae053feffc2da1a5c5771c4d833cac19b206ece2a7df80309ac1cc70a78435821242186027e9c34c449417b', 'id': 'c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e', 'created_at': datetime.datetime(2026, 9, 28, 15, 35, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 35, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e/file', 'properties': {}}, 'image_service': } Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Trying to clone 8a8d88ab-5506-4daa-81af-1073421d9df2 from image c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e at location (None, [{'url': 'file:///opt/stack/data/glance/images/c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e', 'metadata': {}}]). {{(pid=86917) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-66a68d39-82e7-435c-9c58-6c23f4989254 tempest-VolumeDependencyTests-276100199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-00810319-eb06-4d53-8c45-2aaf3d12fbf9" returned: 0 in 0.437s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-66a68d39-82e7-435c-9c58-6c23f4989254 tempest-VolumeDependencyTests-276100199 None] Lock "cinder-quobyte-00810319-eb06-4d53-8c45-2aaf3d12fbf9" released by "delete_volume" :: held 1.025s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e_t54efemidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86917) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:36:01 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Image download 0.00 MB at 0.00 MB/s Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-66a68d39-82e7-435c-9c58-6c23f4989254 tempest-VolumeDependencyTests-276100199 None] Created reservations ['ef07bc8b-6ee9-4cab-885c-ea4719d87c0f', '227e4dd5-c2ab-4c84-9f15-2e98f1e432c1', 'e04ee9cc-31be-47c9-aa0b-49e846bb3b7d', 'dd960bc3-d080-4072-9704-aee3cf4e8310'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d20ff29-0e96-49e0-8ecb-4d9930246300]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e_t54efemidevstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-b002cedd-3669-4d81-bff5-3d48d9aa13dd tempest-ProjectReaderTests-1993964986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b002cedd-3669-4d81-bff5-3d48d9aa13dd tempest-ProjectReaderTests-1993964986 None] Flow 'volume_create_manager' (9c65597e-9396-42b5-a7a5-431745ec2533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b002cedd-3669-4d81-bff5-3d48d9aa13dd tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf28a6f-376f-4754-8623-79fc328a1787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-66a68d39-82e7-435c-9c58-6c23f4989254 tempest-VolumeDependencyTests-276100199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-66a68d39-82e7-435c-9c58-6c23f4989254 tempest-VolumeDependencyTests-276100199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-66a68d39-82e7-435c-9c58-6c23f4989254 tempest-VolumeDependencyTests-276100199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-66a68d39-82e7-435c-9c58-6c23f4989254 tempest-VolumeDependencyTests-276100199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-66a68d39-82e7-435c-9c58-6c23f4989254 tempest-VolumeDependencyTests-276100199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-66a68d39-82e7-435c-9c58-6c23f4989254 tempest-VolumeDependencyTests-276100199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:01 devstack sudo[108285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e_t54efemidevstack@QuobyteHD Sep 28 17:36:01 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b002cedd-3669-4d81-bff5-3d48d9aa13dd tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf28a6f-376f-4754-8623-79fc328a1787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1697057704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf40a3f-6e59-425f-b36a-e5a74657a31c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41af83b5b027437e89b26236a6526fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:36:02Z,use_quota=True,user_id='7f9cff10023b415f845cab0cad31dd8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:01 devstack sudo[108287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b002cedd-3669-4d81-bff5-3d48d9aa13dd tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d14a833f-ca21-4894-870b-0ae6fa828551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:01 devstack sudo[108287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b002cedd-3669-4d81-bff5-3d48d9aa13dd tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d14a833f-ca21-4894-870b-0ae6fa828551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b002cedd-3669-4d81-bff5-3d48d9aa13dd tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d525df5-d641-4494-975b-ad1123f36c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b002cedd-3669-4d81-bff5-3d48d9aa13dd tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d525df5-d641-4494-975b-ad1123f36c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cf40a3f-6e59-425f-b36a-e5a74657a31c', 'volume_name': 'volume-6cf40a3f-6e59-425f-b36a-e5a74657a31c', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b002cedd-3669-4d81-bff5-3d48d9aa13dd tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ffdf0d5-5d2d-4611-a4f5-e6ffab87efaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b002cedd-3669-4d81-bff5-3d48d9aa13dd tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ffdf0d5-5d2d-4611-a4f5-e6ffab87efaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b002cedd-3669-4d81-bff5-3d48d9aa13dd tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f16a5e-368b-49b9-b5e0-d89406783f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:01 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-b002cedd-3669-4d81-bff5-3d48d9aa13dd tempest-ProjectReaderTests-1993964986 None] Volume 6cf40a3f-6e59-425f-b36a-e5a74657a31c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cf40a3f-6e59-425f-b36a-e5a74657a31c', 'volume_size': 1} Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b002cedd-3669-4d81-bff5-3d48d9aa13dd tempest-ProjectReaderTests-1993964986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b002cedd-3669-4d81-bff5-3d48d9aa13dd tempest-ProjectReaderTests-1993964986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b002cedd-3669-4d81-bff5-3d48d9aa13dd tempest-ProjectReaderTests-1993964986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1697057704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf40a3f-6e59-425f-b36a-e5a74657a31c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41af83b5b027437e89b26236a6526fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:36:02Z,use_quota=True,user_id='7f9cff10023b415f845cab0cad31dd8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-b002cedd-3669-4d81-bff5-3d48d9aa13dd tempest-ProjectReaderTests-1993964986 None] Creating volume 6cf40a3f-6e59-425f-b36a-e5a74657a31c {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b002cedd-3669-4d81-bff5-3d48d9aa13dd tempest-ProjectReaderTests-1993964986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b002cedd-3669-4d81-bff5-3d48d9aa13dd tempest-ProjectReaderTests-1993964986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b002cedd-3669-4d81-bff5-3d48d9aa13dd tempest-ProjectReaderTests-1993964986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b002cedd-3669-4d81-bff5-3d48d9aa13dd tempest-ProjectReaderTests-1993964986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b002cedd-3669-4d81-bff5-3d48d9aa13dd tempest-ProjectReaderTests-1993964986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b002cedd-3669-4d81-bff5-3d48d9aa13dd tempest-ProjectReaderTests-1993964986 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:36:01 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-b002cedd-3669-4d81-bff5-3d48d9aa13dd tempest-ProjectReaderTests-1993964986 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b002cedd-3669-4d81-bff5-3d48d9aa13dd tempest-ProjectReaderTests-1993964986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6cf40a3f-6e59-425f-b36a-e5a74657a31c 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:01 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6cf40a3f-6e59-425f-b36a-e5a74657a31c 1073741824 Sep 28 17:36:01 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:01 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e_t54efemidevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e_t54efemidevstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:02 devstack sudo[108287]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-66a68d39-82e7-435c-9c58-6c23f4989254 tempest-VolumeDependencyTests-276100199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.349s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:02 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-66a68d39-82e7-435c-9c58-6c23f4989254 tempest-VolumeDependencyTests-276100199 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:36:02 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-66a68d39-82e7-435c-9c58-6c23f4989254 tempest-VolumeDependencyTests-276100199 None] Deleted volume successfully. Sep 28 17:36:02 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e_t54efemidevstack@QuobyteHD Sep 28 17:36:02 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:02 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-66a68d39-82e7-435c-9c58-6c23f4989254 tempest-VolumeDependencyTests-276100199 None] Lock "cinder-00810319-eb06-4d53-8c45-2aaf3d12fbf9-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:02 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b002cedd-3669-4d81-bff5-3d48d9aa13dd tempest-ProjectReaderTests-1993964986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6cf40a3f-6e59-425f-b36a-e5a74657a31c 1073741824" returned: 0 in 0.586s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:02 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e_t54efemidevstack@QuobyteHD" returned: 1 in 0.463s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e_t54efemidevstack@QuobyteHD' failed. Not Retrying. {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:36:02 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Temporary image c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e is fetched for user dabec5bb8e9249a59544a581675e5614. {{(pid=86917) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:36:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b002cedd-3669-4d81-bff5-3d48d9aa13dd tempest-ProjectReaderTests-1993964986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6cf40a3f-6e59-425f-b36a-e5a74657a31c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:02 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6cf40a3f-6e59-425f-b36a-e5a74657a31c Sep 28 17:36:02 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:02 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c7d7d0-593a-4189-b926-4db4a2b18010]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e_t54efemidevstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:02 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a1817a87-3db0-421a-9441-048852f02951 tempest-VolumeDependencyTests-276100199 None] Acquiring lock "cinder-1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:02 devstack sudo[108305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e_t54efemidevstack@QuobyteHD Sep 28 17:36:02 devstack sudo[108305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:02 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a1817a87-3db0-421a-9441-048852f02951 tempest-VolumeDependencyTests-276100199 None] Lock "cinder-1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:02 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a1817a87-3db0-421a-9441-048852f02951 tempest-VolumeDependencyTests-276100199 None] Acquiring lock "cinder-quobyte-1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:02 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a1817a87-3db0-421a-9441-048852f02951 tempest-VolumeDependencyTests-276100199 None] Lock "cinder-quobyte-1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c" acquired by "delete_volume" :: waited 0.018s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:02 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b002cedd-3669-4d81-bff5-3d48d9aa13dd tempest-ProjectReaderTests-1993964986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6cf40a3f-6e59-425f-b36a-e5a74657a31c" returned: 0 in 0.315s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:02 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b002cedd-3669-4d81-bff5-3d48d9aa13dd tempest-ProjectReaderTests-1993964986 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:36:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b002cedd-3669-4d81-bff5-3d48d9aa13dd tempest-ProjectReaderTests-1993964986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:02 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[f620a9ce-73d1-4813-af67-6fcd3c2dccf9]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a1817a87-3db0-421a-9441-048852f02951 tempest-VolumeDependencyTests-276100199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:02 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b002cedd-3669-4d81-bff5-3d48d9aa13dd tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f16a5e-368b-49b9-b5e0-d89406783f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cf40a3f-6e59-425f-b36a-e5a74657a31c', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:02 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b002cedd-3669-4d81-bff5-3d48d9aa13dd tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eb91fec-3651-4721-9949-23c45dd620d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:02 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-b002cedd-3669-4d81-bff5-3d48d9aa13dd tempest-ProjectReaderTests-1993964986 None] Volume volume-6cf40a3f-6e59-425f-b36a-e5a74657a31c (6cf40a3f-6e59-425f-b36a-e5a74657a31c): created successfully Sep 28 17:36:02 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b002cedd-3669-4d81-bff5-3d48d9aa13dd tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eb91fec-3651-4721-9949-23c45dd620d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:02 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b002cedd-3669-4d81-bff5-3d48d9aa13dd tempest-ProjectReaderTests-1993964986 None] Flow 'volume_create_manager' (9c65597e-9396-42b5-a7a5-431745ec2533) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:36:02 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-b002cedd-3669-4d81-bff5-3d48d9aa13dd tempest-ProjectReaderTests-1993964986 None] Created volume successfully. Sep 28 17:36:02 devstack sudo[108308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c Sep 28 17:36:02 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:02 devstack sudo[108305]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e_t54efemidevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e_t54efemidevstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:02 devstack sudo[108312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e_t54efemidevstack@QuobyteHD Sep 28 17:36:02 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:03 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a1817a87-3db0-421a-9441-048852f02951 tempest-VolumeDependencyTests-276100199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c" returned: 0 in 0.399s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a1817a87-3db0-421a-9441-048852f02951 tempest-VolumeDependencyTests-276100199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:03 devstack sudo[108317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c Sep 28 17:36:03 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:03 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e_t54efemidevstack@QuobyteHD" returned: 1 in 0.336s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e_t54efemidevstack@QuobyteHD' failed. Not Retrying. {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:36:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:03 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a8d88ab-5506-4daa-81af-1073421d9df2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce0ef04b03f4f4194af0ae59bdbb111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:36:01Z,use_quota=True,user_id='dabec5bb8e9249a59544a581675e5614',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:36:03 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Creating volume 8a8d88ab-5506-4daa-81af-1073421d9df2 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:36:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:03 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:36:03 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:36:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:03 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:36:03 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:36:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8a8d88ab-5506-4daa-81af-1073421d9df2 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:03 devstack sudo[108322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8a8d88ab-5506-4daa-81af-1073421d9df2 1073741824 Sep 28 17:36:03 devstack sudo[108322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:03 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a1817a87-3db0-421a-9441-048852f02951 tempest-VolumeDependencyTests-276100199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c" returned: 0 in 0.282s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:03 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a1817a87-3db0-421a-9441-048852f02951 tempest-VolumeDependencyTests-276100199 None] Lock "cinder-quobyte-1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c" released by "delete_volume" :: held 0.748s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:03 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-a1817a87-3db0-421a-9441-048852f02951 tempest-VolumeDependencyTests-276100199 None] Created reservations ['d338d9f0-329a-4b8b-8abd-8f4a04fe734d', '6662ccc7-4596-429b-9ec3-28c5d0874731', '438d27e4-9dbe-4c35-8970-3b07e3f009e1', '81dcfa7d-5352-443d-9a1d-0d8a88e62edc'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:36:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a1817a87-3db0-421a-9441-048852f02951 tempest-VolumeDependencyTests-276100199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a1817a87-3db0-421a-9441-048852f02951 tempest-VolumeDependencyTests-276100199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:03 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a1817a87-3db0-421a-9441-048852f02951 tempest-VolumeDependencyTests-276100199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:36:03 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a1817a87-3db0-421a-9441-048852f02951 tempest-VolumeDependencyTests-276100199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:36:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a1817a87-3db0-421a-9441-048852f02951 tempest-VolumeDependencyTests-276100199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a1817a87-3db0-421a-9441-048852f02951 tempest-VolumeDependencyTests-276100199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:03 devstack sudo[108328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:36:03 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:03 devstack sudo[108322]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:03 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b82d7c7e-6879-48d7-8865-60e2c526403b tempest-ProjectReaderTests-1993964986 None] Acquiring lock "cinder-6cf40a3f-6e59-425f-b36a-e5a74657a31c-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8a8d88ab-5506-4daa-81af-1073421d9df2 1073741824" returned: 0 in 0.634s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:03 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b82d7c7e-6879-48d7-8865-60e2c526403b tempest-ProjectReaderTests-1993964986 None] Lock "cinder-6cf40a3f-6e59-425f-b36a-e5a74657a31c-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8a8d88ab-5506-4daa-81af-1073421d9df2 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:03 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b82d7c7e-6879-48d7-8865-60e2c526403b tempest-ProjectReaderTests-1993964986 None] Acquiring lock "cinder-quobyte-6cf40a3f-6e59-425f-b36a-e5a74657a31c" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:03 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8a8d88ab-5506-4daa-81af-1073421d9df2 Sep 28 17:36:03 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:03 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b82d7c7e-6879-48d7-8865-60e2c526403b tempest-ProjectReaderTests-1993964986 None] Lock "cinder-quobyte-6cf40a3f-6e59-425f-b36a-e5a74657a31c" acquired by "delete_volume" :: waited 0.026s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:04 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a1817a87-3db0-421a-9441-048852f02951 tempest-VolumeDependencyTests-276100199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.395s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:04 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-a1817a87-3db0-421a-9441-048852f02951 tempest-VolumeDependencyTests-276100199 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:36:04 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-a1817a87-3db0-421a-9441-048852f02951 tempest-VolumeDependencyTests-276100199 None] Deleted volume successfully. Sep 28 17:36:04 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a6e8ad-fd96-4cdf-bfa2-58cc2f722fc6]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b82d7c7e-6879-48d7-8865-60e2c526403b tempest-ProjectReaderTests-1993964986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6cf40a3f-6e59-425f-b36a-e5a74657a31c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:04 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a1817a87-3db0-421a-9441-048852f02951 tempest-VolumeDependencyTests-276100199 None] Lock "cinder-1e07cc98-a5c4-475a-ae7b-2d2bc432ef1c-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:04 devstack sudo[108333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6cf40a3f-6e59-425f-b36a-e5a74657a31c Sep 28 17:36:04 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:04 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8a8d88ab-5506-4daa-81af-1073421d9df2" returned: 0 in 0.401s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:04 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:36:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:04 devstack cinder-volume[86917]: DEBUG cinder.volume.volume_utils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Attempting download of c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e ((None, [{'url': 'file:///opt/stack/data/glance/images/c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e', 'metadata': {}}])) to volume 8a8d88ab-5506-4daa-81af-1073421d9df2. {{(pid=86917) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:36:04 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[636d665e-b7c7-4300-9d14-672a2ef026b6]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e_r1i157zr {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:04 devstack sudo[108336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e_r1i157zr Sep 28 17:36:04 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:04 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b82d7c7e-6879-48d7-8865-60e2c526403b tempest-ProjectReaderTests-1993964986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6cf40a3f-6e59-425f-b36a-e5a74657a31c" returned: 0 in 0.542s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b82d7c7e-6879-48d7-8865-60e2c526403b tempest-ProjectReaderTests-1993964986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6cf40a3f-6e59-425f-b36a-e5a74657a31c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:04 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6cf40a3f-6e59-425f-b36a-e5a74657a31c Sep 28 17:36:04 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:04 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e_r1i157zr" returned: 0 in 0.446s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e_r1i157zr {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:05 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b82d7c7e-6879-48d7-8865-60e2c526403b tempest-ProjectReaderTests-1993964986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-6cf40a3f-6e59-425f-b36a-e5a74657a31c" returned: 0 in 0.411s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:05 devstack sudo[108347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e_r1i157zr Sep 28 17:36:05 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:05 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b82d7c7e-6879-48d7-8865-60e2c526403b tempest-ProjectReaderTests-1993964986 None] Lock "cinder-quobyte-6cf40a3f-6e59-425f-b36a-e5a74657a31c" released by "delete_volume" :: held 1.103s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:05 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-b82d7c7e-6879-48d7-8865-60e2c526403b tempest-ProjectReaderTests-1993964986 None] Created reservations ['b10b4c2f-a6a1-4814-87e9-1c21eb7502d5', '9fff3c94-1d48-4a21-807e-5e93e5721ba1', '24fdf90e-e81f-4ac9-935d-eb491b2736ba', 'fc783781-2983-47d4-99af-a4b7d15bcaa3'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:36:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b82d7c7e-6879-48d7-8865-60e2c526403b tempest-ProjectReaderTests-1993964986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b82d7c7e-6879-48d7-8865-60e2c526403b tempest-ProjectReaderTests-1993964986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b82d7c7e-6879-48d7-8865-60e2c526403b tempest-ProjectReaderTests-1993964986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:36:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b82d7c7e-6879-48d7-8865-60e2c526403b tempest-ProjectReaderTests-1993964986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:36:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b82d7c7e-6879-48d7-8865-60e2c526403b tempest-ProjectReaderTests-1993964986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b82d7c7e-6879-48d7-8865-60e2c526403b tempest-ProjectReaderTests-1993964986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:05 devstack sudo[108350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:36:05 devstack sudo[108350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:05 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e_r1i157zr" returned: 1 in 0.487s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e_r1i157zr' failed. Not Retrying. {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:36:05 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[509f7e95-4462-48fb-a70a-d45bf722b24b]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e_t54efemidevstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:05 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e_t54efemidevstack@QuobyteHD Sep 28 17:36:05 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:05 devstack sudo[108350]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b82d7c7e-6879-48d7-8865-60e2c526403b tempest-ProjectReaderTests-1993964986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.350s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:05 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-b82d7c7e-6879-48d7-8865-60e2c526403b tempest-ProjectReaderTests-1993964986 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:36:05 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-b82d7c7e-6879-48d7-8865-60e2c526403b tempest-ProjectReaderTests-1993964986 None] Deleted volume successfully. Sep 28 17:36:05 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b82d7c7e-6879-48d7-8865-60e2c526403b tempest-ProjectReaderTests-1993964986 None] Lock "cinder-6cf40a3f-6e59-425f-b36a-e5a74657a31c-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:05 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e_t54efemidevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e_t54efemidevstack@QuobyteHD {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:05 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e_t54efemidevstack@QuobyteHD Sep 28 17:36:05 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:06 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e_t54efemidevstack@QuobyteHD" returned: 1 in 0.412s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e_t54efemidevstack@QuobyteHD' failed. Not Retrying. {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:36:06 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e was raw, converting to qcow2 {{(pid=86917) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:36:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e_t54efemidevstack@QuobyteHD /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8a8d88ab-5506-4daa-81af-1073421d9df2 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:06 devstack sudo[108364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e_t54efemidevstack@QuobyteHD /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8a8d88ab-5506-4daa-81af-1073421d9df2 Sep 28 17:36:06 devstack sudo[108364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:06 devstack sudo[108364]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e_t54efemidevstack@QuobyteHD /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8a8d88ab-5506-4daa-81af-1073421d9df2" returned: 0 in 0.662s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:06 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e_t54efemidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8a8d88ab-5506-4daa-81af-1073421d9df2 {{(pid=86917) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:36:06 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 17:36:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8a8d88ab-5506-4daa-81af-1073421d9df2 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:06 devstack sudo[108370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8a8d88ab-5506-4daa-81af-1073421d9df2 1G Sep 28 17:36:06 devstack sudo[108370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:07 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-27ec00d2-02e4-4786-9e72-2f919f5425a9 tempest-ProjectReaderTests-1993964986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:36:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-27ec00d2-02e4-4786-9e72-2f919f5425a9 tempest-ProjectReaderTests-1993964986 None] Flow 'volume_create_manager' (ec1d22f5-ddf3-4f1b-9e90-fec6a675d050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:36:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-27ec00d2-02e4-4786-9e72-2f919f5425a9 tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e715170-9335-4604-8b34-3f7aedd13ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-27ec00d2-02e4-4786-9e72-2f919f5425a9 tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e715170-9335-4604-8b34-3f7aedd13ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-230488266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=419818e1-ad54-477b-9adc-196967f90d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41af83b5b027437e89b26236a6526fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:36:07Z,use_quota=True,user_id='7f9cff10023b415f845cab0cad31dd8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-27ec00d2-02e4-4786-9e72-2f919f5425a9 tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96021a58-8769-4296-8462-1b1ee2d7bb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-27ec00d2-02e4-4786-9e72-2f919f5425a9 tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96021a58-8769-4296-8462-1b1ee2d7bb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-27ec00d2-02e4-4786-9e72-2f919f5425a9 tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da3bbebb-ffb9-4b6a-9860-310fba925cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-27ec00d2-02e4-4786-9e72-2f919f5425a9 tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da3bbebb-ffb9-4b6a-9860-310fba925cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '419818e1-ad54-477b-9adc-196967f90d58', 'volume_name': 'volume-419818e1-ad54-477b-9adc-196967f90d58', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-27ec00d2-02e4-4786-9e72-2f919f5425a9 tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b9df464-66ef-44bd-a850-f90dc24171a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-27ec00d2-02e4-4786-9e72-2f919f5425a9 tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b9df464-66ef-44bd-a850-f90dc24171a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-27ec00d2-02e4-4786-9e72-2f919f5425a9 tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d034405f-72d9-4337-9a44-e312b23d2800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:07 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-27ec00d2-02e4-4786-9e72-2f919f5425a9 tempest-ProjectReaderTests-1993964986 None] Volume 419818e1-ad54-477b-9adc-196967f90d58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-419818e1-ad54-477b-9adc-196967f90d58', 'volume_size': 1} Sep 28 17:36:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-27ec00d2-02e4-4786-9e72-2f919f5425a9 tempest-ProjectReaderTests-1993964986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-27ec00d2-02e4-4786-9e72-2f919f5425a9 tempest-ProjectReaderTests-1993964986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:07 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-27ec00d2-02e4-4786-9e72-2f919f5425a9 tempest-ProjectReaderTests-1993964986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-230488266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=419818e1-ad54-477b-9adc-196967f90d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41af83b5b027437e89b26236a6526fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:36:07Z,use_quota=True,user_id='7f9cff10023b415f845cab0cad31dd8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:36:07 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-27ec00d2-02e4-4786-9e72-2f919f5425a9 tempest-ProjectReaderTests-1993964986 None] Creating volume 419818e1-ad54-477b-9adc-196967f90d58 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:36:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-27ec00d2-02e4-4786-9e72-2f919f5425a9 tempest-ProjectReaderTests-1993964986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-27ec00d2-02e4-4786-9e72-2f919f5425a9 tempest-ProjectReaderTests-1993964986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:07 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-27ec00d2-02e4-4786-9e72-2f919f5425a9 tempest-ProjectReaderTests-1993964986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:36:07 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-27ec00d2-02e4-4786-9e72-2f919f5425a9 tempest-ProjectReaderTests-1993964986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:36:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-27ec00d2-02e4-4786-9e72-2f919f5425a9 tempest-ProjectReaderTests-1993964986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:07 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-27ec00d2-02e4-4786-9e72-2f919f5425a9 tempest-ProjectReaderTests-1993964986 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:36:07 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-27ec00d2-02e4-4786-9e72-2f919f5425a9 tempest-ProjectReaderTests-1993964986 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:36:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-27ec00d2-02e4-4786-9e72-2f919f5425a9 tempest-ProjectReaderTests-1993964986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-419818e1-ad54-477b-9adc-196967f90d58 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:07 devstack sudo[108376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-419818e1-ad54-477b-9adc-196967f90d58 1073741824 Sep 28 17:36:07 devstack sudo[108376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:07 devstack sudo[108370]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8a8d88ab-5506-4daa-81af-1073421d9df2 1G" returned: 0 in 0.416s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:07 devstack cinder-volume[86917]: DEBUG cinder.volume.volume_utils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Downloaded image c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e ((None, [{'url': 'file:///opt/stack/data/glance/images/c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e', 'metadata': {}}])) to volume 8a8d88ab-5506-4daa-81af-1073421d9df2 successfully. {{(pid=86917) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:36:07 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Temporary image c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e for user dabec5bb8e9249a59544a581675e5614 is deleted. {{(pid=86917) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:36:07 devstack cinder-volume[86917]: DEBUG cinder.volume.volume_utils [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Marking volume 8a8d88ab-5506-4daa-81af-1073421d9df2 as bootable. {{(pid=86917) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:36:07 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Copying metadata from image c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e to 8a8d88ab-5506-4daa-81af-1073421d9df2. {{(pid=86917) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:36:07 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Creating volume glance metadata for volume 8a8d88ab-5506-4daa-81af-1073421d9df2 backed by image c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e with: {'image_id': 'c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '4cccc21c9cc83f8c6e4331d7e2705804', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86917) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:36:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a948495d-f2b9-4526-8662-029425d8a6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a8d88ab-5506-4daa-81af-1073421d9df2', 'volume_size': 1, 'image_id': 'c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4cccc21c9cc83f8c6e4331d7e2705804', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7ce0ef04b03f4f4194af0ae59bdbb111', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '95e72e9e919cd259c79eeeda046ea8ac00ddcd5aeae053feffc2da1a5c5771c4d833cac19b206ece2a7df80309ac1cc70a78435821242186027e9c34c449417b', 'id': 'c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e', 'created_at': datetime.datetime(2026, 9, 28, 15, 35, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 35, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c259b7e0-670e-4b70-9f79-dd1d4ccf9c7e/file', 'properties': {}}, 'image_service': }' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaa2a1e9-8eac-43de-9b82-ca628f7a8c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:07 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Volume volume-8a8d88ab-5506-4daa-81af-1073421d9df2 (8a8d88ab-5506-4daa-81af-1073421d9df2): created successfully Sep 28 17:36:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaa2a1e9-8eac-43de-9b82-ca628f7a8c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:07 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Flow 'volume_create_manager' (c8b4f45a-352f-4fe4-a379-c97743d5e48b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:36:07 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-c7234434-4aa1-43df-bf57-1369e7ead3cf tempest-VolumeImageDependencyTests-1268111847 None] Created volume successfully. Sep 28 17:36:07 devstack sudo[108376]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-27ec00d2-02e4-4786-9e72-2f919f5425a9 tempest-ProjectReaderTests-1993964986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-419818e1-ad54-477b-9adc-196967f90d58 1073741824" returned: 0 in 0.593s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-27ec00d2-02e4-4786-9e72-2f919f5425a9 tempest-ProjectReaderTests-1993964986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-419818e1-ad54-477b-9adc-196967f90d58 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:07 devstack sudo[108382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-419818e1-ad54-477b-9adc-196967f90d58 Sep 28 17:36:07 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:08 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-27ec00d2-02e4-4786-9e72-2f919f5425a9 tempest-ProjectReaderTests-1993964986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-419818e1-ad54-477b-9adc-196967f90d58" returned: 0 in 0.355s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:08 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-27ec00d2-02e4-4786-9e72-2f919f5425a9 tempest-ProjectReaderTests-1993964986 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:36:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-27ec00d2-02e4-4786-9e72-2f919f5425a9 tempest-ProjectReaderTests-1993964986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:08 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-27ec00d2-02e4-4786-9e72-2f919f5425a9 tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d034405f-72d9-4337-9a44-e312b23d2800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-419818e1-ad54-477b-9adc-196967f90d58', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:08 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-27ec00d2-02e4-4786-9e72-2f919f5425a9 tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d8beba2-af5f-4562-8ced-11ffcced03e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:08 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0d4a8f19-2d6f-4698-913c-b7e3648a5fbb tempest-VolumeImageDependencyTests-1268111847 None] Acquiring lock "cinder-8a8d88ab-5506-4daa-81af-1073421d9df2-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:08 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-27ec00d2-02e4-4786-9e72-2f919f5425a9 tempest-ProjectReaderTests-1993964986 None] Volume volume-419818e1-ad54-477b-9adc-196967f90d58 (419818e1-ad54-477b-9adc-196967f90d58): created successfully Sep 28 17:36:08 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-27ec00d2-02e4-4786-9e72-2f919f5425a9 tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d8beba2-af5f-4562-8ced-11ffcced03e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:08 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-27ec00d2-02e4-4786-9e72-2f919f5425a9 tempest-ProjectReaderTests-1993964986 None] Flow 'volume_create_manager' (ec1d22f5-ddf3-4f1b-9e90-fec6a675d050) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:36:08 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0d4a8f19-2d6f-4698-913c-b7e3648a5fbb tempest-VolumeImageDependencyTests-1268111847 None] Lock "cinder-8a8d88ab-5506-4daa-81af-1073421d9df2-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:08 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-27ec00d2-02e4-4786-9e72-2f919f5425a9 tempest-ProjectReaderTests-1993964986 None] Created volume successfully. Sep 28 17:36:08 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0d4a8f19-2d6f-4698-913c-b7e3648a5fbb tempest-VolumeImageDependencyTests-1268111847 None] Acquiring lock "cinder-quobyte-8a8d88ab-5506-4daa-81af-1073421d9df2" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:08 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0d4a8f19-2d6f-4698-913c-b7e3648a5fbb tempest-VolumeImageDependencyTests-1268111847 None] Lock "cinder-quobyte-8a8d88ab-5506-4daa-81af-1073421d9df2" acquired by "delete_volume" :: waited 0.021s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:08 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f00aa3-e357-4209-89bb-90520cdde235]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0d4a8f19-2d6f-4698-913c-b7e3648a5fbb tempest-VolumeImageDependencyTests-1268111847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8a8d88ab-5506-4daa-81af-1073421d9df2 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:08 devstack sudo[108385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8a8d88ab-5506-4daa-81af-1073421d9df2 Sep 28 17:36:08 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:08 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0d4a8f19-2d6f-4698-913c-b7e3648a5fbb tempest-VolumeImageDependencyTests-1268111847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8a8d88ab-5506-4daa-81af-1073421d9df2" returned: 0 in 0.525s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0d4a8f19-2d6f-4698-913c-b7e3648a5fbb tempest-VolumeImageDependencyTests-1268111847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8a8d88ab-5506-4daa-81af-1073421d9df2 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:08 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3da9f15-7564-46d2-b744-5ea0a37fb4fc tempest-ProjectMemberTests-1852265171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:36:08 devstack sudo[108391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8a8d88ab-5506-4daa-81af-1073421d9df2 Sep 28 17:36:08 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c3da9f15-7564-46d2-b744-5ea0a37fb4fc tempest-ProjectMemberTests-1852265171 None] Flow 'volume_create_manager' (68deae1f-4e80-43a2-b3ff-666e6b74d5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c3da9f15-7564-46d2-b744-5ea0a37fb4fc tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf140f13-bfe9-40b5-af26-44a5df66a6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c3da9f15-7564-46d2-b744-5ea0a37fb4fc tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf140f13-bfe9-40b5-af26-44a5df66a6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-441130150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8dc7c6f-5e21-4486-b231-756ad8185921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e19b5535dc4ca0a0b3b833ab1e8248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:36:09Z,use_quota=True,user_id='56b2bce1c2e2420fb799c45cd8c3987f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c3da9f15-7564-46d2-b744-5ea0a37fb4fc tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72face1c-3794-45e9-bffa-97b8cdc3ea38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c3da9f15-7564-46d2-b744-5ea0a37fb4fc tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72face1c-3794-45e9-bffa-97b8cdc3ea38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c3da9f15-7564-46d2-b744-5ea0a37fb4fc tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1460030e-e1e7-4812-ab62-4e230a1a9d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c3da9f15-7564-46d2-b744-5ea0a37fb4fc tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1460030e-e1e7-4812-ab62-4e230a1a9d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8dc7c6f-5e21-4486-b231-756ad8185921', 'volume_name': 'volume-e8dc7c6f-5e21-4486-b231-756ad8185921', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c3da9f15-7564-46d2-b744-5ea0a37fb4fc tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b1de017-7e1f-4e38-874a-c8f9fbef5c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c3da9f15-7564-46d2-b744-5ea0a37fb4fc tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b1de017-7e1f-4e38-874a-c8f9fbef5c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c3da9f15-7564-46d2-b744-5ea0a37fb4fc tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed74f36-b34b-4a18-8e5f-e8fc3f147eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:09 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-c3da9f15-7564-46d2-b744-5ea0a37fb4fc tempest-ProjectMemberTests-1852265171 None] Volume e8dc7c6f-5e21-4486-b231-756ad8185921: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8dc7c6f-5e21-4486-b231-756ad8185921', 'volume_size': 1} Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c3da9f15-7564-46d2-b744-5ea0a37fb4fc tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c3da9f15-7564-46d2-b744-5ea0a37fb4fc tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c3da9f15-7564-46d2-b744-5ea0a37fb4fc tempest-ProjectMemberTests-1852265171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-441130150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8dc7c6f-5e21-4486-b231-756ad8185921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e19b5535dc4ca0a0b3b833ab1e8248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:36:09Z,use_quota=True,user_id='56b2bce1c2e2420fb799c45cd8c3987f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-c3da9f15-7564-46d2-b744-5ea0a37fb4fc tempest-ProjectMemberTests-1852265171 None] Creating volume e8dc7c6f-5e21-4486-b231-756ad8185921 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c3da9f15-7564-46d2-b744-5ea0a37fb4fc tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c3da9f15-7564-46d2-b744-5ea0a37fb4fc tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c3da9f15-7564-46d2-b744-5ea0a37fb4fc tempest-ProjectMemberTests-1852265171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c3da9f15-7564-46d2-b744-5ea0a37fb4fc tempest-ProjectMemberTests-1852265171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c3da9f15-7564-46d2-b744-5ea0a37fb4fc tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c3da9f15-7564-46d2-b744-5ea0a37fb4fc tempest-ProjectMemberTests-1852265171 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:36:09 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-c3da9f15-7564-46d2-b744-5ea0a37fb4fc tempest-ProjectMemberTests-1852265171 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c3da9f15-7564-46d2-b744-5ea0a37fb4fc tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-3297b101-920c-4759-9427-e7f31ad291fe tempest-ProjectReaderTests-1993964986 None] Acquiring lock "cinder-419818e1-ad54-477b-9adc-196967f90d58-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:09 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921 1073741824 Sep 28 17:36:09 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-3297b101-920c-4759-9427-e7f31ad291fe tempest-ProjectReaderTests-1993964986 None] Lock "cinder-419818e1-ad54-477b-9adc-196967f90d58-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-3297b101-920c-4759-9427-e7f31ad291fe tempest-ProjectReaderTests-1993964986 None] Acquiring lock "cinder-quobyte-419818e1-ad54-477b-9adc-196967f90d58" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-3297b101-920c-4759-9427-e7f31ad291fe tempest-ProjectReaderTests-1993964986 None] Lock "cinder-quobyte-419818e1-ad54-477b-9adc-196967f90d58" acquired by "delete_volume" :: waited 0.034s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c7d2df-a552-429e-b356-91db43f2b29f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3297b101-920c-4759-9427-e7f31ad291fe tempest-ProjectReaderTests-1993964986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-419818e1-ad54-477b-9adc-196967f90d58 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:09 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0d4a8f19-2d6f-4698-913c-b7e3648a5fbb tempest-VolumeImageDependencyTests-1268111847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-8a8d88ab-5506-4daa-81af-1073421d9df2" returned: 0 in 0.415s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0d4a8f19-2d6f-4698-913c-b7e3648a5fbb tempest-VolumeImageDependencyTests-1268111847 None] Lock "cinder-quobyte-8a8d88ab-5506-4daa-81af-1073421d9df2" released by "delete_volume" :: held 0.997s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-0d4a8f19-2d6f-4698-913c-b7e3648a5fbb tempest-VolumeImageDependencyTests-1268111847 None] Created reservations ['fe59472f-3902-4d90-8059-b88c79c04f83', '4d76b798-1e40-46a9-8464-3c89abe473ff', 'd51afee7-598e-4fd1-929d-7857fd0e0cef', '2bd3c2d8-5fb1-4054-bec3-6f7ff29fdb1d'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:36:09 devstack sudo[108396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-419818e1-ad54-477b-9adc-196967f90d58 Sep 28 17:36:09 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0d4a8f19-2d6f-4698-913c-b7e3648a5fbb tempest-VolumeImageDependencyTests-1268111847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0d4a8f19-2d6f-4698-913c-b7e3648a5fbb tempest-VolumeImageDependencyTests-1268111847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0d4a8f19-2d6f-4698-913c-b7e3648a5fbb tempest-VolumeImageDependencyTests-1268111847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0d4a8f19-2d6f-4698-913c-b7e3648a5fbb tempest-VolumeImageDependencyTests-1268111847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0d4a8f19-2d6f-4698-913c-b7e3648a5fbb tempest-VolumeImageDependencyTests-1268111847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0d4a8f19-2d6f-4698-913c-b7e3648a5fbb tempest-VolumeImageDependencyTests-1268111847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:09 devstack sudo[108401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:36:09 devstack sudo[108401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:09 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c3da9f15-7564-46d2-b744-5ea0a37fb4fc tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921 1073741824" returned: 0 in 0.669s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:09 devstack sudo[108401]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:09 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0d4a8f19-2d6f-4698-913c-b7e3648a5fbb tempest-VolumeImageDependencyTests-1268111847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.342s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-0d4a8f19-2d6f-4698-913c-b7e3648a5fbb tempest-VolumeImageDependencyTests-1268111847 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3297b101-920c-4759-9427-e7f31ad291fe tempest-ProjectReaderTests-1993964986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-419818e1-ad54-477b-9adc-196967f90d58" returned: 0 in 0.597s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3297b101-920c-4759-9427-e7f31ad291fe tempest-ProjectReaderTests-1993964986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-419818e1-ad54-477b-9adc-196967f90d58 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:09 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-0d4a8f19-2d6f-4698-913c-b7e3648a5fbb tempest-VolumeImageDependencyTests-1268111847 None] Deleted volume successfully. Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c3da9f15-7564-46d2-b744-5ea0a37fb4fc tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:09 devstack sudo[108409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-419818e1-ad54-477b-9adc-196967f90d58 Sep 28 17:36:09 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:09 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0d4a8f19-2d6f-4698-913c-b7e3648a5fbb tempest-VolumeImageDependencyTests-1268111847 None] Lock "cinder-8a8d88ab-5506-4daa-81af-1073421d9df2-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:09 devstack sudo[108410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921 Sep 28 17:36:09 devstack sudo[108410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:10 devstack sudo[108410]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c3da9f15-7564-46d2-b744-5ea0a37fb4fc tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921" returned: 0 in 0.321s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:10 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c3da9f15-7564-46d2-b744-5ea0a37fb4fc tempest-ProjectMemberTests-1852265171 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:36:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c3da9f15-7564-46d2-b744-5ea0a37fb4fc tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:10 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c3da9f15-7564-46d2-b744-5ea0a37fb4fc tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed74f36-b34b-4a18-8e5f-e8fc3f147eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8dc7c6f-5e21-4486-b231-756ad8185921', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:10 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:10 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c3da9f15-7564-46d2-b744-5ea0a37fb4fc tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14f57c3d-1d21-4986-9af2-535a3f57f963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3297b101-920c-4759-9427-e7f31ad291fe tempest-ProjectReaderTests-1993964986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-419818e1-ad54-477b-9adc-196967f90d58" returned: 0 in 0.385s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:10 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-3297b101-920c-4759-9427-e7f31ad291fe tempest-ProjectReaderTests-1993964986 None] Lock "cinder-quobyte-419818e1-ad54-477b-9adc-196967f90d58" released by "delete_volume" :: held 1.040s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:10 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-c3da9f15-7564-46d2-b744-5ea0a37fb4fc tempest-ProjectMemberTests-1852265171 None] Volume volume-e8dc7c6f-5e21-4486-b231-756ad8185921 (e8dc7c6f-5e21-4486-b231-756ad8185921): created successfully Sep 28 17:36:10 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c3da9f15-7564-46d2-b744-5ea0a37fb4fc tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14f57c3d-1d21-4986-9af2-535a3f57f963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:10 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-c3da9f15-7564-46d2-b744-5ea0a37fb4fc tempest-ProjectMemberTests-1852265171 None] Flow 'volume_create_manager' (68deae1f-4e80-43a2-b3ff-666e6b74d5b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:36:10 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-c3da9f15-7564-46d2-b744-5ea0a37fb4fc tempest-ProjectMemberTests-1852265171 None] Created volume successfully. Sep 28 17:36:10 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-3297b101-920c-4759-9427-e7f31ad291fe tempest-ProjectReaderTests-1993964986 None] Created reservations ['9e2f1241-8ac0-42b9-88b3-7db03a1f00e4', 'd5c80713-1a3b-4dd6-b32c-3891a28849ca', '558ac01e-69be-4cb9-982e-f88621302ed7', 'bc1cc85d-76f3-4289-9110-a8d160e310e3'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:36:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3297b101-920c-4759-9427-e7f31ad291fe tempest-ProjectReaderTests-1993964986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3297b101-920c-4759-9427-e7f31ad291fe tempest-ProjectReaderTests-1993964986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:10 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-3297b101-920c-4759-9427-e7f31ad291fe tempest-ProjectReaderTests-1993964986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:36:10 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-3297b101-920c-4759-9427-e7f31ad291fe tempest-ProjectReaderTests-1993964986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:36:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-3297b101-920c-4759-9427-e7f31ad291fe tempest-ProjectReaderTests-1993964986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3297b101-920c-4759-9427-e7f31ad291fe tempest-ProjectReaderTests-1993964986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:10 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:36:10 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:10 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-3297b101-920c-4759-9427-e7f31ad291fe tempest-ProjectReaderTests-1993964986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.308s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:10 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-3297b101-920c-4759-9427-e7f31ad291fe tempest-ProjectReaderTests-1993964986 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:36:10 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-3297b101-920c-4759-9427-e7f31ad291fe tempest-ProjectReaderTests-1993964986 None] Deleted volume successfully. Sep 28 17:36:10 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-3297b101-920c-4759-9427-e7f31ad291fe tempest-ProjectReaderTests-1993964986 None] Lock "cinder-419818e1-ad54-477b-9adc-196967f90d58-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:11 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=187,cinder:UPDATE=288,cinder:DELETE=29,cinder:INSERT=77 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:36:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b3383c24-b409-43de-92d3-3d5806582c48 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b3383c24-b409-43de-92d3-3d5806582c48 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-b3383c24-b409-43de-92d3-3d5806582c48 tempest-ProjectMemberTests-1852265171 None] Creating offline snapshot 93c93172-3afb-47c5-a35f-bf413b626a95 of volume e8dc7c6f-5e21-4486-b231-756ad8185921 {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:36:11 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14e1607-5c6b-49c9-9494-4c62bbc99e43]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b3383c24-b409-43de-92d3-3d5806582c48 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:12 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921 Sep 28 17:36:12 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:12 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-83e3e115-ee0a-41a1-98b0-69acc32b741e tempest-ProjectReaderTests-1993964986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:36:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-83e3e115-ee0a-41a1-98b0-69acc32b741e tempest-ProjectReaderTests-1993964986 None] Flow 'volume_create_manager' (680fd69e-e745-493c-a920-2d628899bb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:36:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-83e3e115-ee0a-41a1-98b0-69acc32b741e tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d58f7b2d-dd88-49f6-a1ec-2cc4d8a5fb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:12 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:UPDATE=282,cinder:SELECT=219,cinder:INSERT=73,cinder:DELETE=22 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:36:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-83e3e115-ee0a-41a1-98b0-69acc32b741e tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d58f7b2d-dd88-49f6-a1ec-2cc4d8a5fb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1770355291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a727e225-9dbf-40e4-8c72-f91a3fd574c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41af83b5b027437e89b26236a6526fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:36:12Z,use_quota=True,user_id='7f9cff10023b415f845cab0cad31dd8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-83e3e115-ee0a-41a1-98b0-69acc32b741e tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dda705e-a7b3-4bff-9411-e0a97a65570d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-83e3e115-ee0a-41a1-98b0-69acc32b741e tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dda705e-a7b3-4bff-9411-e0a97a65570d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-83e3e115-ee0a-41a1-98b0-69acc32b741e tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f79408f5-05ba-46ce-80a7-f8cbde5494ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-83e3e115-ee0a-41a1-98b0-69acc32b741e tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f79408f5-05ba-46ce-80a7-f8cbde5494ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a727e225-9dbf-40e4-8c72-f91a3fd574c4', 'volume_name': 'volume-a727e225-9dbf-40e4-8c72-f91a3fd574c4', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-83e3e115-ee0a-41a1-98b0-69acc32b741e tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e80718b-8a88-41b2-9507-3322441055dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-83e3e115-ee0a-41a1-98b0-69acc32b741e tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e80718b-8a88-41b2-9507-3322441055dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:12 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-83e3e115-ee0a-41a1-98b0-69acc32b741e tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b009c84a-0c93-4247-a371-b43afdfba0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:12 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-83e3e115-ee0a-41a1-98b0-69acc32b741e tempest-ProjectReaderTests-1993964986 None] Volume a727e225-9dbf-40e4-8c72-f91a3fd574c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a727e225-9dbf-40e4-8c72-f91a3fd574c4', 'volume_size': 1} Sep 28 17:36:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-83e3e115-ee0a-41a1-98b0-69acc32b741e tempest-ProjectReaderTests-1993964986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:12 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b3383c24-b409-43de-92d3-3d5806582c48 tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921" returned: 0 in 0.505s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b3383c24-b409-43de-92d3-3d5806582c48 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921.93c93172-3afb-47c5-a35f-bf413b626a95 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:12 devstack sudo[108424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921.93c93172-3afb-47c5-a35f-bf413b626a95 1G Sep 28 17:36:12 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:12 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b3383c24-b409-43de-92d3-3d5806582c48 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921.93c93172-3afb-47c5-a35f-bf413b626a95 1G" returned: 0 in 0.569s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b3383c24-b409-43de-92d3-3d5806582c48 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8dc7c6f-5e21-4486-b231-756ad8185921 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921.93c93172-3afb-47c5-a35f-bf413b626a95 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:12 devstack sudo[108430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8dc7c6f-5e21-4486-b231-756ad8185921 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921.93c93172-3afb-47c5-a35f-bf413b626a95 Sep 28 17:36:12 devstack sudo[108430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:13 devstack sudo[108430]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b3383c24-b409-43de-92d3-3d5806582c48 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8dc7c6f-5e21-4486-b231-756ad8185921 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921.93c93172-3afb-47c5-a35f-bf413b626a95" returned: 0 in 0.412s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:13 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-b3383c24-b409-43de-92d3-3d5806582c48 tempest-ProjectMemberTests-1852265171 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921.93c93172-3afb-47c5-a35f-bf413b626a95 is being set with open permissions: ugo+rw Sep 28 17:36:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b3383c24-b409-43de-92d3-3d5806582c48 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921.93c93172-3afb-47c5-a35f-bf413b626a95 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:13 devstack sudo[108436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921.93c93172-3afb-47c5-a35f-bf413b626a95 Sep 28 17:36:13 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:13 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b3383c24-b409-43de-92d3-3d5806582c48 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921.93c93172-3afb-47c5-a35f-bf413b626a95" returned: 0 in 0.312s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b3383c24-b409-43de-92d3-3d5806582c48 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:13 devstack sudo[108439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921.info Sep 28 17:36:13 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:14 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b3383c24-b409-43de-92d3-3d5806582c48 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921.info" returned: 0 in 0.307s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:14 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-b3383c24-b409-43de-92d3-3d5806582c48 tempest-ProjectMemberTests-1852265171 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921.info is being set with open permissions: ugo+rw Sep 28 17:36:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b3383c24-b409-43de-92d3-3d5806582c48 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:14 devstack sudo[108442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921.info Sep 28 17:36:14 devstack sudo[108442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:14 devstack sudo[108442]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b3383c24-b409-43de-92d3-3d5806582c48 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921.info" returned: 0 in 0.330s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b3383c24-b409-43de-92d3-3d5806582c48 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.596s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-83e3e115-ee0a-41a1-98b0-69acc32b741e tempest-ProjectReaderTests-1993964986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.115s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:14 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-83e3e115-ee0a-41a1-98b0-69acc32b741e tempest-ProjectReaderTests-1993964986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1770355291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a727e225-9dbf-40e4-8c72-f91a3fd574c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41af83b5b027437e89b26236a6526fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:36:12Z,use_quota=True,user_id='7f9cff10023b415f845cab0cad31dd8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:36:14 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-83e3e115-ee0a-41a1-98b0-69acc32b741e tempest-ProjectReaderTests-1993964986 None] Creating volume a727e225-9dbf-40e4-8c72-f91a3fd574c4 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:36:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-83e3e115-ee0a-41a1-98b0-69acc32b741e tempest-ProjectReaderTests-1993964986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-83e3e115-ee0a-41a1-98b0-69acc32b741e tempest-ProjectReaderTests-1993964986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:14 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-83e3e115-ee0a-41a1-98b0-69acc32b741e tempest-ProjectReaderTests-1993964986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:36:14 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-83e3e115-ee0a-41a1-98b0-69acc32b741e tempest-ProjectReaderTests-1993964986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:36:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-83e3e115-ee0a-41a1-98b0-69acc32b741e tempest-ProjectReaderTests-1993964986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:14 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-83e3e115-ee0a-41a1-98b0-69acc32b741e tempest-ProjectReaderTests-1993964986 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:36:14 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-83e3e115-ee0a-41a1-98b0-69acc32b741e tempest-ProjectReaderTests-1993964986 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:36:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-83e3e115-ee0a-41a1-98b0-69acc32b741e tempest-ProjectReaderTests-1993964986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a727e225-9dbf-40e4-8c72-f91a3fd574c4 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:14 devstack sudo[108445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a727e225-9dbf-40e4-8c72-f91a3fd574c4 1073741824 Sep 28 17:36:14 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:14 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-b3383c24-b409-43de-92d3-3d5806582c48 tempest-ProjectMemberTests-1852265171 None] Create snapshot completed successfully Sep 28 17:36:14 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5cb9f6eb-5e58-4358-806d-aa6a18c4ae7c tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-93c93172-3afb-47c5-a35f-bf413b626a95-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:14 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5cb9f6eb-5e58-4358-806d-aa6a18c4ae7c tempest-ProjectMemberTests-1852265171 None] Lock "cinder-93c93172-3afb-47c5-a35f-bf413b626a95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:14 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5cb9f6eb-5e58-4358-806d-aa6a18c4ae7c tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-quobyte-e8dc7c6f-5e21-4486-b231-756ad8185921" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5cb9f6eb-5e58-4358-806d-aa6a18c4ae7c tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-e8dc7c6f-5e21-4486-b231-756ad8185921" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5cb9f6eb-5e58-4358-806d-aa6a18c4ae7c tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-quobyte-93c93172-3afb-47c5-a35f-bf413b626a95" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5cb9f6eb-5e58-4358-806d-aa6a18c4ae7c tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-93c93172-3afb-47c5-a35f-bf413b626a95" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-5cb9f6eb-5e58-4358-806d-aa6a18c4ae7c tempest-ProjectMemberTests-1852265171 None] Deleting offline snapshot 93c93172-3afb-47c5-a35f-bf413b626a95 of volume e8dc7c6f-5e21-4486-b231-756ad8185921 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-5cb9f6eb-5e58-4358-806d-aa6a18c4ae7c tempest-ProjectMemberTests-1852265171 None] snapshot_file for this snap is: volume-e8dc7c6f-5e21-4486-b231-756ad8185921.93c93172-3afb-47c5-a35f-bf413b626a95 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3250377-54c1-4b6a-a601-37324cf661bf]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5cb9f6eb-5e58-4358-806d-aa6a18c4ae7c tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921.93c93172-3afb-47c5-a35f-bf413b626a95 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:15 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-83e3e115-ee0a-41a1-98b0-69acc32b741e tempest-ProjectReaderTests-1993964986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a727e225-9dbf-40e4-8c72-f91a3fd574c4 1073741824" returned: 0 in 0.708s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-83e3e115-ee0a-41a1-98b0-69acc32b741e tempest-ProjectReaderTests-1993964986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a727e225-9dbf-40e4-8c72-f91a3fd574c4 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:15 devstack sudo[108452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a727e225-9dbf-40e4-8c72-f91a3fd574c4 Sep 28 17:36:15 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:15 devstack sudo[108451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921.93c93172-3afb-47c5-a35f-bf413b626a95 Sep 28 17:36:15 devstack sudo[108451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:15 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-83e3e115-ee0a-41a1-98b0-69acc32b741e tempest-ProjectReaderTests-1993964986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a727e225-9dbf-40e4-8c72-f91a3fd574c4" returned: 0 in 0.406s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-83e3e115-ee0a-41a1-98b0-69acc32b741e tempest-ProjectReaderTests-1993964986 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-83e3e115-ee0a-41a1-98b0-69acc32b741e tempest-ProjectReaderTests-1993964986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-9413e547-d5f9-4035-b777-b023c9ab7a46 tempest-CinderUnicodeTest-2101642268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9413e547-d5f9-4035-b777-b023c9ab7a46 tempest-CinderUnicodeTest-2101642268 None] Flow 'volume_create_manager' (6c358f3f-eda3-4b15-8dc4-97df9ca222a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9413e547-d5f9-4035-b777-b023c9ab7a46 tempest-CinderUnicodeTest-2101642268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f128904-c0e0-47da-8217-ae72551a7cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:15 devstack sudo[108451]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-83e3e115-ee0a-41a1-98b0-69acc32b741e tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b009c84a-0c93-4247-a371-b43afdfba0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a727e225-9dbf-40e4-8c72-f91a3fd574c4', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-83e3e115-ee0a-41a1-98b0-69acc32b741e tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b72587-f398-4a42-a4d4-19b275961b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9413e547-d5f9-4035-b777-b023c9ab7a46 tempest-CinderUnicodeTest-2101642268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f128904-c0e0-47da-8217-ae72551a7cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95df38a5-38b6-482a-be55-9982e530de58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f97ed20d78e44e4abc29bf38b8809e01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:36:16Z,use_quota=True,user_id='b1730cd47e554cd997e412c018465146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9413e547-d5f9-4035-b777-b023c9ab7a46 tempest-CinderUnicodeTest-2101642268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5faa2092-eeda-4169-b918-d83f713098cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9413e547-d5f9-4035-b777-b023c9ab7a46 tempest-CinderUnicodeTest-2101642268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5faa2092-eeda-4169-b918-d83f713098cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9413e547-d5f9-4035-b777-b023c9ab7a46 tempest-CinderUnicodeTest-2101642268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09efbcb8-3591-405b-8f74-019004ad02f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9413e547-d5f9-4035-b777-b023c9ab7a46 tempest-CinderUnicodeTest-2101642268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09efbcb8-3591-405b-8f74-019004ad02f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95df38a5-38b6-482a-be55-9982e530de58', 'volume_name': 'volume-95df38a5-38b6-482a-be55-9982e530de58', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9413e547-d5f9-4035-b777-b023c9ab7a46 tempest-CinderUnicodeTest-2101642268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ec5d24-516f-40c7-a005-08e1a6c0911d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9413e547-d5f9-4035-b777-b023c9ab7a46 tempest-CinderUnicodeTest-2101642268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ec5d24-516f-40c7-a005-08e1a6c0911d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9413e547-d5f9-4035-b777-b023c9ab7a46 tempest-CinderUnicodeTest-2101642268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58485733-8213-44f0-8356-060d97986ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:15 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-9413e547-d5f9-4035-b777-b023c9ab7a46 tempest-CinderUnicodeTest-2101642268 None] Volume 95df38a5-38b6-482a-be55-9982e530de58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95df38a5-38b6-482a-be55-9982e530de58', 'volume_size': 1} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9413e547-d5f9-4035-b777-b023c9ab7a46 tempest-CinderUnicodeTest-2101642268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9413e547-d5f9-4035-b777-b023c9ab7a46 tempest-CinderUnicodeTest-2101642268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-9413e547-d5f9-4035-b777-b023c9ab7a46 tempest-CinderUnicodeTest-2101642268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95df38a5-38b6-482a-be55-9982e530de58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f97ed20d78e44e4abc29bf38b8809e01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:36:16Z,use_quota=True,user_id='b1730cd47e554cd997e412c018465146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-9413e547-d5f9-4035-b777-b023c9ab7a46 tempest-CinderUnicodeTest-2101642268 None] Creating volume 95df38a5-38b6-482a-be55-9982e530de58 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9413e547-d5f9-4035-b777-b023c9ab7a46 tempest-CinderUnicodeTest-2101642268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9413e547-d5f9-4035-b777-b023c9ab7a46 tempest-CinderUnicodeTest-2101642268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-9413e547-d5f9-4035-b777-b023c9ab7a46 tempest-CinderUnicodeTest-2101642268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-9413e547-d5f9-4035-b777-b023c9ab7a46 tempest-CinderUnicodeTest-2101642268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9413e547-d5f9-4035-b777-b023c9ab7a46 tempest-CinderUnicodeTest-2101642268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-9413e547-d5f9-4035-b777-b023c9ab7a46 tempest-CinderUnicodeTest-2101642268 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:36:15 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-9413e547-d5f9-4035-b777-b023c9ab7a46 tempest-CinderUnicodeTest-2101642268 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9413e547-d5f9-4035-b777-b023c9ab7a46 tempest-CinderUnicodeTest-2101642268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-95df38a5-38b6-482a-be55-9982e530de58 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5cb9f6eb-5e58-4358-806d-aa6a18c4ae7c tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921.93c93172-3afb-47c5-a35f-bf413b626a95" returned: 0 in 0.668s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-5cb9f6eb-5e58-4358-806d-aa6a18c4ae7c tempest-ProjectMemberTests-1852265171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8dc7c6f-5e21-4486-b231-756ad8185921(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:36:15 devstack sudo[108460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-95df38a5-38b6-482a-be55-9982e530de58 1073741824 Sep 28 17:36:15 devstack sudo[108460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:15 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-83e3e115-ee0a-41a1-98b0-69acc32b741e tempest-ProjectReaderTests-1993964986 None] Volume volume-a727e225-9dbf-40e4-8c72-f91a3fd574c4 (a727e225-9dbf-40e4-8c72-f91a3fd574c4): created successfully Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-83e3e115-ee0a-41a1-98b0-69acc32b741e tempest-ProjectReaderTests-1993964986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08b72587-f398-4a42-a4d4-19b275961b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-83e3e115-ee0a-41a1-98b0-69acc32b741e tempest-ProjectReaderTests-1993964986 None] Flow 'volume_create_manager' (680fd69e-e745-493c-a920-2d628899bb09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[16115e88-ff3c-40ae-bd9a-78300e22d62c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5cb9f6eb-5e58-4358-806d-aa6a18c4ae7c tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:15 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-83e3e115-ee0a-41a1-98b0-69acc32b741e tempest-ProjectReaderTests-1993964986 None] Created volume successfully. Sep 28 17:36:15 devstack sudo[108462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921 Sep 28 17:36:15 devstack sudo[108462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:16 devstack sudo[108462]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:16 devstack sudo[108460]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5cb9f6eb-5e58-4358-806d-aa6a18c4ae7c tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921" returned: 0 in 0.503s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5cb9f6eb-5e58-4358-806d-aa6a18c4ae7c tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921.93c93172-3afb-47c5-a35f-bf413b626a95 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9413e547-d5f9-4035-b777-b023c9ab7a46 tempest-CinderUnicodeTest-2101642268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-95df38a5-38b6-482a-be55-9982e530de58 1073741824" returned: 0 in 0.584s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:16 devstack sudo[108471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921.93c93172-3afb-47c5-a35f-bf413b626a95 Sep 28 17:36:16 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9413e547-d5f9-4035-b777-b023c9ab7a46 tempest-CinderUnicodeTest-2101642268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-95df38a5-38b6-482a-be55-9982e530de58 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:16 devstack sudo[108473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-95df38a5-38b6-482a-be55-9982e530de58 Sep 28 17:36:16 devstack sudo[108473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:16 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-094f3539-976a-48fe-90d9-2480871aa1a3 tempest-ProjectReaderTests-1993964986 None] Acquiring lock "cinder-a727e225-9dbf-40e4-8c72-f91a3fd574c4-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:16 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-094f3539-976a-48fe-90d9-2480871aa1a3 tempest-ProjectReaderTests-1993964986 None] Lock "cinder-a727e225-9dbf-40e4-8c72-f91a3fd574c4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:16 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-094f3539-976a-48fe-90d9-2480871aa1a3 tempest-ProjectReaderTests-1993964986 None] Acquiring lock "cinder-quobyte-a727e225-9dbf-40e4-8c72-f91a3fd574c4" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:16 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-094f3539-976a-48fe-90d9-2480871aa1a3 tempest-ProjectReaderTests-1993964986 None] Lock "cinder-quobyte-a727e225-9dbf-40e4-8c72-f91a3fd574c4" acquired by "delete_volume" :: waited 0.019s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:16 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd86daf-98b5-462e-a831-3a11874374a5]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-094f3539-976a-48fe-90d9-2480871aa1a3 tempest-ProjectReaderTests-1993964986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a727e225-9dbf-40e4-8c72-f91a3fd574c4 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:16 devstack sudo[108475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a727e225-9dbf-40e4-8c72-f91a3fd574c4 Sep 28 17:36:16 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:16 devstack sudo[108473]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9413e547-d5f9-4035-b777-b023c9ab7a46 tempest-CinderUnicodeTest-2101642268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-95df38a5-38b6-482a-be55-9982e530de58" returned: 0 in 0.417s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:16 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-9413e547-d5f9-4035-b777-b023c9ab7a46 tempest-CinderUnicodeTest-2101642268 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:36:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9413e547-d5f9-4035-b777-b023c9ab7a46 tempest-CinderUnicodeTest-2101642268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9413e547-d5f9-4035-b777-b023c9ab7a46 tempest-CinderUnicodeTest-2101642268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58485733-8213-44f0-8356-060d97986ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95df38a5-38b6-482a-be55-9982e530de58', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9413e547-d5f9-4035-b777-b023c9ab7a46 tempest-CinderUnicodeTest-2101642268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b986201-b15c-4878-81a2-6bb3d723f4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:16 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-9413e547-d5f9-4035-b777-b023c9ab7a46 tempest-CinderUnicodeTest-2101642268 None] Volume volume-95df38a5-38b6-482a-be55-9982e530de58 (95df38a5-38b6-482a-be55-9982e530de58): created successfully Sep 28 17:36:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9413e547-d5f9-4035-b777-b023c9ab7a46 tempest-CinderUnicodeTest-2101642268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b986201-b15c-4878-81a2-6bb3d723f4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:16 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-9413e547-d5f9-4035-b777-b023c9ab7a46 tempest-CinderUnicodeTest-2101642268 None] Flow 'volume_create_manager' (6c358f3f-eda3-4b15-8dc4-97df9ca222a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:36:16 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-9413e547-d5f9-4035-b777-b023c9ab7a46 tempest-CinderUnicodeTest-2101642268 None] Created volume successfully. Sep 28 17:36:16 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5cb9f6eb-5e58-4358-806d-aa6a18c4ae7c tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921.93c93172-3afb-47c5-a35f-bf413b626a95" returned: 0 in 0.582s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5cb9f6eb-5e58-4358-806d-aa6a18c4ae7c tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921.93c93172-3afb-47c5-a35f-bf413b626a95 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:16 devstack sudo[108483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921.93c93172-3afb-47c5-a35f-bf413b626a95 Sep 28 17:36:16 devstack sudo[108483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:17 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-094f3539-976a-48fe-90d9-2480871aa1a3 tempest-ProjectReaderTests-1993964986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a727e225-9dbf-40e4-8c72-f91a3fd574c4" returned: 0 in 0.497s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-094f3539-976a-48fe-90d9-2480871aa1a3 tempest-ProjectReaderTests-1993964986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a727e225-9dbf-40e4-8c72-f91a3fd574c4 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:17 devstack sudo[108489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a727e225-9dbf-40e4-8c72-f91a3fd574c4 Sep 28 17:36:17 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:17 devstack sudo[108483]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5cb9f6eb-5e58-4358-806d-aa6a18c4ae7c tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921.93c93172-3afb-47c5-a35f-bf413b626a95" returned: 0 in 0.301s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:17 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5cb9f6eb-5e58-4358-806d-aa6a18c4ae7c tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-93c93172-3afb-47c5-a35f-bf413b626a95" released by "_delete_snapshot" :: held 2.226s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:17 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5cb9f6eb-5e58-4358-806d-aa6a18c4ae7c tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-e8dc7c6f-5e21-4486-b231-756ad8185921" released by "delete_snapshot" :: held 2.260s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:17 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-5cb9f6eb-5e58-4358-806d-aa6a18c4ae7c tempest-ProjectMemberTests-1852265171 None] Created reservations ['12ec0052-6d81-4eeb-8735-787872ed79e6', '9add3950-30c5-4467-9548-32096732da58', '869d0849-4262-4b06-ad98-e4b201c38e29', '5953b25e-649e-43da-b49d-eb1d6d6fff1b'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:36:17 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-5cb9f6eb-5e58-4358-806d-aa6a18c4ae7c tempest-ProjectMemberTests-1852265171 None] Delete snapshot completed successfully. Sep 28 17:36:17 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5cb9f6eb-5e58-4358-806d-aa6a18c4ae7c tempest-ProjectMemberTests-1852265171 None] Lock "cinder-93c93172-3afb-47c5-a35f-bf413b626a95-delete_snapshot" released by "delete_snapshot" :: held 2.446s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:17 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-094f3539-976a-48fe-90d9-2480871aa1a3 tempest-ProjectReaderTests-1993964986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-a727e225-9dbf-40e4-8c72-f91a3fd574c4" returned: 0 in 0.304s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:17 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-094f3539-976a-48fe-90d9-2480871aa1a3 tempest-ProjectReaderTests-1993964986 None] Lock "cinder-quobyte-a727e225-9dbf-40e4-8c72-f91a3fd574c4" released by "delete_volume" :: held 0.858s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:17 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-094f3539-976a-48fe-90d9-2480871aa1a3 tempest-ProjectReaderTests-1993964986 None] Created reservations ['358642e2-1144-4978-8250-abb9c26d8694', '24aad1b9-71e0-4eaf-9bd9-a1c7af9aee74', '97aa01ba-c9eb-4ca8-ae55-2254d2c38e3c', 'be3414e5-6e15-426a-9572-7b1b7f2c42c3'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:36:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-094f3539-976a-48fe-90d9-2480871aa1a3 tempest-ProjectReaderTests-1993964986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-094f3539-976a-48fe-90d9-2480871aa1a3 tempest-ProjectReaderTests-1993964986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:17 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-094f3539-976a-48fe-90d9-2480871aa1a3 tempest-ProjectReaderTests-1993964986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:36:17 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-094f3539-976a-48fe-90d9-2480871aa1a3 tempest-ProjectReaderTests-1993964986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:36:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-094f3539-976a-48fe-90d9-2480871aa1a3 tempest-ProjectReaderTests-1993964986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-094f3539-976a-48fe-90d9-2480871aa1a3 tempest-ProjectReaderTests-1993964986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:17 devstack sudo[108492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:36:17 devstack sudo[108492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:17 devstack sudo[108492]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-094f3539-976a-48fe-90d9-2480871aa1a3 tempest-ProjectReaderTests-1993964986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.306s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:17 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-094f3539-976a-48fe-90d9-2480871aa1a3 tempest-ProjectReaderTests-1993964986 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:36:17 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-094f3539-976a-48fe-90d9-2480871aa1a3 tempest-ProjectReaderTests-1993964986 None] Deleted volume successfully. Sep 28 17:36:17 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-094f3539-976a-48fe-90d9-2480871aa1a3 tempest-ProjectReaderTests-1993964986 None] Lock "cinder-a727e225-9dbf-40e4-8c72-f91a3fd574c4-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:18 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a3b7d06f-8a6c-469b-ab17-b65dc1edfbf3 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-e8dc7c6f-5e21-4486-b231-756ad8185921-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:18 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a3b7d06f-8a6c-469b-ab17-b65dc1edfbf3 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-e8dc7c6f-5e21-4486-b231-756ad8185921-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:18 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a3b7d06f-8a6c-469b-ab17-b65dc1edfbf3 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-quobyte-e8dc7c6f-5e21-4486-b231-756ad8185921" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:18 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a3b7d06f-8a6c-469b-ab17-b65dc1edfbf3 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-e8dc7c6f-5e21-4486-b231-756ad8185921" acquired by "delete_volume" :: waited 0.042s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:18 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c4f46f-7036-4e0c-8f8f-135adfef01b5]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a3b7d06f-8a6c-469b-ab17-b65dc1edfbf3 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:18 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-b23b214a-5a7c-4dad-951d-f09561e465cf tempest-CinderUnicodeTest-2101642268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:36:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b23b214a-5a7c-4dad-951d-f09561e465cf tempest-CinderUnicodeTest-2101642268 None] Flow 'volume_create_manager' (6b684a74-0ca3-483a-a9a3-9faaa997bf4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:36:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b23b214a-5a7c-4dad-951d-f09561e465cf tempest-CinderUnicodeTest-2101642268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63dcaa2a-def1-415e-9ad1-ce0046b00913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b23b214a-5a7c-4dad-951d-f09561e465cf tempest-CinderUnicodeTest-2101642268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63dcaa2a-def1-415e-9ad1-ce0046b00913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:36:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-632789019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4041a2ae-0ce2-4636-a1f7-46708907fb5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f97ed20d78e44e4abc29bf38b8809e01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:36:18Z,use_quota=True,user_id='b1730cd47e554cd997e412c018465146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b23b214a-5a7c-4dad-951d-f09561e465cf tempest-CinderUnicodeTest-2101642268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f85e9e3-b100-4612-a5e6-1380c9d460a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b23b214a-5a7c-4dad-951d-f09561e465cf tempest-CinderUnicodeTest-2101642268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f85e9e3-b100-4612-a5e6-1380c9d460a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b23b214a-5a7c-4dad-951d-f09561e465cf tempest-CinderUnicodeTest-2101642268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fea708c-96f2-4d31-9ef1-a8865d1f8f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b23b214a-5a7c-4dad-951d-f09561e465cf tempest-CinderUnicodeTest-2101642268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fea708c-96f2-4d31-9ef1-a8865d1f8f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4041a2ae-0ce2-4636-a1f7-46708907fb5a', 'volume_name': 'volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b23b214a-5a7c-4dad-951d-f09561e465cf tempest-CinderUnicodeTest-2101642268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d198cbf5-8bd3-4b79-b9d5-f850812a893d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b23b214a-5a7c-4dad-951d-f09561e465cf tempest-CinderUnicodeTest-2101642268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d198cbf5-8bd3-4b79-b9d5-f850812a893d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:18 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b23b214a-5a7c-4dad-951d-f09561e465cf tempest-CinderUnicodeTest-2101642268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fcea41c-b87a-4f0b-8705-9b687812e6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:18 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-b23b214a-5a7c-4dad-951d-f09561e465cf tempest-CinderUnicodeTest-2101642268 None] Volume 4041a2ae-0ce2-4636-a1f7-46708907fb5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a', 'volume_size': 1} Sep 28 17:36:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b23b214a-5a7c-4dad-951d-f09561e465cf tempest-CinderUnicodeTest-2101642268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b23b214a-5a7c-4dad-951d-f09561e465cf tempest-CinderUnicodeTest-2101642268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:18 devstack sudo[108495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921 Sep 28 17:36:18 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b23b214a-5a7c-4dad-951d-f09561e465cf tempest-CinderUnicodeTest-2101642268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:36:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-632789019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4041a2ae-0ce2-4636-a1f7-46708907fb5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f97ed20d78e44e4abc29bf38b8809e01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:36:18Z,use_quota=True,user_id='b1730cd47e554cd997e412c018465146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:36:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-b23b214a-5a7c-4dad-951d-f09561e465cf tempest-CinderUnicodeTest-2101642268 None] Creating volume 4041a2ae-0ce2-4636-a1f7-46708907fb5a {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:36:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b23b214a-5a7c-4dad-951d-f09561e465cf tempest-CinderUnicodeTest-2101642268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b23b214a-5a7c-4dad-951d-f09561e465cf tempest-CinderUnicodeTest-2101642268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b23b214a-5a7c-4dad-951d-f09561e465cf tempest-CinderUnicodeTest-2101642268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:36:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b23b214a-5a7c-4dad-951d-f09561e465cf tempest-CinderUnicodeTest-2101642268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:36:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b23b214a-5a7c-4dad-951d-f09561e465cf tempest-CinderUnicodeTest-2101642268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b23b214a-5a7c-4dad-951d-f09561e465cf tempest-CinderUnicodeTest-2101642268 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:36:18 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-b23b214a-5a7c-4dad-951d-f09561e465cf tempest-CinderUnicodeTest-2101642268 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:36:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b23b214a-5a7c-4dad-951d-f09561e465cf tempest-CinderUnicodeTest-2101642268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:18 devstack sudo[108497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a 1073741824 Sep 28 17:36:18 devstack sudo[108497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:18 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a3b7d06f-8a6c-469b-ab17-b65dc1edfbf3 tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921" returned: 0 in 0.510s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a3b7d06f-8a6c-469b-ab17-b65dc1edfbf3 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:18 devstack sudo[108505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921 Sep 28 17:36:18 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:19 devstack sudo[108497]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b23b214a-5a7c-4dad-951d-f09561e465cf tempest-CinderUnicodeTest-2101642268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a 1073741824" returned: 0 in 0.658s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b23b214a-5a7c-4dad-951d-f09561e465cf tempest-CinderUnicodeTest-2101642268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:19 devstack sudo[108515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a Sep 28 17:36:19 devstack sudo[108515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:19 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a3b7d06f-8a6c-469b-ab17-b65dc1edfbf3 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e8dc7c6f-5e21-4486-b231-756ad8185921" returned: 0 in 0.426s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:19 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a3b7d06f-8a6c-469b-ab17-b65dc1edfbf3 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-e8dc7c6f-5e21-4486-b231-756ad8185921" released by "delete_volume" :: held 1.044s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:19 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-a3b7d06f-8a6c-469b-ab17-b65dc1edfbf3 tempest-ProjectMemberTests-1852265171 None] Created reservations ['bbd1c7ab-be9d-46d0-ba02-82f6261b7eb6', '2eb0fe91-9f8e-4a71-8663-9e751d2b3d28', '1eb8f9dd-0bdd-4353-8b3e-c65d74ca32d8', '7342b027-135b-4582-8bcd-2557b884bfb4'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:36:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a3b7d06f-8a6c-469b-ab17-b65dc1edfbf3 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a3b7d06f-8a6c-469b-ab17-b65dc1edfbf3 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a3b7d06f-8a6c-469b-ab17-b65dc1edfbf3 tempest-ProjectMemberTests-1852265171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:36:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a3b7d06f-8a6c-469b-ab17-b65dc1edfbf3 tempest-ProjectMemberTests-1852265171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:36:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a3b7d06f-8a6c-469b-ab17-b65dc1edfbf3 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a3b7d06f-8a6c-469b-ab17-b65dc1edfbf3 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:19 devstack sudo[108517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:36:19 devstack sudo[108517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:19 devstack sudo[108515]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b23b214a-5a7c-4dad-951d-f09561e465cf tempest-CinderUnicodeTest-2101642268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a" returned: 0 in 0.438s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b23b214a-5a7c-4dad-951d-f09561e465cf tempest-CinderUnicodeTest-2101642268 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:36:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b23b214a-5a7c-4dad-951d-f09561e465cf tempest-CinderUnicodeTest-2101642268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b23b214a-5a7c-4dad-951d-f09561e465cf tempest-CinderUnicodeTest-2101642268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fcea41c-b87a-4f0b-8705-9b687812e6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b23b214a-5a7c-4dad-951d-f09561e465cf tempest-CinderUnicodeTest-2101642268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd9f30e8-8a99-4af1-ac23-2a648cedc43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:19 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-b23b214a-5a7c-4dad-951d-f09561e465cf tempest-CinderUnicodeTest-2101642268 None] Volume volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a (4041a2ae-0ce2-4636-a1f7-46708907fb5a): created successfully Sep 28 17:36:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b23b214a-5a7c-4dad-951d-f09561e465cf tempest-CinderUnicodeTest-2101642268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd9f30e8-8a99-4af1-ac23-2a648cedc43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:19 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-b23b214a-5a7c-4dad-951d-f09561e465cf tempest-CinderUnicodeTest-2101642268 None] Flow 'volume_create_manager' (6b684a74-0ca3-483a-a9a3-9faaa997bf4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:36:19 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-b23b214a-5a7c-4dad-951d-f09561e465cf tempest-CinderUnicodeTest-2101642268 None] Created volume successfully. Sep 28 17:36:20 devstack sudo[108517]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a3b7d06f-8a6c-469b-ab17-b65dc1edfbf3 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.364s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:20 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-a3b7d06f-8a6c-469b-ab17-b65dc1edfbf3 tempest-ProjectMemberTests-1852265171 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:36:20 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-a3b7d06f-8a6c-469b-ab17-b65dc1edfbf3 tempest-ProjectMemberTests-1852265171 None] Deleted volume successfully. Sep 28 17:36:20 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a3b7d06f-8a6c-469b-ab17-b65dc1edfbf3 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-e8dc7c6f-5e21-4486-b231-756ad8185921-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-19b91df6-baec-4591-9dc0-e32254d983bc tempest-CinderUnicodeTest-2101642268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-19b91df6-baec-4591-9dc0-e32254d983bc tempest-CinderUnicodeTest-2101642268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:20 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-19b91df6-baec-4591-9dc0-e32254d983bc tempest-CinderUnicodeTest-2101642268 None] Creating offline snapshot c4156e4f-9a0f-4565-b0ee-13bd855aa32b of volume 4041a2ae-0ce2-4636-a1f7-46708907fb5a {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:36:20 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[714ab057-c540-440b-b0be-0e6d4ec3f9b5]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-19b91df6-baec-4591-9dc0-e32254d983bc tempest-CinderUnicodeTest-2101642268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:21 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a Sep 28 17:36:21 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:21 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-08ff7904-de6f-4e7c-af21-b273ef2dd112 tempest-ProjectMemberTests-1852265171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:36:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-08ff7904-de6f-4e7c-af21-b273ef2dd112 tempest-ProjectMemberTests-1852265171 None] Flow 'volume_create_manager' (54f9869f-618e-4844-95a6-7e6af7f47299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:36:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-08ff7904-de6f-4e7c-af21-b273ef2dd112 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d0a1e98-d553-4925-b7df-4e348fb5b3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-08ff7904-de6f-4e7c-af21-b273ef2dd112 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d0a1e98-d553-4925-b7df-4e348fb5b3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1094414456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e19b5535dc4ca0a0b3b833ab1e8248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:36:21Z,use_quota=True,user_id='56b2bce1c2e2420fb799c45cd8c3987f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-08ff7904-de6f-4e7c-af21-b273ef2dd112 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6053dc-5351-4f3c-bcd5-a8bc487d9007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-08ff7904-de6f-4e7c-af21-b273ef2dd112 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6053dc-5351-4f3c-bcd5-a8bc487d9007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-08ff7904-de6f-4e7c-af21-b273ef2dd112 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a1b5acf-f159-4da9-a5cc-372d806672a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-08ff7904-de6f-4e7c-af21-b273ef2dd112 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a1b5acf-f159-4da9-a5cc-372d806672a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3a240c7-92bf-4ab2-89f1-f93a2d4ead9d', 'volume_name': 'volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-08ff7904-de6f-4e7c-af21-b273ef2dd112 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c5a70e9-c5b6-4e25-8df9-45eba233b483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-08ff7904-de6f-4e7c-af21-b273ef2dd112 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c5a70e9-c5b6-4e25-8df9-45eba233b483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:21 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-08ff7904-de6f-4e7c-af21-b273ef2dd112 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810daf21-3b53-44ef-bff4-c0440c992a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:21 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-08ff7904-de6f-4e7c-af21-b273ef2dd112 tempest-ProjectMemberTests-1852265171 None] Volume d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d', 'volume_size': 1} Sep 28 17:36:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-08ff7904-de6f-4e7c-af21-b273ef2dd112 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:21 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-19b91df6-baec-4591-9dc0-e32254d983bc tempest-CinderUnicodeTest-2101642268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a" returned: 0 in 0.547s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-19b91df6-baec-4591-9dc0-e32254d983bc tempest-CinderUnicodeTest-2101642268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a.c4156e4f-9a0f-4565-b0ee-13bd855aa32b 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:21 devstack sudo[108527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a.c4156e4f-9a0f-4565-b0ee-13bd855aa32b 1G Sep 28 17:36:21 devstack sudo[108527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:21 devstack sudo[108527]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-19b91df6-baec-4591-9dc0-e32254d983bc tempest-CinderUnicodeTest-2101642268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a.c4156e4f-9a0f-4565-b0ee-13bd855aa32b 1G" returned: 0 in 0.473s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-19b91df6-baec-4591-9dc0-e32254d983bc tempest-CinderUnicodeTest-2101642268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a.c4156e4f-9a0f-4565-b0ee-13bd855aa32b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:21 devstack sudo[108532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a.c4156e4f-9a0f-4565-b0ee-13bd855aa32b Sep 28 17:36:21 devstack sudo[108532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:22 devstack sudo[108532]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-19b91df6-baec-4591-9dc0-e32254d983bc tempest-CinderUnicodeTest-2101642268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a.c4156e4f-9a0f-4565-b0ee-13bd855aa32b" returned: 0 in 0.330s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:22 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-19b91df6-baec-4591-9dc0-e32254d983bc tempest-CinderUnicodeTest-2101642268 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a.c4156e4f-9a0f-4565-b0ee-13bd855aa32b is being set with open permissions: ugo+rw Sep 28 17:36:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-19b91df6-baec-4591-9dc0-e32254d983bc tempest-CinderUnicodeTest-2101642268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a.c4156e4f-9a0f-4565-b0ee-13bd855aa32b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:22 devstack sudo[108537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a.c4156e4f-9a0f-4565-b0ee-13bd855aa32b Sep 28 17:36:22 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:22 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-19b91df6-baec-4591-9dc0-e32254d983bc tempest-CinderUnicodeTest-2101642268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a.c4156e4f-9a0f-4565-b0ee-13bd855aa32b" returned: 0 in 0.265s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-19b91df6-baec-4591-9dc0-e32254d983bc tempest-CinderUnicodeTest-2101642268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:22 devstack sudo[108540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a.info Sep 28 17:36:22 devstack sudo[108540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:22 devstack sudo[108540]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-19b91df6-baec-4591-9dc0-e32254d983bc tempest-CinderUnicodeTest-2101642268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a.info" returned: 0 in 0.287s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:22 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-19b91df6-baec-4591-9dc0-e32254d983bc tempest-CinderUnicodeTest-2101642268 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a.info is being set with open permissions: ugo+rw Sep 28 17:36:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-19b91df6-baec-4591-9dc0-e32254d983bc tempest-CinderUnicodeTest-2101642268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:22 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a.info Sep 28 17:36:22 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:23 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-19b91df6-baec-4591-9dc0-e32254d983bc tempest-CinderUnicodeTest-2101642268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a.info" returned: 0 in 0.268s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-19b91df6-baec-4591-9dc0-e32254d983bc tempest-CinderUnicodeTest-2101642268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.320s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-08ff7904-de6f-4e7c-af21-b273ef2dd112 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.755s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:23 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-08ff7904-de6f-4e7c-af21-b273ef2dd112 tempest-ProjectMemberTests-1852265171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1094414456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e19b5535dc4ca0a0b3b833ab1e8248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:36:21Z,use_quota=True,user_id='56b2bce1c2e2420fb799c45cd8c3987f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:36:23 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-08ff7904-de6f-4e7c-af21-b273ef2dd112 tempest-ProjectMemberTests-1852265171 None] Creating volume d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:36:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-08ff7904-de6f-4e7c-af21-b273ef2dd112 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-08ff7904-de6f-4e7c-af21-b273ef2dd112 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:23 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-08ff7904-de6f-4e7c-af21-b273ef2dd112 tempest-ProjectMemberTests-1852265171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:36:23 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-08ff7904-de6f-4e7c-af21-b273ef2dd112 tempest-ProjectMemberTests-1852265171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:36:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-08ff7904-de6f-4e7c-af21-b273ef2dd112 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:23 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-08ff7904-de6f-4e7c-af21-b273ef2dd112 tempest-ProjectMemberTests-1852265171 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:36:23 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-08ff7904-de6f-4e7c-af21-b273ef2dd112 tempest-ProjectMemberTests-1852265171 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:36:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-08ff7904-de6f-4e7c-af21-b273ef2dd112 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:23 devstack sudo[108546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d 1073741824 Sep 28 17:36:23 devstack sudo[108546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:23 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-19b91df6-baec-4591-9dc0-e32254d983bc tempest-CinderUnicodeTest-2101642268 None] Create snapshot completed successfully Sep 28 17:36:23 devstack sudo[108546]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-08ff7904-de6f-4e7c-af21-b273ef2dd112 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d 1073741824" returned: 0 in 0.483s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-08ff7904-de6f-4e7c-af21-b273ef2dd112 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:23 devstack sudo[108552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d Sep 28 17:36:23 devstack sudo[108552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:24 devstack sudo[108552]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-08ff7904-de6f-4e7c-af21-b273ef2dd112 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d" returned: 0 in 0.292s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-08ff7904-de6f-4e7c-af21-b273ef2dd112 tempest-ProjectMemberTests-1852265171 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:36:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-08ff7904-de6f-4e7c-af21-b273ef2dd112 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8862fec5-42c5-4c65-9690-82a8de2426b5 tempest-CinderUnicodeTest-2101642268 None] Acquiring lock "cinder-c4156e4f-9a0f-4565-b0ee-13bd855aa32b-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-08ff7904-de6f-4e7c-af21-b273ef2dd112 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810daf21-3b53-44ef-bff4-c0440c992a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-08ff7904-de6f-4e7c-af21-b273ef2dd112 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6fcd354-e23d-4ed1-aec5-0f2f8440348f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8862fec5-42c5-4c65-9690-82a8de2426b5 tempest-CinderUnicodeTest-2101642268 None] Lock "cinder-c4156e4f-9a0f-4565-b0ee-13bd855aa32b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8862fec5-42c5-4c65-9690-82a8de2426b5 tempest-CinderUnicodeTest-2101642268 None] Acquiring lock "cinder-quobyte-4041a2ae-0ce2-4636-a1f7-46708907fb5a" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:24 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-08ff7904-de6f-4e7c-af21-b273ef2dd112 tempest-ProjectMemberTests-1852265171 None] Volume volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d (d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d): created successfully Sep 28 17:36:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-08ff7904-de6f-4e7c-af21-b273ef2dd112 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6fcd354-e23d-4ed1-aec5-0f2f8440348f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:24 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-08ff7904-de6f-4e7c-af21-b273ef2dd112 tempest-ProjectMemberTests-1852265171 None] Flow 'volume_create_manager' (54f9869f-618e-4844-95a6-7e6af7f47299) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:36:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8862fec5-42c5-4c65-9690-82a8de2426b5 tempest-CinderUnicodeTest-2101642268 None] Lock "cinder-quobyte-4041a2ae-0ce2-4636-a1f7-46708907fb5a" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8862fec5-42c5-4c65-9690-82a8de2426b5 tempest-CinderUnicodeTest-2101642268 None] Acquiring lock "cinder-quobyte-c4156e4f-9a0f-4565-b0ee-13bd855aa32b" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:24 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-08ff7904-de6f-4e7c-af21-b273ef2dd112 tempest-ProjectMemberTests-1852265171 None] Created volume successfully. Sep 28 17:36:24 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8862fec5-42c5-4c65-9690-82a8de2426b5 tempest-CinderUnicodeTest-2101642268 None] Lock "cinder-quobyte-c4156e4f-9a0f-4565-b0ee-13bd855aa32b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-8862fec5-42c5-4c65-9690-82a8de2426b5 tempest-CinderUnicodeTest-2101642268 None] Deleting offline snapshot c4156e4f-9a0f-4565-b0ee-13bd855aa32b of volume 4041a2ae-0ce2-4636-a1f7-46708907fb5a {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:36:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-8862fec5-42c5-4c65-9690-82a8de2426b5 tempest-CinderUnicodeTest-2101642268 None] snapshot_file for this snap is: volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a.c4156e4f-9a0f-4565-b0ee-13bd855aa32b {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:36:24 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[217f80b3-86bd-4df8-8b5a-f344353f6143]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8862fec5-42c5-4c65-9690-82a8de2426b5 tempest-CinderUnicodeTest-2101642268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a.c4156e4f-9a0f-4565-b0ee-13bd855aa32b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:24 devstack sudo[108555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a.c4156e4f-9a0f-4565-b0ee-13bd855aa32b Sep 28 17:36:24 devstack sudo[108555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-98eeae25-46d2-470c-b196-3feca4b4b097 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-98eeae25-46d2-470c-b196-3feca4b4b097 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-98eeae25-46d2-470c-b196-3feca4b4b097 tempest-ProjectMemberTests-1852265171 None] Creating offline snapshot f9cf8700-35d2-4b3b-8e12-4b0ae48230c6 of volume d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:36:24 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[32dfbe17-114e-4051-b111-fd5113345262]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-98eeae25-46d2-470c-b196-3feca4b4b097 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:24 devstack sudo[108555]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8862fec5-42c5-4c65-9690-82a8de2426b5 tempest-CinderUnicodeTest-2101642268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a.c4156e4f-9a0f-4565-b0ee-13bd855aa32b" returned: 0 in 0.493s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:24 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-8862fec5-42c5-4c65-9690-82a8de2426b5 tempest-CinderUnicodeTest-2101642268 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:36:24 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d90da5d-310f-4fa5-a7a2-93f18ec59046]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8862fec5-42c5-4c65-9690-82a8de2426b5 tempest-CinderUnicodeTest-2101642268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:24 devstack sudo[108561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d Sep 28 17:36:24 devstack sudo[108561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:24 devstack sudo[108562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a Sep 28 17:36:24 devstack sudo[108562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:25 devstack sudo[108561]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-98eeae25-46d2-470c-b196-3feca4b4b097 tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d" returned: 0 in 0.440s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-98eeae25-46d2-470c-b196-3feca4b4b097 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d.f9cf8700-35d2-4b3b-8e12-4b0ae48230c6 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:25 devstack sudo[108568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d.f9cf8700-35d2-4b3b-8e12-4b0ae48230c6 1G Sep 28 17:36:25 devstack sudo[108568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:25 devstack sudo[108562]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8862fec5-42c5-4c65-9690-82a8de2426b5 tempest-CinderUnicodeTest-2101642268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a" returned: 0 in 0.457s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8862fec5-42c5-4c65-9690-82a8de2426b5 tempest-CinderUnicodeTest-2101642268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a.c4156e4f-9a0f-4565-b0ee-13bd855aa32b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:25 devstack sudo[108573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a.c4156e4f-9a0f-4565-b0ee-13bd855aa32b Sep 28 17:36:25 devstack sudo[108573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:25 devstack sudo[108568]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-98eeae25-46d2-470c-b196-3feca4b4b097 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d.f9cf8700-35d2-4b3b-8e12-4b0ae48230c6 1G" returned: 0 in 0.501s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-98eeae25-46d2-470c-b196-3feca4b4b097 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d.f9cf8700-35d2-4b3b-8e12-4b0ae48230c6 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:25 devstack sudo[108583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d.f9cf8700-35d2-4b3b-8e12-4b0ae48230c6 Sep 28 17:36:25 devstack sudo[108583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:25 devstack sudo[108573]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8862fec5-42c5-4c65-9690-82a8de2426b5 tempest-CinderUnicodeTest-2101642268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a.c4156e4f-9a0f-4565-b0ee-13bd855aa32b" returned: 0 in 0.434s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8862fec5-42c5-4c65-9690-82a8de2426b5 tempest-CinderUnicodeTest-2101642268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a.c4156e4f-9a0f-4565-b0ee-13bd855aa32b {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:25 devstack sudo[108585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a.c4156e4f-9a0f-4565-b0ee-13bd855aa32b Sep 28 17:36:25 devstack sudo[108585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:25 devstack sudo[108585]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8862fec5-42c5-4c65-9690-82a8de2426b5 tempest-CinderUnicodeTest-2101642268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a.c4156e4f-9a0f-4565-b0ee-13bd855aa32b" returned: 0 in 0.315s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:26 devstack sudo[108583]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:26 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8862fec5-42c5-4c65-9690-82a8de2426b5 tempest-CinderUnicodeTest-2101642268 None] Lock "cinder-quobyte-c4156e4f-9a0f-4565-b0ee-13bd855aa32b" released by "_delete_snapshot" :: held 1.879s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-98eeae25-46d2-470c-b196-3feca4b4b097 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d.f9cf8700-35d2-4b3b-8e12-4b0ae48230c6" returned: 0 in 0.453s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:26 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-98eeae25-46d2-470c-b196-3feca4b4b097 tempest-ProjectMemberTests-1852265171 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d.f9cf8700-35d2-4b3b-8e12-4b0ae48230c6 is being set with open permissions: ugo+rw Sep 28 17:36:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-98eeae25-46d2-470c-b196-3feca4b4b097 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d.f9cf8700-35d2-4b3b-8e12-4b0ae48230c6 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:26 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8862fec5-42c5-4c65-9690-82a8de2426b5 tempest-CinderUnicodeTest-2101642268 None] Lock "cinder-quobyte-4041a2ae-0ce2-4636-a1f7-46708907fb5a" released by "delete_snapshot" :: held 1.930s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:26 devstack sudo[108592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d.f9cf8700-35d2-4b3b-8e12-4b0ae48230c6 Sep 28 17:36:26 devstack sudo[108592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:26 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-8862fec5-42c5-4c65-9690-82a8de2426b5 tempest-CinderUnicodeTest-2101642268 None] Created reservations ['b648c48d-1a4c-4620-97cf-4c2fe1e58900', '9f76e79d-242c-40ed-8a73-c018a816f890', 'dec0872d-aca3-4b45-8773-abb9de7bd2af', 'f5eb6207-e619-4679-8d94-d1f020fc0ff7'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:36:26 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-8862fec5-42c5-4c65-9690-82a8de2426b5 tempest-CinderUnicodeTest-2101642268 None] Delete snapshot completed successfully. Sep 28 17:36:26 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8862fec5-42c5-4c65-9690-82a8de2426b5 tempest-CinderUnicodeTest-2101642268 None] Lock "cinder-c4156e4f-9a0f-4565-b0ee-13bd855aa32b-delete_snapshot" released by "delete_snapshot" :: held 2.225s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:26 devstack sudo[108592]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-98eeae25-46d2-470c-b196-3feca4b4b097 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d.f9cf8700-35d2-4b3b-8e12-4b0ae48230c6" returned: 0 in 0.330s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-98eeae25-46d2-470c-b196-3feca4b4b097 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:26 devstack sudo[108595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d.info Sep 28 17:36:26 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:26 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-98eeae25-46d2-470c-b196-3feca4b4b097 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d.info" returned: 0 in 0.323s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:26 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-98eeae25-46d2-470c-b196-3feca4b4b097 tempest-ProjectMemberTests-1852265171 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d.info is being set with open permissions: ugo+rw Sep 28 17:36:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-98eeae25-46d2-470c-b196-3feca4b4b097 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:26 devstack sudo[108598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d.info Sep 28 17:36:26 devstack sudo[108598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:27 devstack sudo[108598]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-98eeae25-46d2-470c-b196-3feca4b4b097 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d.info" returned: 0 in 0.295s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-98eeae25-46d2-470c-b196-3feca4b4b097 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.451s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:27 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-98eeae25-46d2-470c-b196-3feca4b4b097 tempest-ProjectMemberTests-1852265171 None] Create snapshot completed successfully Sep 28 17:36:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ec5ed0ed-2f98-42e6-90f4-6216a2237fd9 tempest-CinderUnicodeTest-2101642268 None] Acquiring lock "cinder-4041a2ae-0ce2-4636-a1f7-46708907fb5a-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ec5ed0ed-2f98-42e6-90f4-6216a2237fd9 tempest-CinderUnicodeTest-2101642268 None] Lock "cinder-4041a2ae-0ce2-4636-a1f7-46708907fb5a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ec5ed0ed-2f98-42e6-90f4-6216a2237fd9 tempest-CinderUnicodeTest-2101642268 None] Acquiring lock "cinder-quobyte-4041a2ae-0ce2-4636-a1f7-46708907fb5a" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ec5ed0ed-2f98-42e6-90f4-6216a2237fd9 tempest-CinderUnicodeTest-2101642268 None] Lock "cinder-quobyte-4041a2ae-0ce2-4636-a1f7-46708907fb5a" acquired by "delete_volume" :: waited 0.015s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:27 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6124c10f-988b-4880-942e-a33720d3ff83]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ec5ed0ed-2f98-42e6-90f4-6216a2237fd9 tempest-CinderUnicodeTest-2101642268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:27 devstack sudo[108601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a Sep 28 17:36:27 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a554e87d-a879-4d34-a65e-b6982831ba41 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-f9cf8700-35d2-4b3b-8e12-4b0ae48230c6-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a554e87d-a879-4d34-a65e-b6982831ba41 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-f9cf8700-35d2-4b3b-8e12-4b0ae48230c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a554e87d-a879-4d34-a65e-b6982831ba41 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-quobyte-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a554e87d-a879-4d34-a65e-b6982831ba41 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a554e87d-a879-4d34-a65e-b6982831ba41 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-quobyte-f9cf8700-35d2-4b3b-8e12-4b0ae48230c6" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a554e87d-a879-4d34-a65e-b6982831ba41 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-f9cf8700-35d2-4b3b-8e12-4b0ae48230c6" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:27 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-a554e87d-a879-4d34-a65e-b6982831ba41 tempest-ProjectMemberTests-1852265171 None] Deleting offline snapshot f9cf8700-35d2-4b3b-8e12-4b0ae48230c6 of volume d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:36:27 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-a554e87d-a879-4d34-a65e-b6982831ba41 tempest-ProjectMemberTests-1852265171 None] snapshot_file for this snap is: volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d.f9cf8700-35d2-4b3b-8e12-4b0ae48230c6 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:36:27 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:27 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d74897-361e-4c03-8c9d-97a9aee832ba]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a554e87d-a879-4d34-a65e-b6982831ba41 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d.f9cf8700-35d2-4b3b-8e12-4b0ae48230c6 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ec5ed0ed-2f98-42e6-90f4-6216a2237fd9 tempest-CinderUnicodeTest-2101642268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a" returned: 0 in 0.491s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ec5ed0ed-2f98-42e6-90f4-6216a2237fd9 tempest-CinderUnicodeTest-2101642268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:27 devstack sudo[108608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a Sep 28 17:36:27 devstack sudo[108608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:28 devstack sudo[108607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d.f9cf8700-35d2-4b3b-8e12-4b0ae48230c6 Sep 28 17:36:28 devstack sudo[108607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:28 devstack sudo[108608]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ec5ed0ed-2f98-42e6-90f4-6216a2237fd9 tempest-CinderUnicodeTest-2101642268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4041a2ae-0ce2-4636-a1f7-46708907fb5a" returned: 0 in 0.305s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:28 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ec5ed0ed-2f98-42e6-90f4-6216a2237fd9 tempest-CinderUnicodeTest-2101642268 None] Lock "cinder-quobyte-4041a2ae-0ce2-4636-a1f7-46708907fb5a" released by "delete_volume" :: held 0.876s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:28 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-ec5ed0ed-2f98-42e6-90f4-6216a2237fd9 tempest-CinderUnicodeTest-2101642268 None] Created reservations ['4cccf79f-9552-4072-84c0-168bd88ceeaa', 'cca9b343-0f77-461d-9225-36c91eb25faf', '4ce6874c-e10d-4c6a-908a-20b20772872b', 'a6f0be2a-e01a-43d1-924d-68e2cf601a91'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:36:28 devstack sudo[108607]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a554e87d-a879-4d34-a65e-b6982831ba41 tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d.f9cf8700-35d2-4b3b-8e12-4b0ae48230c6" returned: 0 in 0.437s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:28 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-a554e87d-a879-4d34-a65e-b6982831ba41 tempest-ProjectMemberTests-1852265171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:36:28 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccf985a-19e9-4e40-806d-35ea8212df21]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a554e87d-a879-4d34-a65e-b6982831ba41 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ec5ed0ed-2f98-42e6-90f4-6216a2237fd9 tempest-CinderUnicodeTest-2101642268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ec5ed0ed-2f98-42e6-90f4-6216a2237fd9 tempest-CinderUnicodeTest-2101642268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:28 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ec5ed0ed-2f98-42e6-90f4-6216a2237fd9 tempest-CinderUnicodeTest-2101642268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:36:28 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ec5ed0ed-2f98-42e6-90f4-6216a2237fd9 tempest-CinderUnicodeTest-2101642268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:36:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ec5ed0ed-2f98-42e6-90f4-6216a2237fd9 tempest-CinderUnicodeTest-2101642268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ec5ed0ed-2f98-42e6-90f4-6216a2237fd9 tempest-CinderUnicodeTest-2101642268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:28 devstack sudo[108616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:36:28 devstack sudo[108616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:28 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-07fde91e-3963-47ef-a8fa-a156fbbf7f4f tempest-CinderUnicodeTest-2101642268 None] Acquiring lock "cinder-95df38a5-38b6-482a-be55-9982e530de58-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:28 devstack sudo[108615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d Sep 28 17:36:28 devstack sudo[108615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:28 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-07fde91e-3963-47ef-a8fa-a156fbbf7f4f tempest-CinderUnicodeTest-2101642268 None] Lock "cinder-95df38a5-38b6-482a-be55-9982e530de58-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:28 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-07fde91e-3963-47ef-a8fa-a156fbbf7f4f tempest-CinderUnicodeTest-2101642268 None] Acquiring lock "cinder-quobyte-95df38a5-38b6-482a-be55-9982e530de58" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:28 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-07fde91e-3963-47ef-a8fa-a156fbbf7f4f tempest-CinderUnicodeTest-2101642268 None] Lock "cinder-quobyte-95df38a5-38b6-482a-be55-9982e530de58" acquired by "delete_volume" :: waited 0.023s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:28 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3efc65-fb8c-4d50-8be5-18050f324bb4]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-07fde91e-3963-47ef-a8fa-a156fbbf7f4f tempest-CinderUnicodeTest-2101642268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-95df38a5-38b6-482a-be55-9982e530de58 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:28 devstack sudo[108619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-95df38a5-38b6-482a-be55-9982e530de58 Sep 28 17:36:28 devstack sudo[108619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:28 devstack sudo[108616]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ec5ed0ed-2f98-42e6-90f4-6216a2237fd9 tempest-CinderUnicodeTest-2101642268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.407s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:28 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-ec5ed0ed-2f98-42e6-90f4-6216a2237fd9 tempest-CinderUnicodeTest-2101642268 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:36:28 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-ec5ed0ed-2f98-42e6-90f4-6216a2237fd9 tempest-CinderUnicodeTest-2101642268 None] Deleted volume successfully. Sep 28 17:36:28 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ec5ed0ed-2f98-42e6-90f4-6216a2237fd9 tempest-CinderUnicodeTest-2101642268 None] Lock "cinder-4041a2ae-0ce2-4636-a1f7-46708907fb5a-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:28 devstack sudo[108615]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a554e87d-a879-4d34-a65e-b6982831ba41 tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d" returned: 0 in 0.546s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a554e87d-a879-4d34-a65e-b6982831ba41 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d.f9cf8700-35d2-4b3b-8e12-4b0ae48230c6 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:28 devstack sudo[108625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d.f9cf8700-35d2-4b3b-8e12-4b0ae48230c6 Sep 28 17:36:28 devstack sudo[108625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:29 devstack sudo[108619]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-07fde91e-3963-47ef-a8fa-a156fbbf7f4f tempest-CinderUnicodeTest-2101642268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-95df38a5-38b6-482a-be55-9982e530de58" returned: 0 in 0.458s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-07fde91e-3963-47ef-a8fa-a156fbbf7f4f tempest-CinderUnicodeTest-2101642268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-95df38a5-38b6-482a-be55-9982e530de58 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:29 devstack sudo[108630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-95df38a5-38b6-482a-be55-9982e530de58 Sep 28 17:36:29 devstack sudo[108630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:29 devstack sudo[108625]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a554e87d-a879-4d34-a65e-b6982831ba41 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d.f9cf8700-35d2-4b3b-8e12-4b0ae48230c6" returned: 0 in 0.388s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a554e87d-a879-4d34-a65e-b6982831ba41 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d.f9cf8700-35d2-4b3b-8e12-4b0ae48230c6 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:29 devstack sudo[108635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d.f9cf8700-35d2-4b3b-8e12-4b0ae48230c6 Sep 28 17:36:29 devstack sudo[108635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:29 devstack sudo[108630]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-07fde91e-3963-47ef-a8fa-a156fbbf7f4f tempest-CinderUnicodeTest-2101642268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-95df38a5-38b6-482a-be55-9982e530de58" returned: 0 in 0.270s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-07fde91e-3963-47ef-a8fa-a156fbbf7f4f tempest-CinderUnicodeTest-2101642268 None] Lock "cinder-quobyte-95df38a5-38b6-482a-be55-9982e530de58" released by "delete_volume" :: held 0.792s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:29 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-07fde91e-3963-47ef-a8fa-a156fbbf7f4f tempest-CinderUnicodeTest-2101642268 None] Created reservations ['1516270e-42a6-44e0-bbac-084704c0b157', '646b5416-3255-4bdd-98d1-b5a8626bb701', '0e8550c6-f5d8-4cfa-87c7-02c8eec84ec9', '45f5e6e9-8a73-4dac-a399-e0781114b331'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:36:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-07fde91e-3963-47ef-a8fa-a156fbbf7f4f tempest-CinderUnicodeTest-2101642268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-07fde91e-3963-47ef-a8fa-a156fbbf7f4f tempest-CinderUnicodeTest-2101642268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-07fde91e-3963-47ef-a8fa-a156fbbf7f4f tempest-CinderUnicodeTest-2101642268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:36:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-07fde91e-3963-47ef-a8fa-a156fbbf7f4f tempest-CinderUnicodeTest-2101642268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:36:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-07fde91e-3963-47ef-a8fa-a156fbbf7f4f tempest-CinderUnicodeTest-2101642268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-07fde91e-3963-47ef-a8fa-a156fbbf7f4f tempest-CinderUnicodeTest-2101642268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:29 devstack sudo[108635]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:29 devstack sudo[108639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:36:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a554e87d-a879-4d34-a65e-b6982831ba41 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d.f9cf8700-35d2-4b3b-8e12-4b0ae48230c6" returned: 0 in 0.327s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:29 devstack sudo[108639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a554e87d-a879-4d34-a65e-b6982831ba41 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-f9cf8700-35d2-4b3b-8e12-4b0ae48230c6" released by "_delete_snapshot" :: held 1.867s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a554e87d-a879-4d34-a65e-b6982831ba41 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d" released by "delete_snapshot" :: held 1.901s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:29 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-a554e87d-a879-4d34-a65e-b6982831ba41 tempest-ProjectMemberTests-1852265171 None] Created reservations ['5ec96aaf-1f0c-4050-8d1a-69d9dc060794', '77e307e6-af1b-4564-8171-dc9d11839d6b', '5c5ab598-b401-4604-a8b0-26176bbb027c', '5d22d399-d58d-4536-8fc6-fa6a8946ab8c'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:36:29 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-a554e87d-a879-4d34-a65e-b6982831ba41 tempest-ProjectMemberTests-1852265171 None] Delete snapshot completed successfully. Sep 28 17:36:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-a554e87d-a879-4d34-a65e-b6982831ba41 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-f9cf8700-35d2-4b3b-8e12-4b0ae48230c6-delete_snapshot" released by "delete_snapshot" :: held 2.132s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:29 devstack sudo[108639]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-07fde91e-3963-47ef-a8fa-a156fbbf7f4f tempest-CinderUnicodeTest-2101642268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.380s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:30 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-07fde91e-3963-47ef-a8fa-a156fbbf7f4f tempest-CinderUnicodeTest-2101642268 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:36:30 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-07fde91e-3963-47ef-a8fa-a156fbbf7f4f tempest-CinderUnicodeTest-2101642268 None] Deleted volume successfully. Sep 28 17:36:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-07fde91e-3963-47ef-a8fa-a156fbbf7f4f tempest-CinderUnicodeTest-2101642268 None] Lock "cinder-95df38a5-38b6-482a-be55-9982e530de58-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-9b91bd89-8307-49b0-9033-2eb0b83c7a54 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-9b91bd89-8307-49b0-9033-2eb0b83c7a54 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-9b91bd89-8307-49b0-9033-2eb0b83c7a54 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-quobyte-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-9b91bd89-8307-49b0-9033-2eb0b83c7a54 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d" acquired by "delete_volume" :: waited 0.029s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:30 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a46960-b4c5-4d1f-a0ed-e35d368f994b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9b91bd89-8307-49b0-9033-2eb0b83c7a54 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:30 devstack sudo[108642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d Sep 28 17:36:30 devstack sudo[108642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:30 devstack sudo[108642]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9b91bd89-8307-49b0-9033-2eb0b83c7a54 tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d" returned: 0 in 0.445s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9b91bd89-8307-49b0-9033-2eb0b83c7a54 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:30 devstack sudo[108647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d Sep 28 17:36:30 devstack sudo[108647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:31 devstack sudo[108647]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9b91bd89-8307-49b0-9033-2eb0b83c7a54 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d" returned: 0 in 0.325s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:31 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-9b91bd89-8307-49b0-9033-2eb0b83c7a54 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d" released by "delete_volume" :: held 0.917s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:31 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-9b91bd89-8307-49b0-9033-2eb0b83c7a54 tempest-ProjectMemberTests-1852265171 None] Created reservations ['2f41e798-82c7-4797-84c8-e3e1c1927ff5', '75a1ebf9-a2a5-419c-8cc3-9d37757e638a', '5bcd2f97-6dda-4450-829c-ef493eec2259', 'd4ccc53b-6a92-41f7-8f23-3a8c55f89783'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:36:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9b91bd89-8307-49b0-9033-2eb0b83c7a54 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9b91bd89-8307-49b0-9033-2eb0b83c7a54 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-9b91bd89-8307-49b0-9033-2eb0b83c7a54 tempest-ProjectMemberTests-1852265171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:36:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-9b91bd89-8307-49b0-9033-2eb0b83c7a54 tempest-ProjectMemberTests-1852265171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:36:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9b91bd89-8307-49b0-9033-2eb0b83c7a54 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9b91bd89-8307-49b0-9033-2eb0b83c7a54 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:31 devstack sudo[108650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:36:31 devstack sudo[108650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:31 devstack sudo[108650]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9b91bd89-8307-49b0-9033-2eb0b83c7a54 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.395s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:31 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-9b91bd89-8307-49b0-9033-2eb0b83c7a54 tempest-ProjectMemberTests-1852265171 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:36:31 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-9b91bd89-8307-49b0-9033-2eb0b83c7a54 tempest-ProjectMemberTests-1852265171 None] Deleted volume successfully. Sep 28 17:36:31 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-9b91bd89-8307-49b0-9033-2eb0b83c7a54 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-d3a240c7-92bf-4ab2-89f1-f93a2d4ead9d-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:32 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d18ddfe-ef98-4996-9c59-d858a76a2143 tempest-ProjectMemberTests-1852265171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:36:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4d18ddfe-ef98-4996-9c59-d858a76a2143 tempest-ProjectMemberTests-1852265171 None] Flow 'volume_create_manager' (6c0d4d16-5429-4888-91d5-a2279262d6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:36:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4d18ddfe-ef98-4996-9c59-d858a76a2143 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe0fdc0-dc84-46c2-a38b-e5fe13724166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4d18ddfe-ef98-4996-9c59-d858a76a2143 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe0fdc0-dc84-46c2-a38b-e5fe13724166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1997068122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42cf9bc2-a34e-4199-b923-72a41e6db4f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e19b5535dc4ca0a0b3b833ab1e8248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:36:32Z,use_quota=True,user_id='56b2bce1c2e2420fb799c45cd8c3987f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4d18ddfe-ef98-4996-9c59-d858a76a2143 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (792caa21-6da3-4361-8b30-548e5d27418e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4d18ddfe-ef98-4996-9c59-d858a76a2143 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (792caa21-6da3-4361-8b30-548e5d27418e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4d18ddfe-ef98-4996-9c59-d858a76a2143 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f0a3bb-122c-4b59-b4cc-8d01dee1b838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4d18ddfe-ef98-4996-9c59-d858a76a2143 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f0a3bb-122c-4b59-b4cc-8d01dee1b838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42cf9bc2-a34e-4199-b923-72a41e6db4f5', 'volume_name': 'volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4d18ddfe-ef98-4996-9c59-d858a76a2143 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6db16f9-709e-4332-a11c-d7ee557f5128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4d18ddfe-ef98-4996-9c59-d858a76a2143 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6db16f9-709e-4332-a11c-d7ee557f5128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:32 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4d18ddfe-ef98-4996-9c59-d858a76a2143 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f471320a-bb1e-40c4-ac7d-01fcee3a25e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:32 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-4d18ddfe-ef98-4996-9c59-d858a76a2143 tempest-ProjectMemberTests-1852265171 None] Volume 42cf9bc2-a34e-4199-b923-72a41e6db4f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5', 'volume_size': 1} Sep 28 17:36:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4d18ddfe-ef98-4996-9c59-d858a76a2143 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4d18ddfe-ef98-4996-9c59-d858a76a2143 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4d18ddfe-ef98-4996-9c59-d858a76a2143 tempest-ProjectMemberTests-1852265171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1997068122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42cf9bc2-a34e-4199-b923-72a41e6db4f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e19b5535dc4ca0a0b3b833ab1e8248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:36:32Z,use_quota=True,user_id='56b2bce1c2e2420fb799c45cd8c3987f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:36:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-4d18ddfe-ef98-4996-9c59-d858a76a2143 tempest-ProjectMemberTests-1852265171 None] Creating volume 42cf9bc2-a34e-4199-b923-72a41e6db4f5 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:36:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4d18ddfe-ef98-4996-9c59-d858a76a2143 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4d18ddfe-ef98-4996-9c59-d858a76a2143 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4d18ddfe-ef98-4996-9c59-d858a76a2143 tempest-ProjectMemberTests-1852265171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:36:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4d18ddfe-ef98-4996-9c59-d858a76a2143 tempest-ProjectMemberTests-1852265171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:36:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4d18ddfe-ef98-4996-9c59-d858a76a2143 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:32 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4d18ddfe-ef98-4996-9c59-d858a76a2143 tempest-ProjectMemberTests-1852265171 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:36:32 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-4d18ddfe-ef98-4996-9c59-d858a76a2143 tempest-ProjectMemberTests-1852265171 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:36:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4d18ddfe-ef98-4996-9c59-d858a76a2143 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:32 devstack sudo[108688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5 1073741824 Sep 28 17:36:32 devstack sudo[108688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:33 devstack sudo[108688]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4d18ddfe-ef98-4996-9c59-d858a76a2143 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5 1073741824" returned: 0 in 0.841s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4d18ddfe-ef98-4996-9c59-d858a76a2143 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:33 devstack sudo[108696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5 Sep 28 17:36:33 devstack sudo[108696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:33 devstack sudo[108696]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4d18ddfe-ef98-4996-9c59-d858a76a2143 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5" returned: 0 in 0.353s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:33 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4d18ddfe-ef98-4996-9c59-d858a76a2143 tempest-ProjectMemberTests-1852265171 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:36:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4d18ddfe-ef98-4996-9c59-d858a76a2143 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:33 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4d18ddfe-ef98-4996-9c59-d858a76a2143 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f471320a-bb1e-40c4-ac7d-01fcee3a25e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:33 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4d18ddfe-ef98-4996-9c59-d858a76a2143 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79d6598b-73c0-46ac-9626-41231f30a383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:33 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-4d18ddfe-ef98-4996-9c59-d858a76a2143 tempest-ProjectMemberTests-1852265171 None] Volume volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5 (42cf9bc2-a34e-4199-b923-72a41e6db4f5): created successfully Sep 28 17:36:33 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4d18ddfe-ef98-4996-9c59-d858a76a2143 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79d6598b-73c0-46ac-9626-41231f30a383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:33 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-4d18ddfe-ef98-4996-9c59-d858a76a2143 tempest-ProjectMemberTests-1852265171 None] Flow 'volume_create_manager' (6c0d4d16-5429-4888-91d5-a2279262d6a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:36:33 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-4d18ddfe-ef98-4996-9c59-d858a76a2143 tempest-ProjectMemberTests-1852265171 None] Created volume successfully. Sep 28 17:36:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5591cf84-f944-4dc0-bfe8-9ca7e20449ea tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5591cf84-f944-4dc0-bfe8-9ca7e20449ea tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:34 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-5591cf84-f944-4dc0-bfe8-9ca7e20449ea tempest-ProjectMemberTests-1852265171 None] Creating offline snapshot ddccd72c-762e-4d9e-88bf-8b5c8dbc360c of volume 42cf9bc2-a34e-4199-b923-72a41e6db4f5 {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:36:34 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f52337-54ae-4ad8-bff9-cf652b2f0f03]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5591cf84-f944-4dc0-bfe8-9ca7e20449ea tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:34 devstack sudo[108699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5 Sep 28 17:36:34 devstack sudo[108699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:34 devstack sudo[108699]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5591cf84-f944-4dc0-bfe8-9ca7e20449ea tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5" returned: 0 in 0.422s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5591cf84-f944-4dc0-bfe8-9ca7e20449ea tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5.ddccd72c-762e-4d9e-88bf-8b5c8dbc360c 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:34 devstack sudo[108704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5.ddccd72c-762e-4d9e-88bf-8b5c8dbc360c 1G Sep 28 17:36:34 devstack sudo[108704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:35 devstack sudo[108704]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5591cf84-f944-4dc0-bfe8-9ca7e20449ea tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5.ddccd72c-762e-4d9e-88bf-8b5c8dbc360c 1G" returned: 0 in 0.543s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5591cf84-f944-4dc0-bfe8-9ca7e20449ea tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5.ddccd72c-762e-4d9e-88bf-8b5c8dbc360c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:35 devstack sudo[108710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5.ddccd72c-762e-4d9e-88bf-8b5c8dbc360c Sep 28 17:36:35 devstack sudo[108710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:35 devstack sudo[108710]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5591cf84-f944-4dc0-bfe8-9ca7e20449ea tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5.ddccd72c-762e-4d9e-88bf-8b5c8dbc360c" returned: 0 in 0.456s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:35 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-5591cf84-f944-4dc0-bfe8-9ca7e20449ea tempest-ProjectMemberTests-1852265171 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5.ddccd72c-762e-4d9e-88bf-8b5c8dbc360c is being set with open permissions: ugo+rw Sep 28 17:36:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5591cf84-f944-4dc0-bfe8-9ca7e20449ea tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5.ddccd72c-762e-4d9e-88bf-8b5c8dbc360c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:35 devstack sudo[108715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5.ddccd72c-762e-4d9e-88bf-8b5c8dbc360c Sep 28 17:36:35 devstack sudo[108715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:36 devstack sudo[108715]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5591cf84-f944-4dc0-bfe8-9ca7e20449ea tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5.ddccd72c-762e-4d9e-88bf-8b5c8dbc360c" returned: 0 in 0.315s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5591cf84-f944-4dc0-bfe8-9ca7e20449ea tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:36 devstack sudo[108718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5.info Sep 28 17:36:36 devstack sudo[108718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:36 devstack sudo[108718]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5591cf84-f944-4dc0-bfe8-9ca7e20449ea tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5.info" returned: 0 in 0.405s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:36 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-5591cf84-f944-4dc0-bfe8-9ca7e20449ea tempest-ProjectMemberTests-1852265171 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5.info is being set with open permissions: ugo+rw Sep 28 17:36:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5591cf84-f944-4dc0-bfe8-9ca7e20449ea tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:36 devstack sudo[108721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5.info Sep 28 17:36:36 devstack sudo[108721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:37 devstack sudo[108721]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5591cf84-f944-4dc0-bfe8-9ca7e20449ea tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5.info" returned: 0 in 0.332s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5591cf84-f944-4dc0-bfe8-9ca7e20449ea tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.612s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:37 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-5591cf84-f944-4dc0-bfe8-9ca7e20449ea tempest-ProjectMemberTests-1852265171 None] Create snapshot completed successfully Sep 28 17:36:37 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-eee5bd76-795e-4bbd-adab-a899ba344a46 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-ddccd72c-762e-4d9e-88bf-8b5c8dbc360c-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:37 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-eee5bd76-795e-4bbd-adab-a899ba344a46 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-ddccd72c-762e-4d9e-88bf-8b5c8dbc360c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:37 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-eee5bd76-795e-4bbd-adab-a899ba344a46 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-quobyte-42cf9bc2-a34e-4199-b923-72a41e6db4f5" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:37 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-eee5bd76-795e-4bbd-adab-a899ba344a46 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-42cf9bc2-a34e-4199-b923-72a41e6db4f5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:37 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-eee5bd76-795e-4bbd-adab-a899ba344a46 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-quobyte-ddccd72c-762e-4d9e-88bf-8b5c8dbc360c" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:37 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-eee5bd76-795e-4bbd-adab-a899ba344a46 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-ddccd72c-762e-4d9e-88bf-8b5c8dbc360c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:37 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-eee5bd76-795e-4bbd-adab-a899ba344a46 tempest-ProjectMemberTests-1852265171 None] Deleting offline snapshot ddccd72c-762e-4d9e-88bf-8b5c8dbc360c of volume 42cf9bc2-a34e-4199-b923-72a41e6db4f5 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:36:37 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-eee5bd76-795e-4bbd-adab-a899ba344a46 tempest-ProjectMemberTests-1852265171 None] snapshot_file for this snap is: volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5.ddccd72c-762e-4d9e-88bf-8b5c8dbc360c {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:36:37 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc02667e-22f8-4a5c-9014-848c8a497a8c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:37 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-eee5bd76-795e-4bbd-adab-a899ba344a46 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5.ddccd72c-762e-4d9e-88bf-8b5c8dbc360c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:37 devstack sudo[108725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5.ddccd72c-762e-4d9e-88bf-8b5c8dbc360c Sep 28 17:36:37 devstack sudo[108725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:38 devstack sudo[108725]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-eee5bd76-795e-4bbd-adab-a899ba344a46 tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5.ddccd72c-762e-4d9e-88bf-8b5c8dbc360c" returned: 0 in 0.543s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:38 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-eee5bd76-795e-4bbd-adab-a899ba344a46 tempest-ProjectMemberTests-1852265171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:36:38 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5b8eeb-051f-43bd-b776-8f020dcc90e3]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-eee5bd76-795e-4bbd-adab-a899ba344a46 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:38 devstack sudo[108731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5 Sep 28 17:36:38 devstack sudo[108731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:38 devstack sudo[108731]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-eee5bd76-795e-4bbd-adab-a899ba344a46 tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5" returned: 0 in 0.546s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:38 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-eee5bd76-795e-4bbd-adab-a899ba344a46 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5.ddccd72c-762e-4d9e-88bf-8b5c8dbc360c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:39 devstack sudo[108736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5.ddccd72c-762e-4d9e-88bf-8b5c8dbc360c Sep 28 17:36:39 devstack sudo[108736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:39 devstack sudo[108736]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-eee5bd76-795e-4bbd-adab-a899ba344a46 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5.ddccd72c-762e-4d9e-88bf-8b5c8dbc360c" returned: 0 in 0.463s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-eee5bd76-795e-4bbd-adab-a899ba344a46 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5.ddccd72c-762e-4d9e-88bf-8b5c8dbc360c {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:39 devstack sudo[108742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5.ddccd72c-762e-4d9e-88bf-8b5c8dbc360c Sep 28 17:36:39 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:39 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:39 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-eee5bd76-795e-4bbd-adab-a899ba344a46 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5.ddccd72c-762e-4d9e-88bf-8b5c8dbc360c" returned: 0 in 0.310s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:39 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-eee5bd76-795e-4bbd-adab-a899ba344a46 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-ddccd72c-762e-4d9e-88bf-8b5c8dbc360c" released by "_delete_snapshot" :: held 2.023s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:39 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-eee5bd76-795e-4bbd-adab-a899ba344a46 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-42cf9bc2-a34e-4199-b923-72a41e6db4f5" released by "delete_snapshot" :: held 2.052s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:39 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-eee5bd76-795e-4bbd-adab-a899ba344a46 tempest-ProjectMemberTests-1852265171 None] Created reservations ['c1d4977c-3577-4ee8-b629-596dbce2e6d4', 'ca65fee2-44d1-40c2-8149-6c643170a1c4', '1e92ceb9-ade3-460c-b7fa-a82af55fe4c3', 'be5d78ec-4433-48ac-8721-36c40dcf807b'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:36:39 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-eee5bd76-795e-4bbd-adab-a899ba344a46 tempest-ProjectMemberTests-1852265171 None] Delete snapshot completed successfully. Sep 28 17:36:40 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-eee5bd76-795e-4bbd-adab-a899ba344a46 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-ddccd72c-762e-4d9e-88bf-8b5c8dbc360c-delete_snapshot" released by "delete_snapshot" :: held 2.283s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:40 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c2376142-49fe-41c1-b247-06e14c8bf392 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-42cf9bc2-a34e-4199-b923-72a41e6db4f5-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:41 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c2376142-49fe-41c1-b247-06e14c8bf392 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-42cf9bc2-a34e-4199-b923-72a41e6db4f5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:41 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c2376142-49fe-41c1-b247-06e14c8bf392 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-quobyte-42cf9bc2-a34e-4199-b923-72a41e6db4f5" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:41 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c2376142-49fe-41c1-b247-06e14c8bf392 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-42cf9bc2-a34e-4199-b923-72a41e6db4f5" acquired by "delete_volume" :: waited 0.019s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:41 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f437671-906f-468a-bf66-bca3062eb191]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c2376142-49fe-41c1-b247-06e14c8bf392 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:41 devstack sudo[108745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5 Sep 28 17:36:41 devstack sudo[108745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:41 devstack sudo[108745]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c2376142-49fe-41c1-b247-06e14c8bf392 tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5" returned: 0 in 0.443s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c2376142-49fe-41c1-b247-06e14c8bf392 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:41 devstack sudo[108751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5 Sep 28 17:36:41 devstack sudo[108751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:41 devstack sudo[108751]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c2376142-49fe-41c1-b247-06e14c8bf392 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-42cf9bc2-a34e-4199-b923-72a41e6db4f5" returned: 0 in 0.254s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:41 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c2376142-49fe-41c1-b247-06e14c8bf392 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-42cf9bc2-a34e-4199-b923-72a41e6db4f5" released by "delete_volume" :: held 0.766s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:41 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-c2376142-49fe-41c1-b247-06e14c8bf392 tempest-ProjectMemberTests-1852265171 None] Created reservations ['d3c06212-68e5-47f1-82f6-e1bd25954f08', 'f2052b00-64cb-4e4a-809d-52b99468c7b8', '807b7c05-f292-4e1c-8406-0c6297730c0b', '15ac2e52-fa0d-45b9-9115-002acd0f1874'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:36:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c2376142-49fe-41c1-b247-06e14c8bf392 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c2376142-49fe-41c1-b247-06e14c8bf392 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:42 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c2376142-49fe-41c1-b247-06e14c8bf392 tempest-ProjectMemberTests-1852265171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:36:42 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c2376142-49fe-41c1-b247-06e14c8bf392 tempest-ProjectMemberTests-1852265171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:36:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c2376142-49fe-41c1-b247-06e14c8bf392 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c2376142-49fe-41c1-b247-06e14c8bf392 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:42 devstack sudo[108754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:36:42 devstack sudo[108754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:42 devstack sudo[108754]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c2376142-49fe-41c1-b247-06e14c8bf392 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.262s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:42 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-c2376142-49fe-41c1-b247-06e14c8bf392 tempest-ProjectMemberTests-1852265171 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:36:42 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-c2376142-49fe-41c1-b247-06e14c8bf392 tempest-ProjectMemberTests-1852265171 None] Deleted volume successfully. Sep 28 17:36:42 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c2376142-49fe-41c1-b247-06e14c8bf392 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-42cf9bc2-a34e-4199-b923-72a41e6db4f5-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:42 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-f13656ac-7972-40af-be95-644b645fa36a tempest-ProjectMemberTests-1852265171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:36:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f13656ac-7972-40af-be95-644b645fa36a tempest-ProjectMemberTests-1852265171 None] Flow 'volume_create_manager' (a7b92447-7fd8-4345-8363-9a508b517b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:36:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f13656ac-7972-40af-be95-644b645fa36a tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6db104-1c73-4c7f-a407-ec69ac8a5b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f13656ac-7972-40af-be95-644b645fa36a tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6db104-1c73-4c7f-a407-ec69ac8a5b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-68706363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbde210b-a50a-4ae5-836c-eb15015d0a2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e19b5535dc4ca0a0b3b833ab1e8248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:36:43Z,use_quota=True,user_id='56b2bce1c2e2420fb799c45cd8c3987f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f13656ac-7972-40af-be95-644b645fa36a tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f21180de-1b8a-4aa4-9a4a-7e2156d2dfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f13656ac-7972-40af-be95-644b645fa36a tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f21180de-1b8a-4aa4-9a4a-7e2156d2dfbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f13656ac-7972-40af-be95-644b645fa36a tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17e18153-d92c-44f8-b113-737cf2601d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f13656ac-7972-40af-be95-644b645fa36a tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17e18153-d92c-44f8-b113-737cf2601d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbde210b-a50a-4ae5-836c-eb15015d0a2d', 'volume_name': 'volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f13656ac-7972-40af-be95-644b645fa36a tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e0d1150-0f12-460e-95b5-2a97082190d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f13656ac-7972-40af-be95-644b645fa36a tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e0d1150-0f12-460e-95b5-2a97082190d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:42 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f13656ac-7972-40af-be95-644b645fa36a tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa41c8c6-9ba2-40f5-9626-c5e15372d52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:42 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-f13656ac-7972-40af-be95-644b645fa36a tempest-ProjectMemberTests-1852265171 None] Volume bbde210b-a50a-4ae5-836c-eb15015d0a2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d', 'volume_size': 1} Sep 28 17:36:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f13656ac-7972-40af-be95-644b645fa36a tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f13656ac-7972-40af-be95-644b645fa36a tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:42 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f13656ac-7972-40af-be95-644b645fa36a tempest-ProjectMemberTests-1852265171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-68706363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbde210b-a50a-4ae5-836c-eb15015d0a2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e19b5535dc4ca0a0b3b833ab1e8248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:36:43Z,use_quota=True,user_id='56b2bce1c2e2420fb799c45cd8c3987f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:36:42 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-f13656ac-7972-40af-be95-644b645fa36a tempest-ProjectMemberTests-1852265171 None] Creating volume bbde210b-a50a-4ae5-836c-eb15015d0a2d {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:36:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f13656ac-7972-40af-be95-644b645fa36a tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f13656ac-7972-40af-be95-644b645fa36a tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:42 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f13656ac-7972-40af-be95-644b645fa36a tempest-ProjectMemberTests-1852265171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:36:42 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f13656ac-7972-40af-be95-644b645fa36a tempest-ProjectMemberTests-1852265171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:36:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f13656ac-7972-40af-be95-644b645fa36a tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:42 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f13656ac-7972-40af-be95-644b645fa36a tempest-ProjectMemberTests-1852265171 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:36:42 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-f13656ac-7972-40af-be95-644b645fa36a tempest-ProjectMemberTests-1852265171 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:36:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f13656ac-7972-40af-be95-644b645fa36a tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:42 devstack sudo[108757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d 1073741824 Sep 28 17:36:42 devstack sudo[108757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:43 devstack sudo[108757]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f13656ac-7972-40af-be95-644b645fa36a tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d 1073741824" returned: 0 in 0.546s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f13656ac-7972-40af-be95-644b645fa36a tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:43 devstack sudo[108764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d Sep 28 17:36:43 devstack sudo[108764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:43 devstack sudo[108764]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f13656ac-7972-40af-be95-644b645fa36a tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d" returned: 0 in 0.262s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:43 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f13656ac-7972-40af-be95-644b645fa36a tempest-ProjectMemberTests-1852265171 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:36:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f13656ac-7972-40af-be95-644b645fa36a tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f13656ac-7972-40af-be95-644b645fa36a tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa41c8c6-9ba2-40f5-9626-c5e15372d52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f13656ac-7972-40af-be95-644b645fa36a tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef615747-d6f5-4b51-83eb-8e5c81911a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:43 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-f13656ac-7972-40af-be95-644b645fa36a tempest-ProjectMemberTests-1852265171 None] Volume volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d (bbde210b-a50a-4ae5-836c-eb15015d0a2d): created successfully Sep 28 17:36:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f13656ac-7972-40af-be95-644b645fa36a tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef615747-d6f5-4b51-83eb-8e5c81911a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:43 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f13656ac-7972-40af-be95-644b645fa36a tempest-ProjectMemberTests-1852265171 None] Flow 'volume_create_manager' (a7b92447-7fd8-4345-8363-9a508b517b96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:36:43 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-f13656ac-7972-40af-be95-644b645fa36a tempest-ProjectMemberTests-1852265171 None] Created volume successfully. Sep 28 17:36:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-63dd78b4-dc25-4045-b631-c25fe63d07dd tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-63dd78b4-dc25-4045-b631-c25fe63d07dd tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:45 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-63dd78b4-dc25-4045-b631-c25fe63d07dd tempest-ProjectMemberTests-1852265171 None] Creating offline snapshot ad268dd5-6975-4ed3-aa88-37641c11f425 of volume bbde210b-a50a-4ae5-836c-eb15015d0a2d {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:36:45 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a877f0-fe2e-4f09-9148-3f62e204d0ef]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-63dd78b4-dc25-4045-b631-c25fe63d07dd tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:45 devstack sudo[108767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d Sep 28 17:36:45 devstack sudo[108767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:45 devstack sudo[108767]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-63dd78b4-dc25-4045-b631-c25fe63d07dd tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d" returned: 0 in 0.439s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-63dd78b4-dc25-4045-b631-c25fe63d07dd tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d.ad268dd5-6975-4ed3-aa88-37641c11f425 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:45 devstack sudo[108774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d.ad268dd5-6975-4ed3-aa88-37641c11f425 1G Sep 28 17:36:45 devstack sudo[108774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:46 devstack sudo[108774]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-63dd78b4-dc25-4045-b631-c25fe63d07dd tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d.ad268dd5-6975-4ed3-aa88-37641c11f425 1G" returned: 0 in 0.571s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-63dd78b4-dc25-4045-b631-c25fe63d07dd tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d.ad268dd5-6975-4ed3-aa88-37641c11f425 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:46 devstack sudo[108780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d.ad268dd5-6975-4ed3-aa88-37641c11f425 Sep 28 17:36:46 devstack sudo[108780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:46 devstack sudo[108780]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-63dd78b4-dc25-4045-b631-c25fe63d07dd tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d.ad268dd5-6975-4ed3-aa88-37641c11f425" returned: 0 in 0.308s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:46 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-63dd78b4-dc25-4045-b631-c25fe63d07dd tempest-ProjectMemberTests-1852265171 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d.ad268dd5-6975-4ed3-aa88-37641c11f425 is being set with open permissions: ugo+rw Sep 28 17:36:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-63dd78b4-dc25-4045-b631-c25fe63d07dd tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d.ad268dd5-6975-4ed3-aa88-37641c11f425 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:46 devstack sudo[108787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d.ad268dd5-6975-4ed3-aa88-37641c11f425 Sep 28 17:36:46 devstack sudo[108787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:46 devstack sudo[108787]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-63dd78b4-dc25-4045-b631-c25fe63d07dd tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d.ad268dd5-6975-4ed3-aa88-37641c11f425" returned: 0 in 0.249s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-63dd78b4-dc25-4045-b631-c25fe63d07dd tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:46 devstack sudo[108790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d.info Sep 28 17:36:46 devstack sudo[108790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:47 devstack sudo[108790]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-63dd78b4-dc25-4045-b631-c25fe63d07dd tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d.info" returned: 0 in 0.298s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:47 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-63dd78b4-dc25-4045-b631-c25fe63d07dd tempest-ProjectMemberTests-1852265171 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d.info is being set with open permissions: ugo+rw Sep 28 17:36:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-63dd78b4-dc25-4045-b631-c25fe63d07dd tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:47 devstack sudo[108793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d.info Sep 28 17:36:47 devstack sudo[108793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:47 devstack sudo[108793]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-63dd78b4-dc25-4045-b631-c25fe63d07dd tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d.info" returned: 0 in 0.280s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-63dd78b4-dc25-4045-b631-c25fe63d07dd tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.259s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:47 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-63dd78b4-dc25-4045-b631-c25fe63d07dd tempest-ProjectMemberTests-1852265171 None] Create snapshot completed successfully Sep 28 17:36:48 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-dc6f51b0-a100-4cd6-a139-0f2cdac44efa tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-ad268dd5-6975-4ed3-aa88-37641c11f425-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:48 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-dc6f51b0-a100-4cd6-a139-0f2cdac44efa tempest-ProjectMemberTests-1852265171 None] Lock "cinder-ad268dd5-6975-4ed3-aa88-37641c11f425-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:48 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-dc6f51b0-a100-4cd6-a139-0f2cdac44efa tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-quobyte-bbde210b-a50a-4ae5-836c-eb15015d0a2d" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:48 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-dc6f51b0-a100-4cd6-a139-0f2cdac44efa tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-bbde210b-a50a-4ae5-836c-eb15015d0a2d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:48 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-dc6f51b0-a100-4cd6-a139-0f2cdac44efa tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-quobyte-ad268dd5-6975-4ed3-aa88-37641c11f425" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:48 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-dc6f51b0-a100-4cd6-a139-0f2cdac44efa tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-ad268dd5-6975-4ed3-aa88-37641c11f425" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:48 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-dc6f51b0-a100-4cd6-a139-0f2cdac44efa tempest-ProjectMemberTests-1852265171 None] Deleting offline snapshot ad268dd5-6975-4ed3-aa88-37641c11f425 of volume bbde210b-a50a-4ae5-836c-eb15015d0a2d {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:36:48 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-dc6f51b0-a100-4cd6-a139-0f2cdac44efa tempest-ProjectMemberTests-1852265171 None] snapshot_file for this snap is: volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d.ad268dd5-6975-4ed3-aa88-37641c11f425 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:36:48 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e88bd32-9a3d-4840-a45b-0756cb0e43e3]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-dc6f51b0-a100-4cd6-a139-0f2cdac44efa tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d.ad268dd5-6975-4ed3-aa88-37641c11f425 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:48 devstack sudo[108796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d.ad268dd5-6975-4ed3-aa88-37641c11f425 Sep 28 17:36:48 devstack sudo[108796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:48 devstack sudo[108796]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-dc6f51b0-a100-4cd6-a139-0f2cdac44efa tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d.ad268dd5-6975-4ed3-aa88-37641c11f425" returned: 0 in 0.462s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:48 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-dc6f51b0-a100-4cd6-a139-0f2cdac44efa tempest-ProjectMemberTests-1852265171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:36:48 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c730061c-9758-4b35-8572-85f9af09bc93]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-dc6f51b0-a100-4cd6-a139-0f2cdac44efa tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:48 devstack sudo[108801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d Sep 28 17:36:48 devstack sudo[108801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:49 devstack sudo[108801]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-dc6f51b0-a100-4cd6-a139-0f2cdac44efa tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d" returned: 0 in 0.430s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-dc6f51b0-a100-4cd6-a139-0f2cdac44efa tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d.ad268dd5-6975-4ed3-aa88-37641c11f425 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:49 devstack sudo[108806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d.ad268dd5-6975-4ed3-aa88-37641c11f425 Sep 28 17:36:49 devstack sudo[108806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:36:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:36:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:36:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:49 devstack sudo[108810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:36:49 devstack sudo[108810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:49 devstack sudo[108806]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-dc6f51b0-a100-4cd6-a139-0f2cdac44efa tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d.ad268dd5-6975-4ed3-aa88-37641c11f425" returned: 0 in 0.548s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-dc6f51b0-a100-4cd6-a139-0f2cdac44efa tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d.ad268dd5-6975-4ed3-aa88-37641c11f425 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:49 devstack sudo[108814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d.ad268dd5-6975-4ed3-aa88-37641c11f425 Sep 28 17:36:49 devstack sudo[108814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:49 devstack sudo[108810]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.392s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:49 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:36:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager._thread_info {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:36:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread count: 28 {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:36:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread info: [<_MainThread(MainThread, started 132915553284224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:36:50 devstack sudo[108814]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-dc6f51b0-a100-4cd6-a139-0f2cdac44efa tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d.ad268dd5-6975-4ed3-aa88-37641c11f425" returned: 0 in 0.329s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:50 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-dc6f51b0-a100-4cd6-a139-0f2cdac44efa tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-ad268dd5-6975-4ed3-aa88-37641c11f425" released by "_delete_snapshot" :: held 1.906s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:50 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-dc6f51b0-a100-4cd6-a139-0f2cdac44efa tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-bbde210b-a50a-4ae5-836c-eb15015d0a2d" released by "delete_snapshot" :: held 1.934s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:50 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-dc6f51b0-a100-4cd6-a139-0f2cdac44efa tempest-ProjectMemberTests-1852265171 None] Created reservations ['beb85ad6-0039-4841-9a66-a497925b2cce', '1be6350f-e7aa-486e-9ebb-b136d6a60542', 'a8758cd8-93a4-4349-bb6e-49b368ca4d0c', '8a6513cf-56b9-448f-b3f5-8e8ce81584fd'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:36:50 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-dc6f51b0-a100-4cd6-a139-0f2cdac44efa tempest-ProjectMemberTests-1852265171 None] Delete snapshot completed successfully. Sep 28 17:36:50 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-dc6f51b0-a100-4cd6-a139-0f2cdac44efa tempest-ProjectMemberTests-1852265171 None] Lock "cinder-ad268dd5-6975-4ed3-aa88-37641c11f425-delete_snapshot" released by "delete_snapshot" :: held 2.118s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:50 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-4b4c9792-b5e8-4367-a782-ec5a6003e7aa tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-bbde210b-a50a-4ae5-836c-eb15015d0a2d-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:50 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-4b4c9792-b5e8-4367-a782-ec5a6003e7aa tempest-ProjectMemberTests-1852265171 None] Lock "cinder-bbde210b-a50a-4ae5-836c-eb15015d0a2d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:50 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-4b4c9792-b5e8-4367-a782-ec5a6003e7aa tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-quobyte-bbde210b-a50a-4ae5-836c-eb15015d0a2d" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:50 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-4b4c9792-b5e8-4367-a782-ec5a6003e7aa tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-bbde210b-a50a-4ae5-836c-eb15015d0a2d" acquired by "delete_volume" :: waited 0.021s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:50 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4464c723-a35d-48d5-b357-4abee4ba7373]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4b4c9792-b5e8-4367-a782-ec5a6003e7aa tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:50 devstack sudo[108818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d Sep 28 17:36:50 devstack sudo[108818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:50 devstack sudo[108818]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4b4c9792-b5e8-4367-a782-ec5a6003e7aa tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d" returned: 0 in 0.463s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4b4c9792-b5e8-4367-a782-ec5a6003e7aa tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:51 devstack sudo[108823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d Sep 28 17:36:51 devstack sudo[108823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-de1ec2c8-d130-4a95-9a5c-fe455cf5dffe tempest-SnapshotDependencyTests-260039155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-de1ec2c8-d130-4a95-9a5c-fe455cf5dffe tempest-SnapshotDependencyTests-260039155 None] Flow 'volume_create_manager' (716c3f2a-665d-4158-bb5e-744de883d9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-de1ec2c8-d130-4a95-9a5c-fe455cf5dffe tempest-SnapshotDependencyTests-260039155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1204d37-a9f7-4cd4-847d-64086004fd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-de1ec2c8-d130-4a95-9a5c-fe455cf5dffe tempest-SnapshotDependencyTests-260039155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1204d37-a9f7-4cd4-847d-64086004fd1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-208136976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21f8286f-4ecd-408b-9ec5-2d35936187c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4ec46f48d544b88b132e884503dbe87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:36:51Z,use_quota=True,user_id='274620d0c938435db8001a53f3d2c078',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-de1ec2c8-d130-4a95-9a5c-fe455cf5dffe tempest-SnapshotDependencyTests-260039155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba954e9b-536b-4d90-bca7-875f1f63d193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-de1ec2c8-d130-4a95-9a5c-fe455cf5dffe tempest-SnapshotDependencyTests-260039155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba954e9b-536b-4d90-bca7-875f1f63d193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-de1ec2c8-d130-4a95-9a5c-fe455cf5dffe tempest-SnapshotDependencyTests-260039155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad8b5418-a026-4a33-a743-b15b54e41d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-de1ec2c8-d130-4a95-9a5c-fe455cf5dffe tempest-SnapshotDependencyTests-260039155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad8b5418-a026-4a33-a743-b15b54e41d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21f8286f-4ecd-408b-9ec5-2d35936187c5', 'volume_name': 'volume-21f8286f-4ecd-408b-9ec5-2d35936187c5', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-de1ec2c8-d130-4a95-9a5c-fe455cf5dffe tempest-SnapshotDependencyTests-260039155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33568665-2a38-4417-ba20-00db3a6b939d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-de1ec2c8-d130-4a95-9a5c-fe455cf5dffe tempest-SnapshotDependencyTests-260039155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33568665-2a38-4417-ba20-00db3a6b939d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-de1ec2c8-d130-4a95-9a5c-fe455cf5dffe tempest-SnapshotDependencyTests-260039155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12e86191-e8aa-41ed-92aa-c8f4f3c0ab27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:51 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-de1ec2c8-d130-4a95-9a5c-fe455cf5dffe tempest-SnapshotDependencyTests-260039155 None] Volume 21f8286f-4ecd-408b-9ec5-2d35936187c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21f8286f-4ecd-408b-9ec5-2d35936187c5', 'volume_size': 1} Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-de1ec2c8-d130-4a95-9a5c-fe455cf5dffe tempest-SnapshotDependencyTests-260039155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-de1ec2c8-d130-4a95-9a5c-fe455cf5dffe tempest-SnapshotDependencyTests-260039155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-de1ec2c8-d130-4a95-9a5c-fe455cf5dffe tempest-SnapshotDependencyTests-260039155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-208136976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21f8286f-4ecd-408b-9ec5-2d35936187c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4ec46f48d544b88b132e884503dbe87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:36:51Z,use_quota=True,user_id='274620d0c938435db8001a53f3d2c078',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-de1ec2c8-d130-4a95-9a5c-fe455cf5dffe tempest-SnapshotDependencyTests-260039155 None] Creating volume 21f8286f-4ecd-408b-9ec5-2d35936187c5 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-de1ec2c8-d130-4a95-9a5c-fe455cf5dffe tempest-SnapshotDependencyTests-260039155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-de1ec2c8-d130-4a95-9a5c-fe455cf5dffe tempest-SnapshotDependencyTests-260039155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-de1ec2c8-d130-4a95-9a5c-fe455cf5dffe tempest-SnapshotDependencyTests-260039155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-de1ec2c8-d130-4a95-9a5c-fe455cf5dffe tempest-SnapshotDependencyTests-260039155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-de1ec2c8-d130-4a95-9a5c-fe455cf5dffe tempest-SnapshotDependencyTests-260039155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-de1ec2c8-d130-4a95-9a5c-fe455cf5dffe tempest-SnapshotDependencyTests-260039155 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:36:51 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-de1ec2c8-d130-4a95-9a5c-fe455cf5dffe tempest-SnapshotDependencyTests-260039155 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-de1ec2c8-d130-4a95-9a5c-fe455cf5dffe tempest-SnapshotDependencyTests-260039155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:51 devstack sudo[108825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5 1073741824 Sep 28 17:36:51 devstack sudo[108825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:51 devstack sudo[108823]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4b4c9792-b5e8-4367-a782-ec5a6003e7aa tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-bbde210b-a50a-4ae5-836c-eb15015d0a2d" returned: 0 in 0.276s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-4b4c9792-b5e8-4367-a782-ec5a6003e7aa tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-bbde210b-a50a-4ae5-836c-eb15015d0a2d" released by "delete_volume" :: held 0.807s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-4b4c9792-b5e8-4367-a782-ec5a6003e7aa tempest-ProjectMemberTests-1852265171 None] Created reservations ['3fbfd8fb-d285-4baa-9d44-0ab9ee134072', '5129d9e5-2fbd-4489-a5c1-925c1e94e935', 'f37b656c-0598-493e-b4b9-cadfd1f1c6a0', 'ebfcf37c-fade-40e7-bfcd-791b6240cfe8'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4b4c9792-b5e8-4367-a782-ec5a6003e7aa tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4b4c9792-b5e8-4367-a782-ec5a6003e7aa tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4b4c9792-b5e8-4367-a782-ec5a6003e7aa tempest-ProjectMemberTests-1852265171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-4b4c9792-b5e8-4367-a782-ec5a6003e7aa tempest-ProjectMemberTests-1852265171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4b4c9792-b5e8-4367-a782-ec5a6003e7aa tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4b4c9792-b5e8-4367-a782-ec5a6003e7aa tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:51 devstack sudo[108833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:36:51 devstack sudo[108833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:51 devstack sudo[108825]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-de1ec2c8-d130-4a95-9a5c-fe455cf5dffe tempest-SnapshotDependencyTests-260039155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5 1073741824" returned: 0 in 0.470s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-de1ec2c8-d130-4a95-9a5c-fe455cf5dffe tempest-SnapshotDependencyTests-260039155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:51 devstack sudo[108835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5 Sep 28 17:36:51 devstack sudo[108835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:51 devstack sudo[108833]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4b4c9792-b5e8-4367-a782-ec5a6003e7aa tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.302s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-4b4c9792-b5e8-4367-a782-ec5a6003e7aa tempest-ProjectMemberTests-1852265171 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:36:51 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-4b4c9792-b5e8-4367-a782-ec5a6003e7aa tempest-ProjectMemberTests-1852265171 None] Deleted volume successfully. Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-4b4c9792-b5e8-4367-a782-ec5a6003e7aa tempest-ProjectMemberTests-1852265171 None] Lock "cinder-bbde210b-a50a-4ae5-836c-eb15015d0a2d-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:51 devstack sudo[108835]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-de1ec2c8-d130-4a95-9a5c-fe455cf5dffe tempest-SnapshotDependencyTests-260039155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5" returned: 0 in 0.275s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-de1ec2c8-d130-4a95-9a5c-fe455cf5dffe tempest-SnapshotDependencyTests-260039155 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:36:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-de1ec2c8-d130-4a95-9a5c-fe455cf5dffe tempest-SnapshotDependencyTests-260039155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-de1ec2c8-d130-4a95-9a5c-fe455cf5dffe tempest-SnapshotDependencyTests-260039155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12e86191-e8aa-41ed-92aa-c8f4f3c0ab27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21f8286f-4ecd-408b-9ec5-2d35936187c5', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-de1ec2c8-d130-4a95-9a5c-fe455cf5dffe tempest-SnapshotDependencyTests-260039155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee1837bd-5689-41a6-af13-e6ae83cf0737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:52 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-de1ec2c8-d130-4a95-9a5c-fe455cf5dffe tempest-SnapshotDependencyTests-260039155 None] Volume volume-21f8286f-4ecd-408b-9ec5-2d35936187c5 (21f8286f-4ecd-408b-9ec5-2d35936187c5): created successfully Sep 28 17:36:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-de1ec2c8-d130-4a95-9a5c-fe455cf5dffe tempest-SnapshotDependencyTests-260039155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee1837bd-5689-41a6-af13-e6ae83cf0737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-de1ec2c8-d130-4a95-9a5c-fe455cf5dffe tempest-SnapshotDependencyTests-260039155 None] Flow 'volume_create_manager' (716c3f2a-665d-4158-bb5e-744de883d9e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:36:52 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-de1ec2c8-d130-4a95-9a5c-fe455cf5dffe tempest-SnapshotDependencyTests-260039155 None] Created volume successfully. Sep 28 17:36:52 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3b74120-2ccd-47fb-80c6-b87de9add2ec tempest-ProjectMemberTests-1852265171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:36:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a3b74120-2ccd-47fb-80c6-b87de9add2ec tempest-ProjectMemberTests-1852265171 None] Flow 'volume_create_manager' (30b0aff3-c1ed-498a-a132-66a89ee1bea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:36:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a3b74120-2ccd-47fb-80c6-b87de9add2ec tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53d7d047-86de-4e31-a8e7-481ff237b2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a3b74120-2ccd-47fb-80c6-b87de9add2ec tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53d7d047-86de-4e31-a8e7-481ff237b2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-526996717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1140c2f3-3d94-469f-b13d-82c5fb11e9d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e19b5535dc4ca0a0b3b833ab1e8248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:36:52Z,use_quota=True,user_id='56b2bce1c2e2420fb799c45cd8c3987f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a3b74120-2ccd-47fb-80c6-b87de9add2ec tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e2d9af0-c4e9-4b28-9212-be6eddcc3c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a3b74120-2ccd-47fb-80c6-b87de9add2ec tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e2d9af0-c4e9-4b28-9212-be6eddcc3c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a3b74120-2ccd-47fb-80c6-b87de9add2ec tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c01f923-5dbd-40c9-a7a3-7ad6daf0e63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a3b74120-2ccd-47fb-80c6-b87de9add2ec tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c01f923-5dbd-40c9-a7a3-7ad6daf0e63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1140c2f3-3d94-469f-b13d-82c5fb11e9d0', 'volume_name': 'volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a3b74120-2ccd-47fb-80c6-b87de9add2ec tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3614938-0a37-46fd-a6c8-b05df7af705f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a3b74120-2ccd-47fb-80c6-b87de9add2ec tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3614938-0a37-46fd-a6c8-b05df7af705f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a3b74120-2ccd-47fb-80c6-b87de9add2ec tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27aad653-c5e1-471f-a7b2-db8dbe4488be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:52 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-a3b74120-2ccd-47fb-80c6-b87de9add2ec tempest-ProjectMemberTests-1852265171 None] Volume 1140c2f3-3d94-469f-b13d-82c5fb11e9d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0', 'volume_size': 1} Sep 28 17:36:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a3b74120-2ccd-47fb-80c6-b87de9add2ec tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a3b74120-2ccd-47fb-80c6-b87de9add2ec tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a3b74120-2ccd-47fb-80c6-b87de9add2ec tempest-ProjectMemberTests-1852265171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-526996717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1140c2f3-3d94-469f-b13d-82c5fb11e9d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e19b5535dc4ca0a0b3b833ab1e8248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:36:52Z,use_quota=True,user_id='56b2bce1c2e2420fb799c45cd8c3987f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:36:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-a3b74120-2ccd-47fb-80c6-b87de9add2ec tempest-ProjectMemberTests-1852265171 None] Creating volume 1140c2f3-3d94-469f-b13d-82c5fb11e9d0 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:36:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a3b74120-2ccd-47fb-80c6-b87de9add2ec tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a3b74120-2ccd-47fb-80c6-b87de9add2ec tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a3b74120-2ccd-47fb-80c6-b87de9add2ec tempest-ProjectMemberTests-1852265171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:36:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a3b74120-2ccd-47fb-80c6-b87de9add2ec tempest-ProjectMemberTests-1852265171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:36:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a3b74120-2ccd-47fb-80c6-b87de9add2ec tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a3b74120-2ccd-47fb-80c6-b87de9add2ec tempest-ProjectMemberTests-1852265171 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:36:52 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-a3b74120-2ccd-47fb-80c6-b87de9add2ec tempest-ProjectMemberTests-1852265171 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:36:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a3b74120-2ccd-47fb-80c6-b87de9add2ec tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:52 devstack sudo[108839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0 1073741824 Sep 28 17:36:52 devstack sudo[108839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:52 devstack sudo[108839]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a3b74120-2ccd-47fb-80c6-b87de9add2ec tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0 1073741824" returned: 0 in 0.425s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a3b74120-2ccd-47fb-80c6-b87de9add2ec tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:52 devstack sudo[108844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0 Sep 28 17:36:52 devstack sudo[108844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:52 devstack sudo[108844]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a3b74120-2ccd-47fb-80c6-b87de9add2ec tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0" returned: 0 in 0.241s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a3b74120-2ccd-47fb-80c6-b87de9add2ec tempest-ProjectMemberTests-1852265171 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:36:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a3b74120-2ccd-47fb-80c6-b87de9add2ec tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a3b74120-2ccd-47fb-80c6-b87de9add2ec tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27aad653-c5e1-471f-a7b2-db8dbe4488be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a3b74120-2ccd-47fb-80c6-b87de9add2ec tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4499b22-9a04-4120-b28a-37541862972c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:52 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-a3b74120-2ccd-47fb-80c6-b87de9add2ec tempest-ProjectMemberTests-1852265171 None] Volume volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0 (1140c2f3-3d94-469f-b13d-82c5fb11e9d0): created successfully Sep 28 17:36:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a3b74120-2ccd-47fb-80c6-b87de9add2ec tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4499b22-9a04-4120-b28a-37541862972c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:52 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a3b74120-2ccd-47fb-80c6-b87de9add2ec tempest-ProjectMemberTests-1852265171 None] Flow 'volume_create_manager' (30b0aff3-c1ed-498a-a132-66a89ee1bea0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:36:52 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-a3b74120-2ccd-47fb-80c6-b87de9add2ec tempest-ProjectMemberTests-1852265171 None] Created volume successfully. Sep 28 17:36:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-16befbc7-e9fb-448d-9d29-db0f99f9f36a tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-16befbc7-e9fb-448d-9d29-db0f99f9f36a tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:53 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-16befbc7-e9fb-448d-9d29-db0f99f9f36a tempest-ProjectMemberTests-1852265171 None] Creating offline snapshot d67e7184-e400-40e8-a261-c2580c674c4a of volume 1140c2f3-3d94-469f-b13d-82c5fb11e9d0 {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:36:53 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d5b46a-aee0-47d2-8452-586ef42e238c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-16befbc7-e9fb-448d-9d29-db0f99f9f36a tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:53 devstack sudo[108847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0 Sep 28 17:36:53 devstack sudo[108847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4ed6df63-a56e-4675-87b2-b2151b3e9c0f tempest-SnapshotDependencyTests-260039155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:53 devstack sudo[108847]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-16befbc7-e9fb-448d-9d29-db0f99f9f36a tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0" returned: 0 in 0.363s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-16befbc7-e9fb-448d-9d29-db0f99f9f36a tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0.d67e7184-e400-40e8-a261-c2580c674c4a 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:53 devstack sudo[108852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0.d67e7184-e400-40e8-a261-c2580c674c4a 1G Sep 28 17:36:53 devstack sudo[108852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:54 devstack sudo[108852]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-16befbc7-e9fb-448d-9d29-db0f99f9f36a tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0.d67e7184-e400-40e8-a261-c2580c674c4a 1G" returned: 0 in 0.380s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-16befbc7-e9fb-448d-9d29-db0f99f9f36a tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0.d67e7184-e400-40e8-a261-c2580c674c4a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:54 devstack sudo[108857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0.d67e7184-e400-40e8-a261-c2580c674c4a Sep 28 17:36:54 devstack sudo[108857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:54 devstack sudo[108857]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-16befbc7-e9fb-448d-9d29-db0f99f9f36a tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0.d67e7184-e400-40e8-a261-c2580c674c4a" returned: 0 in 0.278s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:54 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-16befbc7-e9fb-448d-9d29-db0f99f9f36a tempest-ProjectMemberTests-1852265171 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0.d67e7184-e400-40e8-a261-c2580c674c4a is being set with open permissions: ugo+rw Sep 28 17:36:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-16befbc7-e9fb-448d-9d29-db0f99f9f36a tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0.d67e7184-e400-40e8-a261-c2580c674c4a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:54 devstack sudo[108862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0.d67e7184-e400-40e8-a261-c2580c674c4a Sep 28 17:36:54 devstack sudo[108862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:54 devstack sudo[108862]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-16befbc7-e9fb-448d-9d29-db0f99f9f36a tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0.d67e7184-e400-40e8-a261-c2580c674c4a" returned: 0 in 0.252s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-16befbc7-e9fb-448d-9d29-db0f99f9f36a tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:54 devstack sudo[108865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0.info Sep 28 17:36:54 devstack sudo[108865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:54 devstack sudo[108865]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-16befbc7-e9fb-448d-9d29-db0f99f9f36a tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0.info" returned: 0 in 0.239s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:54 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-16befbc7-e9fb-448d-9d29-db0f99f9f36a tempest-ProjectMemberTests-1852265171 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0.info is being set with open permissions: ugo+rw Sep 28 17:36:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-16befbc7-e9fb-448d-9d29-db0f99f9f36a tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:54 devstack sudo[108868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0.info Sep 28 17:36:54 devstack sudo[108868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:55 devstack sudo[108868]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-16befbc7-e9fb-448d-9d29-db0f99f9f36a tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0.info" returned: 0 in 0.240s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-16befbc7-e9fb-448d-9d29-db0f99f9f36a tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.841s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4ed6df63-a56e-4675-87b2-b2151b3e9c0f tempest-SnapshotDependencyTests-260039155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.661s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:55 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-4ed6df63-a56e-4675-87b2-b2151b3e9c0f tempest-SnapshotDependencyTests-260039155 None] Creating offline snapshot 1ab86e71-8241-46e1-95fb-a43874e981d0 of volume 21f8286f-4ecd-408b-9ec5-2d35936187c5 {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:36:55 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-16befbc7-e9fb-448d-9d29-db0f99f9f36a tempest-ProjectMemberTests-1852265171 None] Create snapshot completed successfully Sep 28 17:36:55 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a821df0e-371e-4f5b-a120-0d0e39a90662]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4ed6df63-a56e-4675-87b2-b2151b3e9c0f tempest-SnapshotDependencyTests-260039155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:55 devstack sudo[108871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5 Sep 28 17:36:55 devstack sudo[108871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:55 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d5b147ff-89e7-42a5-a3ff-acc97f972d5b tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-d67e7184-e400-40e8-a261-c2580c674c4a-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:55 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d5b147ff-89e7-42a5-a3ff-acc97f972d5b tempest-ProjectMemberTests-1852265171 None] Lock "cinder-d67e7184-e400-40e8-a261-c2580c674c4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:55 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d5b147ff-89e7-42a5-a3ff-acc97f972d5b tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-quobyte-1140c2f3-3d94-469f-b13d-82c5fb11e9d0" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:55 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d5b147ff-89e7-42a5-a3ff-acc97f972d5b tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-1140c2f3-3d94-469f-b13d-82c5fb11e9d0" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:55 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d5b147ff-89e7-42a5-a3ff-acc97f972d5b tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-quobyte-d67e7184-e400-40e8-a261-c2580c674c4a" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:55 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d5b147ff-89e7-42a5-a3ff-acc97f972d5b tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-d67e7184-e400-40e8-a261-c2580c674c4a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:55 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-d5b147ff-89e7-42a5-a3ff-acc97f972d5b tempest-ProjectMemberTests-1852265171 None] Deleting offline snapshot d67e7184-e400-40e8-a261-c2580c674c4a of volume 1140c2f3-3d94-469f-b13d-82c5fb11e9d0 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:36:55 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-d5b147ff-89e7-42a5-a3ff-acc97f972d5b tempest-ProjectMemberTests-1852265171 None] snapshot_file for this snap is: volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0.d67e7184-e400-40e8-a261-c2580c674c4a {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:36:55 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73a3385-6387-442e-bee7-0bd9ed74e878]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d5b147ff-89e7-42a5-a3ff-acc97f972d5b tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0.d67e7184-e400-40e8-a261-c2580c674c4a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:55 devstack sudo[108871]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4ed6df63-a56e-4675-87b2-b2151b3e9c0f tempest-SnapshotDependencyTests-260039155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5" returned: 0 in 0.378s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4ed6df63-a56e-4675-87b2-b2151b3e9c0f tempest-SnapshotDependencyTests-260039155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5.1ab86e71-8241-46e1-95fb-a43874e981d0 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:55 devstack sudo[108877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5.1ab86e71-8241-46e1-95fb-a43874e981d0 1G Sep 28 17:36:55 devstack sudo[108877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:55 devstack sudo[108876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0.d67e7184-e400-40e8-a261-c2580c674c4a Sep 28 17:36:55 devstack sudo[108876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:55 devstack sudo[108876]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d5b147ff-89e7-42a5-a3ff-acc97f972d5b tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0.d67e7184-e400-40e8-a261-c2580c674c4a" returned: 0 in 0.359s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:55 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-d5b147ff-89e7-42a5-a3ff-acc97f972d5b tempest-ProjectMemberTests-1852265171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:36:55 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc145d2-ac65-4796-85ad-72a327c9c80d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d5b147ff-89e7-42a5-a3ff-acc97f972d5b tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:55 devstack sudo[108877]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4ed6df63-a56e-4675-87b2-b2151b3e9c0f tempest-SnapshotDependencyTests-260039155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5.1ab86e71-8241-46e1-95fb-a43874e981d0 1G" returned: 0 in 0.395s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4ed6df63-a56e-4675-87b2-b2151b3e9c0f tempest-SnapshotDependencyTests-260039155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21f8286f-4ecd-408b-9ec5-2d35936187c5 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5.1ab86e71-8241-46e1-95fb-a43874e981d0 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:55 devstack sudo[108887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21f8286f-4ecd-408b-9ec5-2d35936187c5 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5.1ab86e71-8241-46e1-95fb-a43874e981d0 Sep 28 17:36:55 devstack sudo[108887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:56 devstack sudo[108886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0 Sep 28 17:36:56 devstack sudo[108886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:56 devstack sudo[108887]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4ed6df63-a56e-4675-87b2-b2151b3e9c0f tempest-SnapshotDependencyTests-260039155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21f8286f-4ecd-408b-9ec5-2d35936187c5 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5.1ab86e71-8241-46e1-95fb-a43874e981d0" returned: 0 in 0.295s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:56 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-4ed6df63-a56e-4675-87b2-b2151b3e9c0f tempest-SnapshotDependencyTests-260039155 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5.1ab86e71-8241-46e1-95fb-a43874e981d0 is being set with open permissions: ugo+rw Sep 28 17:36:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4ed6df63-a56e-4675-87b2-b2151b3e9c0f tempest-SnapshotDependencyTests-260039155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5.1ab86e71-8241-46e1-95fb-a43874e981d0 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:56 devstack sudo[108896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5.1ab86e71-8241-46e1-95fb-a43874e981d0 Sep 28 17:36:56 devstack sudo[108896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:56 devstack sudo[108886]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d5b147ff-89e7-42a5-a3ff-acc97f972d5b tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0" returned: 0 in 0.370s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d5b147ff-89e7-42a5-a3ff-acc97f972d5b tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0.d67e7184-e400-40e8-a261-c2580c674c4a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:56 devstack sudo[108898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0.d67e7184-e400-40e8-a261-c2580c674c4a Sep 28 17:36:56 devstack sudo[108898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:56 devstack sudo[108896]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4ed6df63-a56e-4675-87b2-b2151b3e9c0f tempest-SnapshotDependencyTests-260039155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5.1ab86e71-8241-46e1-95fb-a43874e981d0" returned: 0 in 0.271s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4ed6df63-a56e-4675-87b2-b2151b3e9c0f tempest-SnapshotDependencyTests-260039155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:56 devstack sudo[108905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5.info Sep 28 17:36:56 devstack sudo[108905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:56 devstack sudo[108898]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d5b147ff-89e7-42a5-a3ff-acc97f972d5b tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0.d67e7184-e400-40e8-a261-c2580c674c4a" returned: 0 in 0.347s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d5b147ff-89e7-42a5-a3ff-acc97f972d5b tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0.d67e7184-e400-40e8-a261-c2580c674c4a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:56 devstack sudo[108907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0.d67e7184-e400-40e8-a261-c2580c674c4a Sep 28 17:36:56 devstack sudo[108907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:56 devstack sudo[108905]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4ed6df63-a56e-4675-87b2-b2151b3e9c0f tempest-SnapshotDependencyTests-260039155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5.info" returned: 0 in 0.280s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:56 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-4ed6df63-a56e-4675-87b2-b2151b3e9c0f tempest-SnapshotDependencyTests-260039155 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5.info is being set with open permissions: ugo+rw Sep 28 17:36:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4ed6df63-a56e-4675-87b2-b2151b3e9c0f tempest-SnapshotDependencyTests-260039155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:56 devstack sudo[108911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5.info Sep 28 17:36:56 devstack sudo[108911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:56 devstack sudo[108907]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-d5b147ff-89e7-42a5-a3ff-acc97f972d5b tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0.d67e7184-e400-40e8-a261-c2580c674c4a" returned: 0 in 0.260s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:56 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d5b147ff-89e7-42a5-a3ff-acc97f972d5b tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-d67e7184-e400-40e8-a261-c2580c674c4a" released by "_delete_snapshot" :: held 1.450s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:56 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d5b147ff-89e7-42a5-a3ff-acc97f972d5b tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-1140c2f3-3d94-469f-b13d-82c5fb11e9d0" released by "delete_snapshot" :: held 1.476s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:56 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-d5b147ff-89e7-42a5-a3ff-acc97f972d5b tempest-ProjectMemberTests-1852265171 None] Created reservations ['a361dab0-5b4a-492b-9f99-805db11fad82', 'b03b1022-9be9-4fad-8f62-d0f0194b0b91', '5aafef4c-c6e5-4329-bb15-7c39d9096543', '6ccd9c31-99d2-4dcf-9a99-fe7c87d90437'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:36:57 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-d5b147ff-89e7-42a5-a3ff-acc97f972d5b tempest-ProjectMemberTests-1852265171 None] Delete snapshot completed successfully. Sep 28 17:36:57 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-d5b147ff-89e7-42a5-a3ff-acc97f972d5b tempest-ProjectMemberTests-1852265171 None] Lock "cinder-d67e7184-e400-40e8-a261-c2580c674c4a-delete_snapshot" released by "delete_snapshot" :: held 1.624s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:57 devstack sudo[108911]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4ed6df63-a56e-4675-87b2-b2151b3e9c0f tempest-SnapshotDependencyTests-260039155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5.info" returned: 0 in 0.286s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4ed6df63-a56e-4675-87b2-b2151b3e9c0f tempest-SnapshotDependencyTests-260039155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.006s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:57 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-4ed6df63-a56e-4675-87b2-b2151b3e9c0f tempest-SnapshotDependencyTests-260039155 None] Create snapshot completed successfully Sep 28 17:36:57 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0c146759-036e-458f-abb3-0a8240465eeb tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-1140c2f3-3d94-469f-b13d-82c5fb11e9d0-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:57 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0c146759-036e-458f-abb3-0a8240465eeb tempest-ProjectMemberTests-1852265171 None] Lock "cinder-1140c2f3-3d94-469f-b13d-82c5fb11e9d0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:57 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0c146759-036e-458f-abb3-0a8240465eeb tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-quobyte-1140c2f3-3d94-469f-b13d-82c5fb11e9d0" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:57 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0c146759-036e-458f-abb3-0a8240465eeb tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-1140c2f3-3d94-469f-b13d-82c5fb11e9d0" acquired by "delete_volume" :: waited 0.018s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:57 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc694e47-2ed7-4d51-9164-0d41aba01c3b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0c146759-036e-458f-abb3-0a8240465eeb tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:57 devstack sudo[108914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0 Sep 28 17:36:57 devstack sudo[108914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:58 devstack sudo[108914]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0c146759-036e-458f-abb3-0a8240465eeb tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0" returned: 0 in 0.385s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0c146759-036e-458f-abb3-0a8240465eeb tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:58 devstack sudo[108920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0 Sep 28 17:36:58 devstack sudo[108920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Flow 'volume_create_manager' (024334d3-a287-43af-8bb9-15fc41ed2add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66588e02-4dc2-4fe7-841e-a80644291f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66588e02-4dc2-4fe7-841e-a80644291f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d019ec7-6612-409b-a6b3-89dcd6d2533f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4ec46f48d544b88b132e884503dbe87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1ab86e71-8241-46e1-95fb-a43874e981d0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:36:58Z,use_quota=True,user_id='274620d0c938435db8001a53f3d2c078',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66aabc73-da42-40f3-bb08-b39501ae6c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66aabc73-da42-40f3-bb08-b39501ae6c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36530d34-42aa-47fb-80ab-e45e4379997f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36530d34-42aa-47fb-80ab-e45e4379997f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3d019ec7-6612-409b-a6b3-89dcd6d2533f', 'volume_name': 'volume-3d019ec7-6612-409b-a6b3-89dcd6d2533f', 'volume_size': 1, 'snapshot_id': '1ab86e71-8241-46e1-95fb-a43874e981d0'}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9162fe1a-603f-4dc2-a17a-30160c6d4c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9162fe1a-603f-4dc2-a17a-30160c6d4c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e4dc65d-9bbe-46e8-b7fc-f38f0bb76794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:58 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Volume 3d019ec7-6612-409b-a6b3-89dcd6d2533f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3d019ec7-6612-409b-a6b3-89dcd6d2533f', 'volume_size': 1, 'snapshot_id': '1ab86e71-8241-46e1-95fb-a43874e981d0'} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Acquiring lock "cinder-quobyte-1ab86e71-8241-46e1-95fb-a43874e981d0-3d019ec7-6612-409b-a6b3-89dcd6d2533f" by "_create_volume_from_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:58 devstack sudo[108920]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0c146759-036e-458f-abb3-0a8240465eeb tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-1140c2f3-3d94-469f-b13d-82c5fb11e9d0" returned: 0 in 0.265s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Lock "cinder-quobyte-1ab86e71-8241-46e1-95fb-a43874e981d0-3d019ec7-6612-409b-a6b3-89dcd6d2533f" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Creating volume 3d019ec7-6612-409b-a6b3-89dcd6d2533f from snapshot 1ab86e71-8241-46e1-95fb-a43874e981d0 {{(pid=86917) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Acquiring lock "cinder-quobyte-3d019ec7-6612-409b-a6b3-89dcd6d2533f" by "_copy_volume_from_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0c146759-036e-458f-abb3-0a8240465eeb tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-1140c2f3-3d94-469f-b13d-82c5fb11e9d0" released by "delete_volume" :: held 0.733s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Lock "cinder-quobyte-3d019ec7-6612-409b-a6b3-89dcd6d2533f" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] snapshot: 1ab86e71-8241-46e1-95fb-a43874e981d0, volume: 3d019ec7-6612-409b-a6b3-89dcd6d2533f, {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc4758c-f089-40dd-b2ca-699d7e12eac8]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5.1ab86e71-8241-46e1-95fb-a43874e981d0 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-0c146759-036e-458f-abb3-0a8240465eeb tempest-ProjectMemberTests-1852265171 None] Created reservations ['8d9d54de-5889-4100-8641-f7f986c4d94a', '74dae8cd-f4c5-402b-85af-aac8e7928863', '8e1b778a-de5f-4c7c-8dc9-d98baf1a6c06', '1a52c53d-1227-47f1-9e95-f5c1f1188e26'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0c146759-036e-458f-abb3-0a8240465eeb tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0c146759-036e-458f-abb3-0a8240465eeb tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0c146759-036e-458f-abb3-0a8240465eeb tempest-ProjectMemberTests-1852265171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-0c146759-036e-458f-abb3-0a8240465eeb tempest-ProjectMemberTests-1852265171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-0c146759-036e-458f-abb3-0a8240465eeb tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0c146759-036e-458f-abb3-0a8240465eeb tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:58 devstack sudo[108923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5.1ab86e71-8241-46e1-95fb-a43874e981d0 Sep 28 17:36:58 devstack sudo[108923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:58 devstack sudo[108924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:36:58 devstack sudo[108924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:58 devstack sudo[108923]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5.1ab86e71-8241-46e1-95fb-a43874e981d0" returned: 0 in 0.377s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21f8286f-4ecd-408b-9ec5-2d35936187c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:36:58 devstack sudo[108924]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-0c146759-036e-458f-abb3-0a8240465eeb tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.279s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-0c146759-036e-458f-abb3-0a8240465eeb tempest-ProjectMemberTests-1852265171 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:36:58 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-0c146759-036e-458f-abb3-0a8240465eeb tempest-ProjectMemberTests-1852265171 None] Deleted volume successfully. Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd80ff80-21cd-4f19-a0ef-b649f340f667]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:58 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-0c146759-036e-458f-abb3-0a8240465eeb tempest-ProjectMemberTests-1852265171 None] Lock "cinder-1140c2f3-3d94-469f-b13d-82c5fb11e9d0-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:36:58 devstack sudo[108931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5 Sep 28 17:36:58 devstack sudo[108931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:59 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-a542b838-1989-44a4-b159-f7ed1c2ac790 tempest-ProjectMemberTests-1852265171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:36:59 devstack sudo[108931]: pam_unix(sudo:session): session closed for user root Sep 28 17:36:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a542b838-1989-44a4-b159-f7ed1c2ac790 tempest-ProjectMemberTests-1852265171 None] Flow 'volume_create_manager' (dfb07dab-7c64-432b-9591-e562a6e53e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:36:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a542b838-1989-44a4-b159-f7ed1c2ac790 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0445eadf-3922-452b-9b80-52aeebbeb60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5" returned: 0 in 0.459s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:36:59 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5 {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:36:59 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Creating direct copy from snapshot {{(pid=86917) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:36:59 devstack cinder-volume[86917]: DEBUG cinder.utils [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Path /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3d019ec7-6612-409b-a6b3-89dcd6d2533f not found in is_blk_device check {{(pid=86917) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:36:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3d019ec7-6612-409b-a6b3-89dcd6d2533f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:36:59 devstack sudo[108936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3d019ec7-6612-409b-a6b3-89dcd6d2533f Sep 28 17:36:59 devstack sudo[108936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:36:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a542b838-1989-44a4-b159-f7ed1c2ac790 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0445eadf-3922-452b-9b80-52aeebbeb60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1145496941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e821c726-3203-4ee4-b138-0d4da01b8928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e19b5535dc4ca0a0b3b833ab1e8248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:36:59Z,use_quota=True,user_id='56b2bce1c2e2420fb799c45cd8c3987f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a542b838-1989-44a4-b159-f7ed1c2ac790 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb7a095-6fc7-4a42-9aee-945e03b1fe76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a542b838-1989-44a4-b159-f7ed1c2ac790 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb7a095-6fc7-4a42-9aee-945e03b1fe76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a542b838-1989-44a4-b159-f7ed1c2ac790 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e661a4-4404-4d66-89b4-ff0ec4e9d9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a542b838-1989-44a4-b159-f7ed1c2ac790 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e661a4-4404-4d66-89b4-ff0ec4e9d9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e821c726-3203-4ee4-b138-0d4da01b8928', 'volume_name': 'volume-e821c726-3203-4ee4-b138-0d4da01b8928', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a542b838-1989-44a4-b159-f7ed1c2ac790 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33eb7c2e-041c-40d6-866d-5e19b6e83161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a542b838-1989-44a4-b159-f7ed1c2ac790 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33eb7c2e-041c-40d6-866d-5e19b6e83161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:36:59 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a542b838-1989-44a4-b159-f7ed1c2ac790 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58a53c22-8dab-4d6b-b6ba-2bfb5ccd571d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:36:59 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-a542b838-1989-44a4-b159-f7ed1c2ac790 tempest-ProjectMemberTests-1852265171 None] Volume e821c726-3203-4ee4-b138-0d4da01b8928: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e821c726-3203-4ee4-b138-0d4da01b8928', 'volume_size': 1} Sep 28 17:36:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a542b838-1989-44a4-b159-f7ed1c2ac790 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:37:05 devstack sudo[108936]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3d019ec7-6612-409b-a6b3-89dcd6d2533f" returned: 0 in 5.883s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:05 devstack cinder-volume[86917]: DEBUG cinder.image.image_utils [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Image conversion details: src /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5, size 1024.00 MB, duration 5.88 sec, destination /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3d019ec7-6612-409b-a6b3-89dcd6d2533f {{(pid=86917) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:37:05 devstack cinder-volume[86917]: INFO cinder.image.image_utils [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Converted 1024.00 MB image at 174.04 MB/s Sep 28 17:37:05 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3d019ec7-6612-409b-a6b3-89dcd6d2533f is being set with open permissions: ugo+rw Sep 28 17:37:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3d019ec7-6612-409b-a6b3-89dcd6d2533f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:05 devstack sudo[108950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3d019ec7-6612-409b-a6b3-89dcd6d2533f Sep 28 17:37:05 devstack sudo[108950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:05 devstack sudo[108950]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3d019ec7-6612-409b-a6b3-89dcd6d2533f" returned: 0 in 0.273s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:05 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Lock "cinder-quobyte-3d019ec7-6612-409b-a6b3-89dcd6d2533f" released by "_copy_volume_from_snapshot" :: held 7.080s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:05 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Lock "cinder-quobyte-1ab86e71-8241-46e1-95fb-a43874e981d0-3d019ec7-6612-409b-a6b3-89dcd6d2533f" released by "_create_volume_from_snapshot" :: held 7.146s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.173s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:37:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a542b838-1989-44a4-b159-f7ed1c2ac790 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.142s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:37:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a542b838-1989-44a4-b159-f7ed1c2ac790 tempest-ProjectMemberTests-1852265171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1145496941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e821c726-3203-4ee4-b138-0d4da01b8928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e19b5535dc4ca0a0b3b833ab1e8248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:36:59Z,use_quota=True,user_id='56b2bce1c2e2420fb799c45cd8c3987f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:37:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-a542b838-1989-44a4-b159-f7ed1c2ac790 tempest-ProjectMemberTests-1852265171 None] Creating volume e821c726-3203-4ee4-b138-0d4da01b8928 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:37:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a542b838-1989-44a4-b159-f7ed1c2ac790 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:37:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a542b838-1989-44a4-b159-f7ed1c2ac790 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:37:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a542b838-1989-44a4-b159-f7ed1c2ac790 tempest-ProjectMemberTests-1852265171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:37:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a542b838-1989-44a4-b159-f7ed1c2ac790 tempest-ProjectMemberTests-1852265171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:37:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a542b838-1989-44a4-b159-f7ed1c2ac790 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:37:05 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a542b838-1989-44a4-b159-f7ed1c2ac790 tempest-ProjectMemberTests-1852265171 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:37:05 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-a542b838-1989-44a4-b159-f7ed1c2ac790 tempest-ProjectMemberTests-1852265171 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:37:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a542b838-1989-44a4-b159-f7ed1c2ac790 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:05 devstack sudo[108953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928 1073741824 Sep 28 17:37:05 devstack sudo[108953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e4dc65d-9bbe-46e8-b7fc-f38f0bb76794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d019ec7-6612-409b-a6b3-89dcd6d2533f', 'volume_size': 1, 'snapshot_id': '1ab86e71-8241-46e1-95fb-a43874e981d0'}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76bfc228-c924-46c6-b562-7fd6f0b3acb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:05 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Volume volume-3d019ec7-6612-409b-a6b3-89dcd6d2533f (3d019ec7-6612-409b-a6b3-89dcd6d2533f): created successfully Sep 28 17:37:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76bfc228-c924-46c6-b562-7fd6f0b3acb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:05 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Flow 'volume_create_manager' (024334d3-a287-43af-8bb9-15fc41ed2add) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:37:05 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-542c33c5-1ae0-4391-bfcc-5db3632252bf tempest-SnapshotDependencyTests-260039155 None] Created volume successfully. Sep 28 17:37:05 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-965dc974-c9bb-443f-becd-6a372bfc3711 tempest-SnapshotDependencyTests-260039155 None] Acquiring lock "cinder-1ab86e71-8241-46e1-95fb-a43874e981d0-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:06 devstack sudo[108953]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a542b838-1989-44a4-b159-f7ed1c2ac790 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928 1073741824" returned: 0 in 0.476s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:06 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-965dc974-c9bb-443f-becd-6a372bfc3711 tempest-SnapshotDependencyTests-260039155 None] Lock "cinder-1ab86e71-8241-46e1-95fb-a43874e981d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:06 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-965dc974-c9bb-443f-becd-6a372bfc3711 tempest-SnapshotDependencyTests-260039155 None] Acquiring lock "cinder-quobyte-21f8286f-4ecd-408b-9ec5-2d35936187c5" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:06 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-965dc974-c9bb-443f-becd-6a372bfc3711 tempest-SnapshotDependencyTests-260039155 None] Lock "cinder-quobyte-21f8286f-4ecd-408b-9ec5-2d35936187c5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:06 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-965dc974-c9bb-443f-becd-6a372bfc3711 tempest-SnapshotDependencyTests-260039155 None] Acquiring lock "cinder-quobyte-1ab86e71-8241-46e1-95fb-a43874e981d0" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:06 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-965dc974-c9bb-443f-becd-6a372bfc3711 tempest-SnapshotDependencyTests-260039155 None] Lock "cinder-quobyte-1ab86e71-8241-46e1-95fb-a43874e981d0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:06 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-965dc974-c9bb-443f-becd-6a372bfc3711 tempest-SnapshotDependencyTests-260039155 None] Deleting offline snapshot 1ab86e71-8241-46e1-95fb-a43874e981d0 of volume 21f8286f-4ecd-408b-9ec5-2d35936187c5 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:37:06 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-965dc974-c9bb-443f-becd-6a372bfc3711 tempest-SnapshotDependencyTests-260039155 None] snapshot_file for this snap is: volume-21f8286f-4ecd-408b-9ec5-2d35936187c5.1ab86e71-8241-46e1-95fb-a43874e981d0 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:37:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a542b838-1989-44a4-b159-f7ed1c2ac790 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:06 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20d3e7b-091e-413d-b72d-4c169dfb6f41]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:37:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-965dc974-c9bb-443f-becd-6a372bfc3711 tempest-SnapshotDependencyTests-260039155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5.1ab86e71-8241-46e1-95fb-a43874e981d0 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:06 devstack sudo[108959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928 Sep 28 17:37:06 devstack sudo[108959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:06 devstack sudo[108960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5.1ab86e71-8241-46e1-95fb-a43874e981d0 Sep 28 17:37:06 devstack sudo[108960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:06 devstack sudo[108959]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a542b838-1989-44a4-b159-f7ed1c2ac790 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928" returned: 0 in 0.246s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:06 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a542b838-1989-44a4-b159-f7ed1c2ac790 tempest-ProjectMemberTests-1852265171 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:37:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a542b838-1989-44a4-b159-f7ed1c2ac790 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:37:06 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a542b838-1989-44a4-b159-f7ed1c2ac790 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58a53c22-8dab-4d6b-b6ba-2bfb5ccd571d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e821c726-3203-4ee4-b138-0d4da01b8928', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:06 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a542b838-1989-44a4-b159-f7ed1c2ac790 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2a6891b-70a1-4a2c-8ad3-50cc7ddfe20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:06 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-a542b838-1989-44a4-b159-f7ed1c2ac790 tempest-ProjectMemberTests-1852265171 None] Volume volume-e821c726-3203-4ee4-b138-0d4da01b8928 (e821c726-3203-4ee4-b138-0d4da01b8928): created successfully Sep 28 17:37:06 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a542b838-1989-44a4-b159-f7ed1c2ac790 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2a6891b-70a1-4a2c-8ad3-50cc7ddfe20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:06 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a542b838-1989-44a4-b159-f7ed1c2ac790 tempest-ProjectMemberTests-1852265171 None] Flow 'volume_create_manager' (dfb07dab-7c64-432b-9591-e562a6e53e97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:37:06 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-a542b838-1989-44a4-b159-f7ed1c2ac790 tempest-ProjectMemberTests-1852265171 None] Created volume successfully. Sep 28 17:37:06 devstack sudo[108960]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-965dc974-c9bb-443f-becd-6a372bfc3711 tempest-SnapshotDependencyTests-260039155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5.1ab86e71-8241-46e1-95fb-a43874e981d0" returned: 0 in 0.377s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:06 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-965dc974-c9bb-443f-becd-6a372bfc3711 tempest-SnapshotDependencyTests-260039155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21f8286f-4ecd-408b-9ec5-2d35936187c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:37:06 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[626a5975-f613-4895-a555-3d5cdf6779c7]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:37:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-965dc974-c9bb-443f-becd-6a372bfc3711 tempest-SnapshotDependencyTests-260039155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:06 devstack sudo[108967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5 Sep 28 17:37:06 devstack sudo[108967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:07 devstack sudo[108967]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-965dc974-c9bb-443f-becd-6a372bfc3711 tempest-SnapshotDependencyTests-260039155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5" returned: 0 in 0.541s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-965dc974-c9bb-443f-becd-6a372bfc3711 tempest-SnapshotDependencyTests-260039155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5.1ab86e71-8241-46e1-95fb-a43874e981d0 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:07 devstack sudo[108972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5.1ab86e71-8241-46e1-95fb-a43874e981d0 Sep 28 17:37:07 devstack sudo[108972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9a09dc54-b3b0-461e-88c2-dea368d131fe tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:37:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9a09dc54-b3b0-461e-88c2-dea368d131fe tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:37:07 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-9a09dc54-b3b0-461e-88c2-dea368d131fe tempest-ProjectMemberTests-1852265171 None] Creating offline snapshot 883bf0a2-5594-47a1-8aec-5f3e1b970869 of volume e821c726-3203-4ee4-b138-0d4da01b8928 {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:37:07 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb72f075-403d-4fa7-ad04-629c89647865]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:37:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9a09dc54-b3b0-461e-88c2-dea368d131fe tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:07 devstack sudo[108974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928 Sep 28 17:37:07 devstack sudo[108974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:07 devstack sudo[108972]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-965dc974-c9bb-443f-becd-6a372bfc3711 tempest-SnapshotDependencyTests-260039155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5.1ab86e71-8241-46e1-95fb-a43874e981d0" returned: 0 in 0.361s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-965dc974-c9bb-443f-becd-6a372bfc3711 tempest-SnapshotDependencyTests-260039155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5.1ab86e71-8241-46e1-95fb-a43874e981d0 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:07 devstack sudo[108979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5.1ab86e71-8241-46e1-95fb-a43874e981d0 Sep 28 17:37:07 devstack sudo[108979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:07 devstack sudo[108974]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9a09dc54-b3b0-461e-88c2-dea368d131fe tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928" returned: 0 in 0.377s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9a09dc54-b3b0-461e-88c2-dea368d131fe tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928.883bf0a2-5594-47a1-8aec-5f3e1b970869 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:07 devstack sudo[108984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928.883bf0a2-5594-47a1-8aec-5f3e1b970869 1G Sep 28 17:37:07 devstack sudo[108984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:07 devstack sudo[108979]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-965dc974-c9bb-443f-becd-6a372bfc3711 tempest-SnapshotDependencyTests-260039155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5.1ab86e71-8241-46e1-95fb-a43874e981d0" returned: 0 in 0.258s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:07 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-965dc974-c9bb-443f-becd-6a372bfc3711 tempest-SnapshotDependencyTests-260039155 None] Lock "cinder-quobyte-1ab86e71-8241-46e1-95fb-a43874e981d0" released by "_delete_snapshot" :: held 1.643s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:07 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-965dc974-c9bb-443f-becd-6a372bfc3711 tempest-SnapshotDependencyTests-260039155 None] Lock "cinder-quobyte-21f8286f-4ecd-408b-9ec5-2d35936187c5" released by "delete_snapshot" :: held 1.667s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:07 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-965dc974-c9bb-443f-becd-6a372bfc3711 tempest-SnapshotDependencyTests-260039155 None] Created reservations ['bca28ad8-b478-4ae8-9ca1-25513d60f6b7', 'a6c8c864-fe26-4c78-b95f-5d23c003fae1', '6f72d8df-5082-43cc-984f-8c51c46f791e', '901243ce-84c9-492e-a70c-7ef4b1f0462c'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:37:07 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-965dc974-c9bb-443f-becd-6a372bfc3711 tempest-SnapshotDependencyTests-260039155 None] Delete snapshot completed successfully. Sep 28 17:37:07 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-965dc974-c9bb-443f-becd-6a372bfc3711 tempest-SnapshotDependencyTests-260039155 None] Lock "cinder-1ab86e71-8241-46e1-95fb-a43874e981d0-delete_snapshot" released by "delete_snapshot" :: held 1.810s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:07 devstack sudo[108984]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9a09dc54-b3b0-461e-88c2-dea368d131fe tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928.883bf0a2-5594-47a1-8aec-5f3e1b970869 1G" returned: 0 in 0.419s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9a09dc54-b3b0-461e-88c2-dea368d131fe tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e821c726-3203-4ee4-b138-0d4da01b8928 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928.883bf0a2-5594-47a1-8aec-5f3e1b970869 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:08 devstack sudo[108990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e821c726-3203-4ee4-b138-0d4da01b8928 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928.883bf0a2-5594-47a1-8aec-5f3e1b970869 Sep 28 17:37:08 devstack sudo[108990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:08 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b9958f0d-be8a-4c66-a843-4712c2f0cb46 tempest-SnapshotDependencyTests-260039155 None] Acquiring lock "cinder-21f8286f-4ecd-408b-9ec5-2d35936187c5-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:08 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b9958f0d-be8a-4c66-a843-4712c2f0cb46 tempest-SnapshotDependencyTests-260039155 None] Lock "cinder-21f8286f-4ecd-408b-9ec5-2d35936187c5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:08 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b9958f0d-be8a-4c66-a843-4712c2f0cb46 tempest-SnapshotDependencyTests-260039155 None] Acquiring lock "cinder-quobyte-21f8286f-4ecd-408b-9ec5-2d35936187c5" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:08 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b9958f0d-be8a-4c66-a843-4712c2f0cb46 tempest-SnapshotDependencyTests-260039155 None] Lock "cinder-quobyte-21f8286f-4ecd-408b-9ec5-2d35936187c5" acquired by "delete_volume" :: waited 0.014s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:08 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[27149007-6b7d-4e94-ba03-507743241f89]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:37:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b9958f0d-be8a-4c66-a843-4712c2f0cb46 tempest-SnapshotDependencyTests-260039155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:08 devstack sudo[108990]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9a09dc54-b3b0-461e-88c2-dea368d131fe tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e821c726-3203-4ee4-b138-0d4da01b8928 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928.883bf0a2-5594-47a1-8aec-5f3e1b970869" returned: 0 in 0.326s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:08 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-9a09dc54-b3b0-461e-88c2-dea368d131fe tempest-ProjectMemberTests-1852265171 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928.883bf0a2-5594-47a1-8aec-5f3e1b970869 is being set with open permissions: ugo+rw Sep 28 17:37:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9a09dc54-b3b0-461e-88c2-dea368d131fe tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928.883bf0a2-5594-47a1-8aec-5f3e1b970869 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:08 devstack sudo[108998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928.883bf0a2-5594-47a1-8aec-5f3e1b970869 Sep 28 17:37:08 devstack sudo[108998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:08 devstack sudo[108997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5 Sep 28 17:37:08 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:08 devstack sudo[108998]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9a09dc54-b3b0-461e-88c2-dea368d131fe tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928.883bf0a2-5594-47a1-8aec-5f3e1b970869" returned: 0 in 0.238s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9a09dc54-b3b0-461e-88c2-dea368d131fe tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:08 devstack sudo[109002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928.info Sep 28 17:37:08 devstack sudo[109002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:08 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b9958f0d-be8a-4c66-a843-4712c2f0cb46 tempest-SnapshotDependencyTests-260039155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5" returned: 0 in 0.379s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b9958f0d-be8a-4c66-a843-4712c2f0cb46 tempest-SnapshotDependencyTests-260039155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:08 devstack sudo[109007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5 Sep 28 17:37:08 devstack sudo[109007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:08 devstack sudo[109002]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9a09dc54-b3b0-461e-88c2-dea368d131fe tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928.info" returned: 0 in 0.281s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:08 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-9a09dc54-b3b0-461e-88c2-dea368d131fe tempest-ProjectMemberTests-1852265171 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928.info is being set with open permissions: ugo+rw Sep 28 17:37:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9a09dc54-b3b0-461e-88c2-dea368d131fe tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:08 devstack sudo[109010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928.info Sep 28 17:37:08 devstack sudo[109010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:08 devstack sudo[109007]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b9958f0d-be8a-4c66-a843-4712c2f0cb46 tempest-SnapshotDependencyTests-260039155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-21f8286f-4ecd-408b-9ec5-2d35936187c5" returned: 0 in 0.265s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:08 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b9958f0d-be8a-4c66-a843-4712c2f0cb46 tempest-SnapshotDependencyTests-260039155 None] Lock "cinder-quobyte-21f8286f-4ecd-408b-9ec5-2d35936187c5" released by "delete_volume" :: held 0.704s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:09 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-b9958f0d-be8a-4c66-a843-4712c2f0cb46 tempest-SnapshotDependencyTests-260039155 None] Created reservations ['14242e2a-9265-450b-91b1-f4c731eea312', '6965d90d-a06e-4c94-8de1-991e00136ab6', '905122c8-4331-455a-bcd8-d2fcab4a9a67', 'de2507bb-aa81-42c4-8318-74e5863a1da5'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:37:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b9958f0d-be8a-4c66-a843-4712c2f0cb46 tempest-SnapshotDependencyTests-260039155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:37:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b9958f0d-be8a-4c66-a843-4712c2f0cb46 tempest-SnapshotDependencyTests-260039155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:37:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b9958f0d-be8a-4c66-a843-4712c2f0cb46 tempest-SnapshotDependencyTests-260039155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:37:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-b9958f0d-be8a-4c66-a843-4712c2f0cb46 tempest-SnapshotDependencyTests-260039155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:37:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b9958f0d-be8a-4c66-a843-4712c2f0cb46 tempest-SnapshotDependencyTests-260039155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:37:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b9958f0d-be8a-4c66-a843-4712c2f0cb46 tempest-SnapshotDependencyTests-260039155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:09 devstack sudo[109014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:37:09 devstack sudo[109014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:09 devstack sudo[109010]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9a09dc54-b3b0-461e-88c2-dea368d131fe tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928.info" returned: 0 in 0.265s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-9a09dc54-b3b0-461e-88c2-dea368d131fe tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.986s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:37:09 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-9a09dc54-b3b0-461e-88c2-dea368d131fe tempest-ProjectMemberTests-1852265171 None] Create snapshot completed successfully Sep 28 17:37:09 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8618b97f-0d36-49e2-acc2-f2000b82c39f tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-883bf0a2-5594-47a1-8aec-5f3e1b970869-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:09 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8618b97f-0d36-49e2-acc2-f2000b82c39f tempest-ProjectMemberTests-1852265171 None] Lock "cinder-883bf0a2-5594-47a1-8aec-5f3e1b970869-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:09 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8618b97f-0d36-49e2-acc2-f2000b82c39f tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-quobyte-e821c726-3203-4ee4-b138-0d4da01b8928" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:09 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8618b97f-0d36-49e2-acc2-f2000b82c39f tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-e821c726-3203-4ee4-b138-0d4da01b8928" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:09 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8618b97f-0d36-49e2-acc2-f2000b82c39f tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-quobyte-883bf0a2-5594-47a1-8aec-5f3e1b970869" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:09 devstack sudo[109014]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:09 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8618b97f-0d36-49e2-acc2-f2000b82c39f tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-883bf0a2-5594-47a1-8aec-5f3e1b970869" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-8618b97f-0d36-49e2-acc2-f2000b82c39f tempest-ProjectMemberTests-1852265171 None] Deleting offline snapshot 883bf0a2-5594-47a1-8aec-5f3e1b970869 of volume e821c726-3203-4ee4-b138-0d4da01b8928 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:37:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-8618b97f-0d36-49e2-acc2-f2000b82c39f tempest-ProjectMemberTests-1852265171 None] snapshot_file for this snap is: volume-e821c726-3203-4ee4-b138-0d4da01b8928.883bf0a2-5594-47a1-8aec-5f3e1b970869 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:37:09 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-72c50618-541c-4ee7-8e4b-7eea610d4277 tempest-SnapshotDependencyTests-260039155 None] Acquiring lock "cinder-3d019ec7-6612-409b-a6b3-89dcd6d2533f-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b9958f0d-be8a-4c66-a843-4712c2f0cb46 tempest-SnapshotDependencyTests-260039155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.304s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:09 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-b9958f0d-be8a-4c66-a843-4712c2f0cb46 tempest-SnapshotDependencyTests-260039155 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:37:09 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-b9958f0d-be8a-4c66-a843-4712c2f0cb46 tempest-SnapshotDependencyTests-260039155 None] Deleted volume successfully. Sep 28 17:37:09 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a794e23-8d4d-4aaa-b48a-7b03f5bda2b5]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:37:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8618b97f-0d36-49e2-acc2-f2000b82c39f tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928.883bf0a2-5594-47a1-8aec-5f3e1b970869 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:09 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-72c50618-541c-4ee7-8e4b-7eea610d4277 tempest-SnapshotDependencyTests-260039155 None] Lock "cinder-3d019ec7-6612-409b-a6b3-89dcd6d2533f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:09 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-b9958f0d-be8a-4c66-a843-4712c2f0cb46 tempest-SnapshotDependencyTests-260039155 None] Lock "cinder-21f8286f-4ecd-408b-9ec5-2d35936187c5-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:09 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-72c50618-541c-4ee7-8e4b-7eea610d4277 tempest-SnapshotDependencyTests-260039155 None] Acquiring lock "cinder-quobyte-3d019ec7-6612-409b-a6b3-89dcd6d2533f" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:09 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-72c50618-541c-4ee7-8e4b-7eea610d4277 tempest-SnapshotDependencyTests-260039155 None] Lock "cinder-quobyte-3d019ec7-6612-409b-a6b3-89dcd6d2533f" acquired by "delete_volume" :: waited 0.018s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:09 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7609f45f-845d-4f4d-90f0-21ad44642493]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:37:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-72c50618-541c-4ee7-8e4b-7eea610d4277 tempest-SnapshotDependencyTests-260039155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3d019ec7-6612-409b-a6b3-89dcd6d2533f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:09 devstack sudo[109017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928.883bf0a2-5594-47a1-8aec-5f3e1b970869 Sep 28 17:37:09 devstack sudo[109017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:09 devstack sudo[109018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3d019ec7-6612-409b-a6b3-89dcd6d2533f Sep 28 17:37:09 devstack sudo[109018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:09 devstack sudo[109017]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8618b97f-0d36-49e2-acc2-f2000b82c39f tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928.883bf0a2-5594-47a1-8aec-5f3e1b970869" returned: 0 in 0.375s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-8618b97f-0d36-49e2-acc2-f2000b82c39f tempest-ProjectMemberTests-1852265171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e821c726-3203-4ee4-b138-0d4da01b8928(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:37:09 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[b152a657-c06f-4359-8014-f5311e25e58b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:37:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8618b97f-0d36-49e2-acc2-f2000b82c39f tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:09 devstack sudo[109018]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-72c50618-541c-4ee7-8e4b-7eea610d4277 tempest-SnapshotDependencyTests-260039155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3d019ec7-6612-409b-a6b3-89dcd6d2533f" returned: 0 in 0.373s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-72c50618-541c-4ee7-8e4b-7eea610d4277 tempest-SnapshotDependencyTests-260039155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3d019ec7-6612-409b-a6b3-89dcd6d2533f {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:09 devstack sudo[109028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3d019ec7-6612-409b-a6b3-89dcd6d2533f Sep 28 17:37:09 devstack sudo[109028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:09 devstack sudo[109026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928 Sep 28 17:37:09 devstack sudo[109026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:10 devstack sudo[109028]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-72c50618-541c-4ee7-8e4b-7eea610d4277 tempest-SnapshotDependencyTests-260039155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3d019ec7-6612-409b-a6b3-89dcd6d2533f" returned: 0 in 0.239s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:10 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-72c50618-541c-4ee7-8e4b-7eea610d4277 tempest-SnapshotDependencyTests-260039155 None] Lock "cinder-quobyte-3d019ec7-6612-409b-a6b3-89dcd6d2533f" released by "delete_volume" :: held 0.650s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:10 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-72c50618-541c-4ee7-8e4b-7eea610d4277 tempest-SnapshotDependencyTests-260039155 None] Created reservations ['c3df7293-060b-4022-8296-15359f146309', '44fa0939-31e7-4d70-822d-41869445acc5', '1f88e367-1575-4357-9963-134fcc3a7bfd', '02e04b9e-8fbe-4195-9315-f76919eb0715'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:37:10 devstack sudo[109026]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8618b97f-0d36-49e2-acc2-f2000b82c39f tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928" returned: 0 in 0.383s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8618b97f-0d36-49e2-acc2-f2000b82c39f tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928.883bf0a2-5594-47a1-8aec-5f3e1b970869 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:10 devstack sudo[109035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928.883bf0a2-5594-47a1-8aec-5f3e1b970869 Sep 28 17:37:10 devstack sudo[109035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-72c50618-541c-4ee7-8e4b-7eea610d4277 tempest-SnapshotDependencyTests-260039155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:37:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-72c50618-541c-4ee7-8e4b-7eea610d4277 tempest-SnapshotDependencyTests-260039155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:37:10 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-72c50618-541c-4ee7-8e4b-7eea610d4277 tempest-SnapshotDependencyTests-260039155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:37:10 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-72c50618-541c-4ee7-8e4b-7eea610d4277 tempest-SnapshotDependencyTests-260039155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:37:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-72c50618-541c-4ee7-8e4b-7eea610d4277 tempest-SnapshotDependencyTests-260039155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:37:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-72c50618-541c-4ee7-8e4b-7eea610d4277 tempest-SnapshotDependencyTests-260039155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:10 devstack sudo[109037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:37:10 devstack sudo[109037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:10 devstack sudo[109037]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-72c50618-541c-4ee7-8e4b-7eea610d4277 tempest-SnapshotDependencyTests-260039155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.257s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:10 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-72c50618-541c-4ee7-8e4b-7eea610d4277 tempest-SnapshotDependencyTests-260039155 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:37:10 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-72c50618-541c-4ee7-8e4b-7eea610d4277 tempest-SnapshotDependencyTests-260039155 None] Deleted volume successfully. Sep 28 17:37:10 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-72c50618-541c-4ee7-8e4b-7eea610d4277 tempest-SnapshotDependencyTests-260039155 None] Lock "cinder-3d019ec7-6612-409b-a6b3-89dcd6d2533f-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:10 devstack sudo[109035]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8618b97f-0d36-49e2-acc2-f2000b82c39f tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928.883bf0a2-5594-47a1-8aec-5f3e1b970869" returned: 0 in 0.395s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8618b97f-0d36-49e2-acc2-f2000b82c39f tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928.883bf0a2-5594-47a1-8aec-5f3e1b970869 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:10 devstack sudo[109043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928.883bf0a2-5594-47a1-8aec-5f3e1b970869 Sep 28 17:37:10 devstack sudo[109043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:10 devstack sudo[109043]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8618b97f-0d36-49e2-acc2-f2000b82c39f tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928.883bf0a2-5594-47a1-8aec-5f3e1b970869" returned: 0 in 0.256s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:10 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8618b97f-0d36-49e2-acc2-f2000b82c39f tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-883bf0a2-5594-47a1-8aec-5f3e1b970869" released by "_delete_snapshot" :: held 1.533s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:10 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8618b97f-0d36-49e2-acc2-f2000b82c39f tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-e821c726-3203-4ee4-b138-0d4da01b8928" released by "delete_snapshot" :: held 1.561s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:10 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-8618b97f-0d36-49e2-acc2-f2000b82c39f tempest-ProjectMemberTests-1852265171 None] Created reservations ['b41d5cc4-c755-4dd3-80a8-10ef4ee5fb1b', '165877f5-85e2-4a7d-9d58-f40e4797ecde', 'bc73c828-d147-4a1f-9135-f5bf15cfd558', 'e4543844-6448-462f-9875-cf0076c77fee'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:37:11 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-8618b97f-0d36-49e2-acc2-f2000b82c39f tempest-ProjectMemberTests-1852265171 None] Delete snapshot completed successfully. Sep 28 17:37:11 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8618b97f-0d36-49e2-acc2-f2000b82c39f tempest-ProjectMemberTests-1852265171 None] Lock "cinder-883bf0a2-5594-47a1-8aec-5f3e1b970869-delete_snapshot" released by "delete_snapshot" :: held 1.702s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:11 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f1a42e7b-063b-45b8-919e-af1d1540d299 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-e821c726-3203-4ee4-b138-0d4da01b8928-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:11 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f1a42e7b-063b-45b8-919e-af1d1540d299 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-e821c726-3203-4ee4-b138-0d4da01b8928-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:11 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f1a42e7b-063b-45b8-919e-af1d1540d299 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-quobyte-e821c726-3203-4ee4-b138-0d4da01b8928" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:11 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f1a42e7b-063b-45b8-919e-af1d1540d299 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-e821c726-3203-4ee4-b138-0d4da01b8928" acquired by "delete_volume" :: waited 0.016s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:11 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[17147396-3895-484c-af57-847bfaccbebf]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:37:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f1a42e7b-063b-45b8-919e-af1d1540d299 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:11 devstack sudo[109047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928 Sep 28 17:37:11 devstack sudo[109047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:11 devstack sudo[109047]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f1a42e7b-063b-45b8-919e-af1d1540d299 tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928" returned: 0 in 0.377s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f1a42e7b-063b-45b8-919e-af1d1540d299 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:12 devstack sudo[109053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928 Sep 28 17:37:12 devstack sudo[109053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:12 devstack sudo[109053]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f1a42e7b-063b-45b8-919e-af1d1540d299 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-e821c726-3203-4ee4-b138-0d4da01b8928" returned: 0 in 0.263s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:12 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f1a42e7b-063b-45b8-919e-af1d1540d299 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-e821c726-3203-4ee4-b138-0d4da01b8928" released by "delete_volume" :: held 0.714s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:12 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=139,cinder:UPDATE=178,cinder:INSERT=37,cinder:DELETE=10 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:37:12 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:UPDATE=154,cinder:SELECT=134,cinder:DELETE=18,cinder:INSERT=53 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:37:12 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-f1a42e7b-063b-45b8-919e-af1d1540d299 tempest-ProjectMemberTests-1852265171 None] Created reservations ['4da59494-a023-4bd1-870b-80f16fb3aa00', '27bd5de7-60db-4939-8445-af42f22546de', 'f4928f9d-90a1-4fa0-b286-8df94ee51d52', 'bc938bd9-2eda-4bc4-9697-f22e6238ddde'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:37:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f1a42e7b-063b-45b8-919e-af1d1540d299 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:37:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f1a42e7b-063b-45b8-919e-af1d1540d299 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:37:12 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f1a42e7b-063b-45b8-919e-af1d1540d299 tempest-ProjectMemberTests-1852265171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:37:12 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f1a42e7b-063b-45b8-919e-af1d1540d299 tempest-ProjectMemberTests-1852265171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:37:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f1a42e7b-063b-45b8-919e-af1d1540d299 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:37:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f1a42e7b-063b-45b8-919e-af1d1540d299 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:12 devstack sudo[109056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:37:12 devstack sudo[109056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:12 devstack sudo[109056]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f1a42e7b-063b-45b8-919e-af1d1540d299 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.256s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:12 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-f1a42e7b-063b-45b8-919e-af1d1540d299 tempest-ProjectMemberTests-1852265171 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:37:12 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-f1a42e7b-063b-45b8-919e-af1d1540d299 tempest-ProjectMemberTests-1852265171 None] Deleted volume successfully. Sep 28 17:37:12 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-f1a42e7b-063b-45b8-919e-af1d1540d299 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-e821c726-3203-4ee4-b138-0d4da01b8928-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:13 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-623b9e7c-85ad-49f3-9f69-9ba69f155aa0 tempest-ProjectMemberTests-1852265171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:37:13 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-623b9e7c-85ad-49f3-9f69-9ba69f155aa0 tempest-ProjectMemberTests-1852265171 None] Flow 'volume_create_manager' (140a2078-0096-4210-a1d2-87fbf7b240cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:37:13 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-623b9e7c-85ad-49f3-9f69-9ba69f155aa0 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51499d05-9949-43dc-ace3-73fc078392a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:13 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-623b9e7c-85ad-49f3-9f69-9ba69f155aa0 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51499d05-9949-43dc-ace3-73fc078392a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1618373645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed3a679-dec3-462a-a177-2e21b2e2d7cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e19b5535dc4ca0a0b3b833ab1e8248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:37:13Z,use_quota=True,user_id='56b2bce1c2e2420fb799c45cd8c3987f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:13 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-623b9e7c-85ad-49f3-9f69-9ba69f155aa0 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9791163-d32a-421b-8caa-071730e05dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:13 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-623b9e7c-85ad-49f3-9f69-9ba69f155aa0 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9791163-d32a-421b-8caa-071730e05dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:13 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-623b9e7c-85ad-49f3-9f69-9ba69f155aa0 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6801f2b2-c64a-4682-aa61-fabfe1c09738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:13 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-623b9e7c-85ad-49f3-9f69-9ba69f155aa0 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6801f2b2-c64a-4682-aa61-fabfe1c09738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eed3a679-dec3-462a-a177-2e21b2e2d7cb', 'volume_name': 'volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:13 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-623b9e7c-85ad-49f3-9f69-9ba69f155aa0 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4155ced3-6dba-4d8e-af6b-9839db466f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:13 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-623b9e7c-85ad-49f3-9f69-9ba69f155aa0 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4155ced3-6dba-4d8e-af6b-9839db466f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:13 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-623b9e7c-85ad-49f3-9f69-9ba69f155aa0 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (634127a7-7b9f-4e73-8631-629ded955a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:13 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-623b9e7c-85ad-49f3-9f69-9ba69f155aa0 tempest-ProjectMemberTests-1852265171 None] Volume eed3a679-dec3-462a-a177-2e21b2e2d7cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb', 'volume_size': 1} Sep 28 17:37:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-623b9e7c-85ad-49f3-9f69-9ba69f155aa0 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:37:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-623b9e7c-85ad-49f3-9f69-9ba69f155aa0 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:37:13 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-623b9e7c-85ad-49f3-9f69-9ba69f155aa0 tempest-ProjectMemberTests-1852265171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1618373645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed3a679-dec3-462a-a177-2e21b2e2d7cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e19b5535dc4ca0a0b3b833ab1e8248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:37:13Z,use_quota=True,user_id='56b2bce1c2e2420fb799c45cd8c3987f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:37:13 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-623b9e7c-85ad-49f3-9f69-9ba69f155aa0 tempest-ProjectMemberTests-1852265171 None] Creating volume eed3a679-dec3-462a-a177-2e21b2e2d7cb {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:37:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-623b9e7c-85ad-49f3-9f69-9ba69f155aa0 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:37:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-623b9e7c-85ad-49f3-9f69-9ba69f155aa0 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:37:13 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-623b9e7c-85ad-49f3-9f69-9ba69f155aa0 tempest-ProjectMemberTests-1852265171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:37:13 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-623b9e7c-85ad-49f3-9f69-9ba69f155aa0 tempest-ProjectMemberTests-1852265171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:37:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-623b9e7c-85ad-49f3-9f69-9ba69f155aa0 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:37:13 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-623b9e7c-85ad-49f3-9f69-9ba69f155aa0 tempest-ProjectMemberTests-1852265171 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:37:13 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-623b9e7c-85ad-49f3-9f69-9ba69f155aa0 tempest-ProjectMemberTests-1852265171 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:37:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-623b9e7c-85ad-49f3-9f69-9ba69f155aa0 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:13 devstack sudo[109059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb 1073741824 Sep 28 17:37:13 devstack sudo[109059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:13 devstack sudo[109059]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-623b9e7c-85ad-49f3-9f69-9ba69f155aa0 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb 1073741824" returned: 0 in 0.414s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-623b9e7c-85ad-49f3-9f69-9ba69f155aa0 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:13 devstack sudo[109064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb Sep 28 17:37:13 devstack sudo[109064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:14 devstack sudo[109064]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-623b9e7c-85ad-49f3-9f69-9ba69f155aa0 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb" returned: 0 in 0.315s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:14 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-623b9e7c-85ad-49f3-9f69-9ba69f155aa0 tempest-ProjectMemberTests-1852265171 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:37:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-623b9e7c-85ad-49f3-9f69-9ba69f155aa0 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:37:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-623b9e7c-85ad-49f3-9f69-9ba69f155aa0 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (634127a7-7b9f-4e73-8631-629ded955a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-623b9e7c-85ad-49f3-9f69-9ba69f155aa0 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ed00f4-099f-43e1-a6f9-0e6fb1ea4a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:14 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-623b9e7c-85ad-49f3-9f69-9ba69f155aa0 tempest-ProjectMemberTests-1852265171 None] Volume volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb (eed3a679-dec3-462a-a177-2e21b2e2d7cb): created successfully Sep 28 17:37:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-623b9e7c-85ad-49f3-9f69-9ba69f155aa0 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ed00f4-099f-43e1-a6f9-0e6fb1ea4a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:14 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-623b9e7c-85ad-49f3-9f69-9ba69f155aa0 tempest-ProjectMemberTests-1852265171 None] Flow 'volume_create_manager' (140a2078-0096-4210-a1d2-87fbf7b240cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:37:14 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-623b9e7c-85ad-49f3-9f69-9ba69f155aa0 tempest-ProjectMemberTests-1852265171 None] Created volume successfully. Sep 28 17:37:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-20523071-9892-4d93-a26a-03a81eb05776 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:37:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-20523071-9892-4d93-a26a-03a81eb05776 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:37:15 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-20523071-9892-4d93-a26a-03a81eb05776 tempest-ProjectMemberTests-1852265171 None] Creating offline snapshot 5a2e5f91-e08a-4ed8-acdd-6ed1af3ef0fd of volume eed3a679-dec3-462a-a177-2e21b2e2d7cb {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:37:15 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e8a9ec-8b32-45d8-be55-61f5e8da92c2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:37:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-20523071-9892-4d93-a26a-03a81eb05776 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:15 devstack sudo[109068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb Sep 28 17:37:15 devstack sudo[109068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:15 devstack sudo[109068]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-20523071-9892-4d93-a26a-03a81eb05776 tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb" returned: 0 in 0.382s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-20523071-9892-4d93-a26a-03a81eb05776 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb.5a2e5f91-e08a-4ed8-acdd-6ed1af3ef0fd 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:15 devstack sudo[109073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb.5a2e5f91-e08a-4ed8-acdd-6ed1af3ef0fd 1G Sep 28 17:37:15 devstack sudo[109073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:16 devstack sudo[109073]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-20523071-9892-4d93-a26a-03a81eb05776 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb.5a2e5f91-e08a-4ed8-acdd-6ed1af3ef0fd 1G" returned: 0 in 0.466s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-20523071-9892-4d93-a26a-03a81eb05776 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb.5a2e5f91-e08a-4ed8-acdd-6ed1af3ef0fd {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:16 devstack sudo[109080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb.5a2e5f91-e08a-4ed8-acdd-6ed1af3ef0fd Sep 28 17:37:16 devstack sudo[109080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:16 devstack sudo[109080]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-20523071-9892-4d93-a26a-03a81eb05776 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb.5a2e5f91-e08a-4ed8-acdd-6ed1af3ef0fd" returned: 0 in 0.321s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:16 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-20523071-9892-4d93-a26a-03a81eb05776 tempest-ProjectMemberTests-1852265171 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb.5a2e5f91-e08a-4ed8-acdd-6ed1af3ef0fd is being set with open permissions: ugo+rw Sep 28 17:37:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-20523071-9892-4d93-a26a-03a81eb05776 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb.5a2e5f91-e08a-4ed8-acdd-6ed1af3ef0fd {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:16 devstack sudo[109086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb.5a2e5f91-e08a-4ed8-acdd-6ed1af3ef0fd Sep 28 17:37:16 devstack sudo[109086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:16 devstack sudo[109086]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-20523071-9892-4d93-a26a-03a81eb05776 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb.5a2e5f91-e08a-4ed8-acdd-6ed1af3ef0fd" returned: 0 in 0.252s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-20523071-9892-4d93-a26a-03a81eb05776 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:16 devstack sudo[109089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb.info Sep 28 17:37:16 devstack sudo[109089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:17 devstack sudo[109089]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-20523071-9892-4d93-a26a-03a81eb05776 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb.info" returned: 0 in 0.257s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:17 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-20523071-9892-4d93-a26a-03a81eb05776 tempest-ProjectMemberTests-1852265171 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb.info is being set with open permissions: ugo+rw Sep 28 17:37:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-20523071-9892-4d93-a26a-03a81eb05776 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:17 devstack sudo[109092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb.info Sep 28 17:37:17 devstack sudo[109092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:17 devstack sudo[109092]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-20523071-9892-4d93-a26a-03a81eb05776 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb.info" returned: 0 in 0.257s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-20523071-9892-4d93-a26a-03a81eb05776 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.027s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:37:17 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-20523071-9892-4d93-a26a-03a81eb05776 tempest-ProjectMemberTests-1852265171 None] Create snapshot completed successfully Sep 28 17:37:18 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-493add62-3d3f-4f38-a0e7-19ef3b7db34b tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-5a2e5f91-e08a-4ed8-acdd-6ed1af3ef0fd-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:18 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-493add62-3d3f-4f38-a0e7-19ef3b7db34b tempest-ProjectMemberTests-1852265171 None] Lock "cinder-5a2e5f91-e08a-4ed8-acdd-6ed1af3ef0fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:18 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-493add62-3d3f-4f38-a0e7-19ef3b7db34b tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-quobyte-eed3a679-dec3-462a-a177-2e21b2e2d7cb" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:18 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-493add62-3d3f-4f38-a0e7-19ef3b7db34b tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-eed3a679-dec3-462a-a177-2e21b2e2d7cb" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:18 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-493add62-3d3f-4f38-a0e7-19ef3b7db34b tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-quobyte-5a2e5f91-e08a-4ed8-acdd-6ed1af3ef0fd" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:18 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-493add62-3d3f-4f38-a0e7-19ef3b7db34b tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-5a2e5f91-e08a-4ed8-acdd-6ed1af3ef0fd" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-493add62-3d3f-4f38-a0e7-19ef3b7db34b tempest-ProjectMemberTests-1852265171 None] Deleting offline snapshot 5a2e5f91-e08a-4ed8-acdd-6ed1af3ef0fd of volume eed3a679-dec3-462a-a177-2e21b2e2d7cb {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:37:18 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-493add62-3d3f-4f38-a0e7-19ef3b7db34b tempest-ProjectMemberTests-1852265171 None] snapshot_file for this snap is: volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb.5a2e5f91-e08a-4ed8-acdd-6ed1af3ef0fd {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:37:18 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6ab939-29b9-4fc1-b439-b724b168d994]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:37:18 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-493add62-3d3f-4f38-a0e7-19ef3b7db34b tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb.5a2e5f91-e08a-4ed8-acdd-6ed1af3ef0fd {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:18 devstack sudo[109095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb.5a2e5f91-e08a-4ed8-acdd-6ed1af3ef0fd Sep 28 17:37:18 devstack sudo[109095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:19 devstack sudo[109095]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-493add62-3d3f-4f38-a0e7-19ef3b7db34b tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb.5a2e5f91-e08a-4ed8-acdd-6ed1af3ef0fd" returned: 0 in 0.449s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:19 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-493add62-3d3f-4f38-a0e7-19ef3b7db34b tempest-ProjectMemberTests-1852265171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:37:19 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ee1b69-278d-4248-a424-aed06258cd4e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:37:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-493add62-3d3f-4f38-a0e7-19ef3b7db34b tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:19 devstack sudo[109104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb Sep 28 17:37:19 devstack sudo[109104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:19 devstack sudo[109104]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-493add62-3d3f-4f38-a0e7-19ef3b7db34b tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb" returned: 0 in 0.379s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:19 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-493add62-3d3f-4f38-a0e7-19ef3b7db34b tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb.5a2e5f91-e08a-4ed8-acdd-6ed1af3ef0fd {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:19 devstack sudo[109112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb.5a2e5f91-e08a-4ed8-acdd-6ed1af3ef0fd Sep 28 17:37:19 devstack sudo[109112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:20 devstack sudo[109112]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-493add62-3d3f-4f38-a0e7-19ef3b7db34b tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb.5a2e5f91-e08a-4ed8-acdd-6ed1af3ef0fd" returned: 0 in 0.410s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-493add62-3d3f-4f38-a0e7-19ef3b7db34b tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb.5a2e5f91-e08a-4ed8-acdd-6ed1af3ef0fd {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:20 devstack sudo[109118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb.5a2e5f91-e08a-4ed8-acdd-6ed1af3ef0fd Sep 28 17:37:20 devstack sudo[109118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:20 devstack sudo[109118]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-493add62-3d3f-4f38-a0e7-19ef3b7db34b tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb.5a2e5f91-e08a-4ed8-acdd-6ed1af3ef0fd" returned: 0 in 0.269s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:20 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-493add62-3d3f-4f38-a0e7-19ef3b7db34b tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-5a2e5f91-e08a-4ed8-acdd-6ed1af3ef0fd" released by "_delete_snapshot" :: held 1.623s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:20 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-493add62-3d3f-4f38-a0e7-19ef3b7db34b tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-eed3a679-dec3-462a-a177-2e21b2e2d7cb" released by "delete_snapshot" :: held 1.648s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:20 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-493add62-3d3f-4f38-a0e7-19ef3b7db34b tempest-ProjectMemberTests-1852265171 None] Created reservations ['aa28bcb8-f9cd-48c7-9f56-9465986a98f4', '790cacb1-9c8d-48e6-9c7d-491c33917652', 'a15259c1-f4a0-4221-ae0e-22097f42f69b', '0b04257a-d878-4b5e-8a8e-85fc01260556'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:37:20 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-493add62-3d3f-4f38-a0e7-19ef3b7db34b tempest-ProjectMemberTests-1852265171 None] Delete snapshot completed successfully. Sep 28 17:37:20 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-493add62-3d3f-4f38-a0e7-19ef3b7db34b tempest-ProjectMemberTests-1852265171 None] Lock "cinder-5a2e5f91-e08a-4ed8-acdd-6ed1af3ef0fd-delete_snapshot" released by "delete_snapshot" :: held 1.808s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:20 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-247f6435-0897-4bbc-ad36-77eb7d065c9c tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-eed3a679-dec3-462a-a177-2e21b2e2d7cb-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:20 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-247f6435-0897-4bbc-ad36-77eb7d065c9c tempest-ProjectMemberTests-1852265171 None] Lock "cinder-eed3a679-dec3-462a-a177-2e21b2e2d7cb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:20 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-247f6435-0897-4bbc-ad36-77eb7d065c9c tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-quobyte-eed3a679-dec3-462a-a177-2e21b2e2d7cb" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:20 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-247f6435-0897-4bbc-ad36-77eb7d065c9c tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-eed3a679-dec3-462a-a177-2e21b2e2d7cb" acquired by "delete_volume" :: waited 0.017s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:20 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a0557a-a00e-4462-a472-5e7290cc3e88]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:37:20 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-247f6435-0897-4bbc-ad36-77eb7d065c9c tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:21 devstack sudo[109121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb Sep 28 17:37:21 devstack sudo[109121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:21 devstack sudo[109121]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-247f6435-0897-4bbc-ad36-77eb7d065c9c tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb" returned: 0 in 0.377s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-247f6435-0897-4bbc-ad36-77eb7d065c9c tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:21 devstack sudo[109126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb Sep 28 17:37:21 devstack sudo[109126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:21 devstack sudo[109126]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-247f6435-0897-4bbc-ad36-77eb7d065c9c tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-eed3a679-dec3-462a-a177-2e21b2e2d7cb" returned: 0 in 0.250s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:21 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-247f6435-0897-4bbc-ad36-77eb7d065c9c tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-eed3a679-dec3-462a-a177-2e21b2e2d7cb" released by "delete_volume" :: held 0.693s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:21 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-247f6435-0897-4bbc-ad36-77eb7d065c9c tempest-ProjectMemberTests-1852265171 None] Created reservations ['67098498-4135-43ab-b428-17f577880f5a', '15fe56b8-f999-4f02-935d-3d6f92d56574', '9aa1b46b-3c48-4cb1-9447-434ff5c156d9', 'fd986e7b-d37a-45cc-8074-240b643dc000'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:37:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-247f6435-0897-4bbc-ad36-77eb7d065c9c tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:37:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-247f6435-0897-4bbc-ad36-77eb7d065c9c tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:37:21 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-247f6435-0897-4bbc-ad36-77eb7d065c9c tempest-ProjectMemberTests-1852265171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:37:21 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-247f6435-0897-4bbc-ad36-77eb7d065c9c tempest-ProjectMemberTests-1852265171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:37:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-247f6435-0897-4bbc-ad36-77eb7d065c9c tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:37:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-247f6435-0897-4bbc-ad36-77eb7d065c9c tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:21 devstack sudo[109130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:37:21 devstack sudo[109130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:21 devstack sudo[109130]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:21 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-247f6435-0897-4bbc-ad36-77eb7d065c9c tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.235s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:21 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-247f6435-0897-4bbc-ad36-77eb7d065c9c tempest-ProjectMemberTests-1852265171 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:37:21 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-247f6435-0897-4bbc-ad36-77eb7d065c9c tempest-ProjectMemberTests-1852265171 None] Deleted volume successfully. Sep 28 17:37:22 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-247f6435-0897-4bbc-ad36-77eb7d065c9c tempest-ProjectMemberTests-1852265171 None] Lock "cinder-eed3a679-dec3-462a-a177-2e21b2e2d7cb-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:22 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-83e27f3f-40a7-4d93-9091-a9f7d1651de1 tempest-ProjectMemberTests-1852265171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:37:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-83e27f3f-40a7-4d93-9091-a9f7d1651de1 tempest-ProjectMemberTests-1852265171 None] Flow 'volume_create_manager' (33fa8b78-6c49-42d8-a889-f2f6c4935372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:37:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-83e27f3f-40a7-4d93-9091-a9f7d1651de1 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9516b06d-ab2c-4e66-9494-a56ce95c6dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-83e27f3f-40a7-4d93-9091-a9f7d1651de1 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9516b06d-ab2c-4e66-9494-a56ce95c6dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-101585657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3878e7e7-f111-4531-9da7-20b63a1d2568,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e19b5535dc4ca0a0b3b833ab1e8248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:37:23Z,use_quota=True,user_id='56b2bce1c2e2420fb799c45cd8c3987f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-83e27f3f-40a7-4d93-9091-a9f7d1651de1 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c07eead-1d0f-413e-8cb9-a36fa7ebfb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-83e27f3f-40a7-4d93-9091-a9f7d1651de1 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c07eead-1d0f-413e-8cb9-a36fa7ebfb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-83e27f3f-40a7-4d93-9091-a9f7d1651de1 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb9be64e-a4e2-4650-af7e-08b48fb74426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-83e27f3f-40a7-4d93-9091-a9f7d1651de1 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb9be64e-a4e2-4650-af7e-08b48fb74426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3878e7e7-f111-4531-9da7-20b63a1d2568', 'volume_name': 'volume-3878e7e7-f111-4531-9da7-20b63a1d2568', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-83e27f3f-40a7-4d93-9091-a9f7d1651de1 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5013e7d6-e613-4c14-82ed-7f140c72e0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-83e27f3f-40a7-4d93-9091-a9f7d1651de1 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5013e7d6-e613-4c14-82ed-7f140c72e0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:22 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-83e27f3f-40a7-4d93-9091-a9f7d1651de1 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5317a8b9-eec5-418c-8f26-1b3c7c952c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:22 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-83e27f3f-40a7-4d93-9091-a9f7d1651de1 tempest-ProjectMemberTests-1852265171 None] Volume 3878e7e7-f111-4531-9da7-20b63a1d2568: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3878e7e7-f111-4531-9da7-20b63a1d2568', 'volume_size': 1} Sep 28 17:37:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-83e27f3f-40a7-4d93-9091-a9f7d1651de1 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:37:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-83e27f3f-40a7-4d93-9091-a9f7d1651de1 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:37:22 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-83e27f3f-40a7-4d93-9091-a9f7d1651de1 tempest-ProjectMemberTests-1852265171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-101585657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3878e7e7-f111-4531-9da7-20b63a1d2568,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e19b5535dc4ca0a0b3b833ab1e8248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:37:23Z,use_quota=True,user_id='56b2bce1c2e2420fb799c45cd8c3987f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:37:22 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-83e27f3f-40a7-4d93-9091-a9f7d1651de1 tempest-ProjectMemberTests-1852265171 None] Creating volume 3878e7e7-f111-4531-9da7-20b63a1d2568 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:37:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-83e27f3f-40a7-4d93-9091-a9f7d1651de1 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:37:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-83e27f3f-40a7-4d93-9091-a9f7d1651de1 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:37:22 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-83e27f3f-40a7-4d93-9091-a9f7d1651de1 tempest-ProjectMemberTests-1852265171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:37:22 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-83e27f3f-40a7-4d93-9091-a9f7d1651de1 tempest-ProjectMemberTests-1852265171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:37:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-83e27f3f-40a7-4d93-9091-a9f7d1651de1 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:37:22 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-83e27f3f-40a7-4d93-9091-a9f7d1651de1 tempest-ProjectMemberTests-1852265171 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:37:22 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-83e27f3f-40a7-4d93-9091-a9f7d1651de1 tempest-ProjectMemberTests-1852265171 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:37:22 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-83e27f3f-40a7-4d93-9091-a9f7d1651de1 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:22 devstack sudo[109133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568 1073741824 Sep 28 17:37:22 devstack sudo[109133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:23 devstack sudo[109133]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-83e27f3f-40a7-4d93-9091-a9f7d1651de1 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568 1073741824" returned: 0 in 0.404s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-83e27f3f-40a7-4d93-9091-a9f7d1651de1 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:23 devstack sudo[109138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568 Sep 28 17:37:23 devstack sudo[109138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:23 devstack sudo[109138]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-83e27f3f-40a7-4d93-9091-a9f7d1651de1 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568" returned: 0 in 0.234s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:23 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-83e27f3f-40a7-4d93-9091-a9f7d1651de1 tempest-ProjectMemberTests-1852265171 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:37:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-83e27f3f-40a7-4d93-9091-a9f7d1651de1 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:37:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-83e27f3f-40a7-4d93-9091-a9f7d1651de1 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5317a8b9-eec5-418c-8f26-1b3c7c952c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3878e7e7-f111-4531-9da7-20b63a1d2568', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-83e27f3f-40a7-4d93-9091-a9f7d1651de1 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55cb02ba-ce0d-4333-b576-e8df8e3421e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:23 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-83e27f3f-40a7-4d93-9091-a9f7d1651de1 tempest-ProjectMemberTests-1852265171 None] Volume volume-3878e7e7-f111-4531-9da7-20b63a1d2568 (3878e7e7-f111-4531-9da7-20b63a1d2568): created successfully Sep 28 17:37:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-83e27f3f-40a7-4d93-9091-a9f7d1651de1 tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55cb02ba-ce0d-4333-b576-e8df8e3421e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:23 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-83e27f3f-40a7-4d93-9091-a9f7d1651de1 tempest-ProjectMemberTests-1852265171 None] Flow 'volume_create_manager' (33fa8b78-6c49-42d8-a889-f2f6c4935372) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:37:23 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-83e27f3f-40a7-4d93-9091-a9f7d1651de1 tempest-ProjectMemberTests-1852265171 None] Created volume successfully. Sep 28 17:37:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7496941d-6233-4a38-be62-34f06ee701ac tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:37:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7496941d-6233-4a38-be62-34f06ee701ac tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:37:23 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-7496941d-6233-4a38-be62-34f06ee701ac tempest-ProjectMemberTests-1852265171 None] Creating offline snapshot eb0d0e50-3e10-4e72-9829-b00c60f969a7 of volume 3878e7e7-f111-4531-9da7-20b63a1d2568 {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:37:23 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[807ae98e-8bda-4eb8-ac60-7228d9248b9d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:37:23 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7496941d-6233-4a38-be62-34f06ee701ac tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:23 devstack sudo[109141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568 Sep 28 17:37:23 devstack sudo[109141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:24 devstack sudo[109141]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7496941d-6233-4a38-be62-34f06ee701ac tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568" returned: 0 in 0.342s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7496941d-6233-4a38-be62-34f06ee701ac tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568.eb0d0e50-3e10-4e72-9829-b00c60f969a7 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:24 devstack sudo[109146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568.eb0d0e50-3e10-4e72-9829-b00c60f969a7 1G Sep 28 17:37:24 devstack sudo[109146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:24 devstack sudo[109146]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7496941d-6233-4a38-be62-34f06ee701ac tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568.eb0d0e50-3e10-4e72-9829-b00c60f969a7 1G" returned: 0 in 0.368s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7496941d-6233-4a38-be62-34f06ee701ac tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3878e7e7-f111-4531-9da7-20b63a1d2568 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568.eb0d0e50-3e10-4e72-9829-b00c60f969a7 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:24 devstack sudo[109152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3878e7e7-f111-4531-9da7-20b63a1d2568 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568.eb0d0e50-3e10-4e72-9829-b00c60f969a7 Sep 28 17:37:24 devstack sudo[109152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:24 devstack sudo[109152]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7496941d-6233-4a38-be62-34f06ee701ac tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3878e7e7-f111-4531-9da7-20b63a1d2568 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568.eb0d0e50-3e10-4e72-9829-b00c60f969a7" returned: 0 in 0.285s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:24 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-7496941d-6233-4a38-be62-34f06ee701ac tempest-ProjectMemberTests-1852265171 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568.eb0d0e50-3e10-4e72-9829-b00c60f969a7 is being set with open permissions: ugo+rw Sep 28 17:37:24 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7496941d-6233-4a38-be62-34f06ee701ac tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568.eb0d0e50-3e10-4e72-9829-b00c60f969a7 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:24 devstack sudo[109157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568.eb0d0e50-3e10-4e72-9829-b00c60f969a7 Sep 28 17:37:24 devstack sudo[109157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:25 devstack sudo[109157]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7496941d-6233-4a38-be62-34f06ee701ac tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568.eb0d0e50-3e10-4e72-9829-b00c60f969a7" returned: 0 in 0.228s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7496941d-6233-4a38-be62-34f06ee701ac tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:25 devstack sudo[109160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568.info Sep 28 17:37:25 devstack sudo[109160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:25 devstack sudo[109160]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7496941d-6233-4a38-be62-34f06ee701ac tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568.info" returned: 0 in 0.239s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:25 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-7496941d-6233-4a38-be62-34f06ee701ac tempest-ProjectMemberTests-1852265171 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568.info is being set with open permissions: ugo+rw Sep 28 17:37:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7496941d-6233-4a38-be62-34f06ee701ac tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:25 devstack sudo[109163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568.info Sep 28 17:37:25 devstack sudo[109163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:25 devstack sudo[109163]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-7496941d-6233-4a38-be62-34f06ee701ac tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568.info" returned: 0 in 0.241s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:25 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-7496941d-6233-4a38-be62-34f06ee701ac tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.785s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:37:25 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-7496941d-6233-4a38-be62-34f06ee701ac tempest-ProjectMemberTests-1852265171 None] Create snapshot completed successfully Sep 28 17:37:25 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-9c45cf68-23ef-4994-af5a-9763273eaba7 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-eb0d0e50-3e10-4e72-9829-b00c60f969a7-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:25 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-9c45cf68-23ef-4994-af5a-9763273eaba7 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-eb0d0e50-3e10-4e72-9829-b00c60f969a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:25 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-9c45cf68-23ef-4994-af5a-9763273eaba7 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-quobyte-3878e7e7-f111-4531-9da7-20b63a1d2568" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:25 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-9c45cf68-23ef-4994-af5a-9763273eaba7 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-3878e7e7-f111-4531-9da7-20b63a1d2568" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:25 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-9c45cf68-23ef-4994-af5a-9763273eaba7 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-quobyte-eb0d0e50-3e10-4e72-9829-b00c60f969a7" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:25 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-9c45cf68-23ef-4994-af5a-9763273eaba7 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-eb0d0e50-3e10-4e72-9829-b00c60f969a7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:25 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-9c45cf68-23ef-4994-af5a-9763273eaba7 tempest-ProjectMemberTests-1852265171 None] Deleting offline snapshot eb0d0e50-3e10-4e72-9829-b00c60f969a7 of volume 3878e7e7-f111-4531-9da7-20b63a1d2568 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:37:26 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-9c45cf68-23ef-4994-af5a-9763273eaba7 tempest-ProjectMemberTests-1852265171 None] snapshot_file for this snap is: volume-3878e7e7-f111-4531-9da7-20b63a1d2568.eb0d0e50-3e10-4e72-9829-b00c60f969a7 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:37:26 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c6246d-dada-4bd7-a7d3-4b26f7152af7]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:37:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9c45cf68-23ef-4994-af5a-9763273eaba7 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568.eb0d0e50-3e10-4e72-9829-b00c60f969a7 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:26 devstack sudo[109166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568.eb0d0e50-3e10-4e72-9829-b00c60f969a7 Sep 28 17:37:26 devstack sudo[109166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:26 devstack sudo[109166]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9c45cf68-23ef-4994-af5a-9763273eaba7 tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568.eb0d0e50-3e10-4e72-9829-b00c60f969a7" returned: 0 in 0.346s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:26 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-9c45cf68-23ef-4994-af5a-9763273eaba7 tempest-ProjectMemberTests-1852265171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3878e7e7-f111-4531-9da7-20b63a1d2568(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:37:26 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e72775-31dc-4dd8-906d-c42497f5d109]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:37:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9c45cf68-23ef-4994-af5a-9763273eaba7 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:26 devstack sudo[109171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568 Sep 28 17:37:26 devstack sudo[109171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:26 devstack sudo[109171]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9c45cf68-23ef-4994-af5a-9763273eaba7 tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568" returned: 0 in 0.339s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:26 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9c45cf68-23ef-4994-af5a-9763273eaba7 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568.eb0d0e50-3e10-4e72-9829-b00c60f969a7 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:26 devstack sudo[109176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568.eb0d0e50-3e10-4e72-9829-b00c60f969a7 Sep 28 17:37:26 devstack sudo[109176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:27 devstack sudo[109176]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9c45cf68-23ef-4994-af5a-9763273eaba7 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568.eb0d0e50-3e10-4e72-9829-b00c60f969a7" returned: 0 in 0.372s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9c45cf68-23ef-4994-af5a-9763273eaba7 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568.eb0d0e50-3e10-4e72-9829-b00c60f969a7 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:27 devstack sudo[109183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568.eb0d0e50-3e10-4e72-9829-b00c60f969a7 Sep 28 17:37:27 devstack sudo[109183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:27 devstack sudo[109183]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:27 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-9c45cf68-23ef-4994-af5a-9763273eaba7 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568.eb0d0e50-3e10-4e72-9829-b00c60f969a7" returned: 0 in 0.247s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-9c45cf68-23ef-4994-af5a-9763273eaba7 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-eb0d0e50-3e10-4e72-9829-b00c60f969a7" released by "_delete_snapshot" :: held 1.394s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-9c45cf68-23ef-4994-af5a-9763273eaba7 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-3878e7e7-f111-4531-9da7-20b63a1d2568" released by "delete_snapshot" :: held 1.415s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:27 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-9c45cf68-23ef-4994-af5a-9763273eaba7 tempest-ProjectMemberTests-1852265171 None] Created reservations ['854605c9-43ee-4f10-9652-607823204767', '8ad017fe-10aa-4581-b4bb-8c0a55685dff', 'ff96a103-f3d4-4f5a-80f3-e13bca9b8626', '53a7246d-baf1-44ac-9cbc-432764bbac07'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:37:27 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-9c45cf68-23ef-4994-af5a-9763273eaba7 tempest-ProjectMemberTests-1852265171 None] Delete snapshot completed successfully. Sep 28 17:37:27 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-9c45cf68-23ef-4994-af5a-9763273eaba7 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-eb0d0e50-3e10-4e72-9829-b00c60f969a7-delete_snapshot" released by "delete_snapshot" :: held 1.536s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:28 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5e761083-4516-4e4b-ae25-b0a73d4a695f tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-3878e7e7-f111-4531-9da7-20b63a1d2568-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:28 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5e761083-4516-4e4b-ae25-b0a73d4a695f tempest-ProjectMemberTests-1852265171 None] Lock "cinder-3878e7e7-f111-4531-9da7-20b63a1d2568-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:28 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5e761083-4516-4e4b-ae25-b0a73d4a695f tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-quobyte-3878e7e7-f111-4531-9da7-20b63a1d2568" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:28 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5e761083-4516-4e4b-ae25-b0a73d4a695f tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-3878e7e7-f111-4531-9da7-20b63a1d2568" acquired by "delete_volume" :: waited 0.014s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:28 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a838f0e-fbc6-4e53-aa2d-7946f8d3b485]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:37:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5e761083-4516-4e4b-ae25-b0a73d4a695f tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:28 devstack sudo[109186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568 Sep 28 17:37:28 devstack sudo[109186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:28 devstack sudo[109186]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5e761083-4516-4e4b-ae25-b0a73d4a695f tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568" returned: 0 in 0.345s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5e761083-4516-4e4b-ae25-b0a73d4a695f tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:28 devstack sudo[109191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568 Sep 28 17:37:28 devstack sudo[109191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:28 devstack sudo[109191]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5e761083-4516-4e4b-ae25-b0a73d4a695f tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3878e7e7-f111-4531-9da7-20b63a1d2568" returned: 0 in 0.236s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:28 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5e761083-4516-4e4b-ae25-b0a73d4a695f tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-3878e7e7-f111-4531-9da7-20b63a1d2568" released by "delete_volume" :: held 0.639s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:28 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-5e761083-4516-4e4b-ae25-b0a73d4a695f tempest-ProjectMemberTests-1852265171 None] Created reservations ['cef74da4-41cb-443c-b7bb-2bb21455af96', '653c2d79-ca67-4f31-823c-b05d44f4fb4a', 'd45622d5-8d5c-4c0b-9b37-d3d2141f13f8', '5e330aad-5826-4387-b6f0-8333a42d4001'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:37:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5e761083-4516-4e4b-ae25-b0a73d4a695f tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:37:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5e761083-4516-4e4b-ae25-b0a73d4a695f tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:37:28 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-5e761083-4516-4e4b-ae25-b0a73d4a695f tempest-ProjectMemberTests-1852265171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:37:28 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-5e761083-4516-4e4b-ae25-b0a73d4a695f tempest-ProjectMemberTests-1852265171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:37:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-5e761083-4516-4e4b-ae25-b0a73d4a695f tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:37:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5e761083-4516-4e4b-ae25-b0a73d4a695f tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:28 devstack sudo[109194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:37:28 devstack sudo[109194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:29 devstack sudo[109194]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-5e761083-4516-4e4b-ae25-b0a73d4a695f tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.230s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:29 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-5e761083-4516-4e4b-ae25-b0a73d4a695f tempest-ProjectMemberTests-1852265171 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:37:29 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-5e761083-4516-4e4b-ae25-b0a73d4a695f tempest-ProjectMemberTests-1852265171 None] Deleted volume successfully. Sep 28 17:37:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-5e761083-4516-4e4b-ae25-b0a73d4a695f tempest-ProjectMemberTests-1852265171 None] Lock "cinder-3878e7e7-f111-4531-9da7-20b63a1d2568-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:29 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-417343b1-8678-4616-8ed5-036a8db0ce8f tempest-ProjectMemberTests-1852265171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:37:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-417343b1-8678-4616-8ed5-036a8db0ce8f tempest-ProjectMemberTests-1852265171 None] Flow 'volume_create_manager' (b280add3-f882-49c8-abf1-a9742ea1cd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:37:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-417343b1-8678-4616-8ed5-036a8db0ce8f tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5064bbd8-774c-45a7-8fee-1efcb14477b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-417343b1-8678-4616-8ed5-036a8db0ce8f tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5064bbd8-774c-45a7-8fee-1efcb14477b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1591631695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb3d136c-7619-46a3-beed-42765604faec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e19b5535dc4ca0a0b3b833ab1e8248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:37:30Z,use_quota=True,user_id='56b2bce1c2e2420fb799c45cd8c3987f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-417343b1-8678-4616-8ed5-036a8db0ce8f tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20bcf14f-4280-46c9-aefe-dc3e334f08d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-417343b1-8678-4616-8ed5-036a8db0ce8f tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20bcf14f-4280-46c9-aefe-dc3e334f08d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-417343b1-8678-4616-8ed5-036a8db0ce8f tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73219cd4-fa40-44c6-82b0-c8b1d4b9cb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-417343b1-8678-4616-8ed5-036a8db0ce8f tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73219cd4-fa40-44c6-82b0-c8b1d4b9cb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb3d136c-7619-46a3-beed-42765604faec', 'volume_name': 'volume-cb3d136c-7619-46a3-beed-42765604faec', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-417343b1-8678-4616-8ed5-036a8db0ce8f tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d61015c-8da5-4b18-a8ef-ae4f9fee3e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-417343b1-8678-4616-8ed5-036a8db0ce8f tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d61015c-8da5-4b18-a8ef-ae4f9fee3e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:29 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-417343b1-8678-4616-8ed5-036a8db0ce8f tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a215ac06-012c-4b48-a8d0-3c78f4c74ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:29 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-417343b1-8678-4616-8ed5-036a8db0ce8f tempest-ProjectMemberTests-1852265171 None] Volume cb3d136c-7619-46a3-beed-42765604faec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb3d136c-7619-46a3-beed-42765604faec', 'volume_size': 1} Sep 28 17:37:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-417343b1-8678-4616-8ed5-036a8db0ce8f tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:37:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-417343b1-8678-4616-8ed5-036a8db0ce8f tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:37:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-417343b1-8678-4616-8ed5-036a8db0ce8f tempest-ProjectMemberTests-1852265171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1591631695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb3d136c-7619-46a3-beed-42765604faec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e19b5535dc4ca0a0b3b833ab1e8248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:37:30Z,use_quota=True,user_id='56b2bce1c2e2420fb799c45cd8c3987f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:37:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-417343b1-8678-4616-8ed5-036a8db0ce8f tempest-ProjectMemberTests-1852265171 None] Creating volume cb3d136c-7619-46a3-beed-42765604faec {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:37:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-417343b1-8678-4616-8ed5-036a8db0ce8f tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:37:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-417343b1-8678-4616-8ed5-036a8db0ce8f tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:37:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-417343b1-8678-4616-8ed5-036a8db0ce8f tempest-ProjectMemberTests-1852265171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:37:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-417343b1-8678-4616-8ed5-036a8db0ce8f tempest-ProjectMemberTests-1852265171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:37:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-417343b1-8678-4616-8ed5-036a8db0ce8f tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:37:29 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-417343b1-8678-4616-8ed5-036a8db0ce8f tempest-ProjectMemberTests-1852265171 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:37:29 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-417343b1-8678-4616-8ed5-036a8db0ce8f tempest-ProjectMemberTests-1852265171 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:37:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-417343b1-8678-4616-8ed5-036a8db0ce8f tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:29 devstack sudo[109197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec 1073741824 Sep 28 17:37:29 devstack sudo[109197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:30 devstack sudo[109197]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-417343b1-8678-4616-8ed5-036a8db0ce8f tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec 1073741824" returned: 0 in 0.399s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-417343b1-8678-4616-8ed5-036a8db0ce8f tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:30 devstack sudo[109203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec Sep 28 17:37:30 devstack sudo[109203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:30 devstack sudo[109203]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-417343b1-8678-4616-8ed5-036a8db0ce8f tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec" returned: 0 in 0.234s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:30 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-417343b1-8678-4616-8ed5-036a8db0ce8f tempest-ProjectMemberTests-1852265171 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:37:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-417343b1-8678-4616-8ed5-036a8db0ce8f tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:37:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-417343b1-8678-4616-8ed5-036a8db0ce8f tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a215ac06-012c-4b48-a8d0-3c78f4c74ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb3d136c-7619-46a3-beed-42765604faec', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-417343b1-8678-4616-8ed5-036a8db0ce8f tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ef257d2-23a4-4dc9-b038-34c593e07eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:30 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-417343b1-8678-4616-8ed5-036a8db0ce8f tempest-ProjectMemberTests-1852265171 None] Volume volume-cb3d136c-7619-46a3-beed-42765604faec (cb3d136c-7619-46a3-beed-42765604faec): created successfully Sep 28 17:37:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-417343b1-8678-4616-8ed5-036a8db0ce8f tempest-ProjectMemberTests-1852265171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ef257d2-23a4-4dc9-b038-34c593e07eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-417343b1-8678-4616-8ed5-036a8db0ce8f tempest-ProjectMemberTests-1852265171 None] Flow 'volume_create_manager' (b280add3-f882-49c8-abf1-a9742ea1cd2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:37:30 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-417343b1-8678-4616-8ed5-036a8db0ce8f tempest-ProjectMemberTests-1852265171 None] Created volume successfully. Sep 28 17:37:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b6124be0-d67f-4a7e-ad59-4feff5a44f1c tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:37:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b6124be0-d67f-4a7e-ad59-4feff5a44f1c tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:37:30 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-b6124be0-d67f-4a7e-ad59-4feff5a44f1c tempest-ProjectMemberTests-1852265171 None] Creating offline snapshot f8212c94-411e-4350-84d5-c6a689c11a39 of volume cb3d136c-7619-46a3-beed-42765604faec {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:37:30 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee8871a-c32a-4bc1-8d43-8f9162293ff7]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:37:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b6124be0-d67f-4a7e-ad59-4feff5a44f1c tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:31 devstack sudo[109206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec Sep 28 17:37:31 devstack sudo[109206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:31 devstack sudo[109206]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b6124be0-d67f-4a7e-ad59-4feff5a44f1c tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec" returned: 0 in 0.368s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b6124be0-d67f-4a7e-ad59-4feff5a44f1c tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec.f8212c94-411e-4350-84d5-c6a689c11a39 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:31 devstack sudo[109211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec.f8212c94-411e-4350-84d5-c6a689c11a39 1G Sep 28 17:37:31 devstack sudo[109211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:31 devstack sudo[109211]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b6124be0-d67f-4a7e-ad59-4feff5a44f1c tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec.f8212c94-411e-4350-84d5-c6a689c11a39 1G" returned: 0 in 0.372s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b6124be0-d67f-4a7e-ad59-4feff5a44f1c tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb3d136c-7619-46a3-beed-42765604faec -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec.f8212c94-411e-4350-84d5-c6a689c11a39 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:31 devstack sudo[109218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb3d136c-7619-46a3-beed-42765604faec -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec.f8212c94-411e-4350-84d5-c6a689c11a39 Sep 28 17:37:31 devstack sudo[109218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:31 devstack sudo[109218]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b6124be0-d67f-4a7e-ad59-4feff5a44f1c tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb3d136c-7619-46a3-beed-42765604faec -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec.f8212c94-411e-4350-84d5-c6a689c11a39" returned: 0 in 0.287s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:31 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-b6124be0-d67f-4a7e-ad59-4feff5a44f1c tempest-ProjectMemberTests-1852265171 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec.f8212c94-411e-4350-84d5-c6a689c11a39 is being set with open permissions: ugo+rw Sep 28 17:37:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b6124be0-d67f-4a7e-ad59-4feff5a44f1c tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec.f8212c94-411e-4350-84d5-c6a689c11a39 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:31 devstack sudo[109223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec.f8212c94-411e-4350-84d5-c6a689c11a39 Sep 28 17:37:31 devstack sudo[109223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:32 devstack sudo[109223]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b6124be0-d67f-4a7e-ad59-4feff5a44f1c tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec.f8212c94-411e-4350-84d5-c6a689c11a39" returned: 0 in 0.227s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b6124be0-d67f-4a7e-ad59-4feff5a44f1c tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:32 devstack sudo[109226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec.info Sep 28 17:37:32 devstack sudo[109226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:32 devstack sudo[109226]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b6124be0-d67f-4a7e-ad59-4feff5a44f1c tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec.info" returned: 0 in 0.238s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:32 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-b6124be0-d67f-4a7e-ad59-4feff5a44f1c tempest-ProjectMemberTests-1852265171 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec.info is being set with open permissions: ugo+rw Sep 28 17:37:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b6124be0-d67f-4a7e-ad59-4feff5a44f1c tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:32 devstack sudo[109229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec.info Sep 28 17:37:32 devstack sudo[109229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:32 devstack sudo[109229]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-b6124be0-d67f-4a7e-ad59-4feff5a44f1c tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec.info" returned: 0 in 0.225s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:32 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-b6124be0-d67f-4a7e-ad59-4feff5a44f1c tempest-ProjectMemberTests-1852265171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.803s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:37:32 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-b6124be0-d67f-4a7e-ad59-4feff5a44f1c tempest-ProjectMemberTests-1852265171 None] Create snapshot completed successfully Sep 28 17:37:33 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-4474c864-af6a-4db9-a598-b7447dc9be23 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-f8212c94-411e-4350-84d5-c6a689c11a39-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:33 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-4474c864-af6a-4db9-a598-b7447dc9be23 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-f8212c94-411e-4350-84d5-c6a689c11a39-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:33 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-4474c864-af6a-4db9-a598-b7447dc9be23 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-quobyte-cb3d136c-7619-46a3-beed-42765604faec" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:33 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-4474c864-af6a-4db9-a598-b7447dc9be23 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-cb3d136c-7619-46a3-beed-42765604faec" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:33 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-4474c864-af6a-4db9-a598-b7447dc9be23 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-quobyte-f8212c94-411e-4350-84d5-c6a689c11a39" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:33 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-4474c864-af6a-4db9-a598-b7447dc9be23 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-f8212c94-411e-4350-84d5-c6a689c11a39" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:33 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-4474c864-af6a-4db9-a598-b7447dc9be23 tempest-ProjectMemberTests-1852265171 None] Deleting offline snapshot f8212c94-411e-4350-84d5-c6a689c11a39 of volume cb3d136c-7619-46a3-beed-42765604faec {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:37:33 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-4474c864-af6a-4db9-a598-b7447dc9be23 tempest-ProjectMemberTests-1852265171 None] snapshot_file for this snap is: volume-cb3d136c-7619-46a3-beed-42765604faec.f8212c94-411e-4350-84d5-c6a689c11a39 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:37:33 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c5b676-fc85-435e-9335-7afa850cba30]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:37:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4474c864-af6a-4db9-a598-b7447dc9be23 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec.f8212c94-411e-4350-84d5-c6a689c11a39 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:33 devstack sudo[109268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec.f8212c94-411e-4350-84d5-c6a689c11a39 Sep 28 17:37:33 devstack sudo[109268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:33 devstack sudo[109268]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4474c864-af6a-4db9-a598-b7447dc9be23 tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec.f8212c94-411e-4350-84d5-c6a689c11a39" returned: 0 in 0.357s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:33 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-4474c864-af6a-4db9-a598-b7447dc9be23 tempest-ProjectMemberTests-1852265171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb3d136c-7619-46a3-beed-42765604faec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:37:33 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d97fe1-6bec-46ec-aae9-1fdf1a51c18c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:37:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4474c864-af6a-4db9-a598-b7447dc9be23 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:33 devstack sudo[109273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec Sep 28 17:37:33 devstack sudo[109273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:33 devstack sudo[109273]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4474c864-af6a-4db9-a598-b7447dc9be23 tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec" returned: 0 in 0.347s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4474c864-af6a-4db9-a598-b7447dc9be23 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec.f8212c94-411e-4350-84d5-c6a689c11a39 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:33 devstack sudo[109278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec.f8212c94-411e-4350-84d5-c6a689c11a39 Sep 28 17:37:33 devstack sudo[109278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:34 devstack sudo[109278]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4474c864-af6a-4db9-a598-b7447dc9be23 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec.f8212c94-411e-4350-84d5-c6a689c11a39" returned: 0 in 0.324s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4474c864-af6a-4db9-a598-b7447dc9be23 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec.f8212c94-411e-4350-84d5-c6a689c11a39 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:34 devstack sudo[109283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec.f8212c94-411e-4350-84d5-c6a689c11a39 Sep 28 17:37:34 devstack sudo[109283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:34 devstack sudo[109283]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4474c864-af6a-4db9-a598-b7447dc9be23 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec.f8212c94-411e-4350-84d5-c6a689c11a39" returned: 0 in 0.240s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:34 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-4474c864-af6a-4db9-a598-b7447dc9be23 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-f8212c94-411e-4350-84d5-c6a689c11a39" released by "_delete_snapshot" :: held 1.376s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:34 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-4474c864-af6a-4db9-a598-b7447dc9be23 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-cb3d136c-7619-46a3-beed-42765604faec" released by "delete_snapshot" :: held 1.399s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:34 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-4474c864-af6a-4db9-a598-b7447dc9be23 tempest-ProjectMemberTests-1852265171 None] Created reservations ['a11cf306-8fb8-40cb-833f-c0e500f36c1e', '83977899-eb15-4e0e-ae85-c15675d334a2', 'b28cfe08-a763-41fd-9843-590d2c5bfe56', '340e1b85-d213-45fe-8444-0123c6a8c5d2'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:37:34 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-4474c864-af6a-4db9-a598-b7447dc9be23 tempest-ProjectMemberTests-1852265171 None] Delete snapshot completed successfully. Sep 28 17:37:34 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-4474c864-af6a-4db9-a598-b7447dc9be23 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-f8212c94-411e-4350-84d5-c6a689c11a39-delete_snapshot" released by "delete_snapshot" :: held 1.536s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:35 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8cefa1cf-f6ca-418f-9ebb-da4e3baad260 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-cb3d136c-7619-46a3-beed-42765604faec-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:35 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8cefa1cf-f6ca-418f-9ebb-da4e3baad260 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-cb3d136c-7619-46a3-beed-42765604faec-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:35 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8cefa1cf-f6ca-418f-9ebb-da4e3baad260 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "cinder-quobyte-cb3d136c-7619-46a3-beed-42765604faec" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:35 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8cefa1cf-f6ca-418f-9ebb-da4e3baad260 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-cb3d136c-7619-46a3-beed-42765604faec" acquired by "delete_volume" :: waited 0.014s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:35 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfd93a1-b58e-420c-b420-69d2af6783cd]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:37:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8cefa1cf-f6ca-418f-9ebb-da4e3baad260 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:35 devstack sudo[109286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec Sep 28 17:37:35 devstack sudo[109286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:35 devstack sudo[109286]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8cefa1cf-f6ca-418f-9ebb-da4e3baad260 tempest-ProjectMemberTests-1852265171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec" returned: 0 in 0.365s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8cefa1cf-f6ca-418f-9ebb-da4e3baad260 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:35 devstack sudo[109291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec Sep 28 17:37:35 devstack sudo[109291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:35 devstack sudo[109291]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:35 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8cefa1cf-f6ca-418f-9ebb-da4e3baad260 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-cb3d136c-7619-46a3-beed-42765604faec" returned: 0 in 0.238s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:35 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8cefa1cf-f6ca-418f-9ebb-da4e3baad260 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-quobyte-cb3d136c-7619-46a3-beed-42765604faec" released by "delete_volume" :: held 0.660s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:36 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-8cefa1cf-f6ca-418f-9ebb-da4e3baad260 tempest-ProjectMemberTests-1852265171 None] Created reservations ['e79317f7-64ca-49ef-95ea-3e9adec9c429', 'a8dc3604-861f-4aa5-957f-8832dbe969da', '42e42797-e008-448c-9895-796a38cf2b8d', '5d4f0316-5f59-4809-a579-640f19cba217'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:37:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8cefa1cf-f6ca-418f-9ebb-da4e3baad260 tempest-ProjectMemberTests-1852265171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:37:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8cefa1cf-f6ca-418f-9ebb-da4e3baad260 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:37:36 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-8cefa1cf-f6ca-418f-9ebb-da4e3baad260 tempest-ProjectMemberTests-1852265171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:37:36 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-8cefa1cf-f6ca-418f-9ebb-da4e3baad260 tempest-ProjectMemberTests-1852265171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:37:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-8cefa1cf-f6ca-418f-9ebb-da4e3baad260 tempest-ProjectMemberTests-1852265171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:37:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8cefa1cf-f6ca-418f-9ebb-da4e3baad260 tempest-ProjectMemberTests-1852265171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:36 devstack sudo[109294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:37:36 devstack sudo[109294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:36 devstack sudo[109294]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:36 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8cefa1cf-f6ca-418f-9ebb-da4e3baad260 tempest-ProjectMemberTests-1852265171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.238s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:36 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-8cefa1cf-f6ca-418f-9ebb-da4e3baad260 tempest-ProjectMemberTests-1852265171 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:37:36 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-8cefa1cf-f6ca-418f-9ebb-da4e3baad260 tempest-ProjectMemberTests-1852265171 None] Deleted volume successfully. Sep 28 17:37:36 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8cefa1cf-f6ca-418f-9ebb-da4e3baad260 tempest-ProjectMemberTests-1852265171 None] Lock "cinder-cb3d136c-7619-46a3-beed-42765604faec-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:39 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-6811b479-8cf1-4311-a56b-31cdaa83b7b2 tempest-ProjectReaderTests-1222155939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:37:39 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6811b479-8cf1-4311-a56b-31cdaa83b7b2 tempest-ProjectReaderTests-1222155939 None] Flow 'volume_create_manager' (d59df558-81ed-44f6-bb40-7c5ea06c124d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:37:39 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6811b479-8cf1-4311-a56b-31cdaa83b7b2 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f72c980-c18a-4d04-b041-051f9e1af18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:39 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6811b479-8cf1-4311-a56b-31cdaa83b7b2 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f72c980-c18a-4d04-b041-051f9e1af18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-491422815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=633479e0-7c0b-4b15-8832-ba21a1ac3c82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae23ec65bc8f4c708326a2e2366de780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:37:40Z,use_quota=True,user_id='1d9ec54263a441558ee84f9542d8a627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6811b479-8cf1-4311-a56b-31cdaa83b7b2 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c53e29-9d96-4cf1-a3f4-7dacc4ab8a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6811b479-8cf1-4311-a56b-31cdaa83b7b2 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c53e29-9d96-4cf1-a3f4-7dacc4ab8a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6811b479-8cf1-4311-a56b-31cdaa83b7b2 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e948395a-7ab3-45f0-aa93-9f956dfeef84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6811b479-8cf1-4311-a56b-31cdaa83b7b2 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e948395a-7ab3-45f0-aa93-9f956dfeef84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '633479e0-7c0b-4b15-8832-ba21a1ac3c82', 'volume_name': 'volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6811b479-8cf1-4311-a56b-31cdaa83b7b2 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9a14a36-df48-4043-be9f-dbf352981e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6811b479-8cf1-4311-a56b-31cdaa83b7b2 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9a14a36-df48-4043-be9f-dbf352981e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6811b479-8cf1-4311-a56b-31cdaa83b7b2 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eda7579-2f4d-4cd5-bda5-bb3b998142ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:40 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-6811b479-8cf1-4311-a56b-31cdaa83b7b2 tempest-ProjectReaderTests-1222155939 None] Volume 633479e0-7c0b-4b15-8832-ba21a1ac3c82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82', 'volume_size': 1} Sep 28 17:37:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6811b479-8cf1-4311-a56b-31cdaa83b7b2 tempest-ProjectReaderTests-1222155939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:37:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6811b479-8cf1-4311-a56b-31cdaa83b7b2 tempest-ProjectReaderTests-1222155939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:37:40 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6811b479-8cf1-4311-a56b-31cdaa83b7b2 tempest-ProjectReaderTests-1222155939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-491422815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=633479e0-7c0b-4b15-8832-ba21a1ac3c82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae23ec65bc8f4c708326a2e2366de780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:37:40Z,use_quota=True,user_id='1d9ec54263a441558ee84f9542d8a627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:37:40 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-6811b479-8cf1-4311-a56b-31cdaa83b7b2 tempest-ProjectReaderTests-1222155939 None] Creating volume 633479e0-7c0b-4b15-8832-ba21a1ac3c82 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:37:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6811b479-8cf1-4311-a56b-31cdaa83b7b2 tempest-ProjectReaderTests-1222155939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:37:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6811b479-8cf1-4311-a56b-31cdaa83b7b2 tempest-ProjectReaderTests-1222155939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:37:40 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6811b479-8cf1-4311-a56b-31cdaa83b7b2 tempest-ProjectReaderTests-1222155939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:37:40 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6811b479-8cf1-4311-a56b-31cdaa83b7b2 tempest-ProjectReaderTests-1222155939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:37:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6811b479-8cf1-4311-a56b-31cdaa83b7b2 tempest-ProjectReaderTests-1222155939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:37:40 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6811b479-8cf1-4311-a56b-31cdaa83b7b2 tempest-ProjectReaderTests-1222155939 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:37:40 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-6811b479-8cf1-4311-a56b-31cdaa83b7b2 tempest-ProjectReaderTests-1222155939 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:37:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6811b479-8cf1-4311-a56b-31cdaa83b7b2 tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:40 devstack sudo[109297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82 1073741824 Sep 28 17:37:40 devstack sudo[109297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:40 devstack sudo[109297]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6811b479-8cf1-4311-a56b-31cdaa83b7b2 tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82 1073741824" returned: 0 in 0.456s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6811b479-8cf1-4311-a56b-31cdaa83b7b2 tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:40 devstack sudo[109303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82 Sep 28 17:37:40 devstack sudo[109303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:40 devstack sudo[109303]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-6811b479-8cf1-4311-a56b-31cdaa83b7b2 tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82" returned: 0 in 0.259s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:40 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-6811b479-8cf1-4311-a56b-31cdaa83b7b2 tempest-ProjectReaderTests-1222155939 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:37:40 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-6811b479-8cf1-4311-a56b-31cdaa83b7b2 tempest-ProjectReaderTests-1222155939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:37:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6811b479-8cf1-4311-a56b-31cdaa83b7b2 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eda7579-2f4d-4cd5-bda5-bb3b998142ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6811b479-8cf1-4311-a56b-31cdaa83b7b2 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4640746b-3186-4aef-af95-78207c4efe54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:40 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-6811b479-8cf1-4311-a56b-31cdaa83b7b2 tempest-ProjectReaderTests-1222155939 None] Volume volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82 (633479e0-7c0b-4b15-8832-ba21a1ac3c82): created successfully Sep 28 17:37:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6811b479-8cf1-4311-a56b-31cdaa83b7b2 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4640746b-3186-4aef-af95-78207c4efe54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:40 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-6811b479-8cf1-4311-a56b-31cdaa83b7b2 tempest-ProjectReaderTests-1222155939 None] Flow 'volume_create_manager' (d59df558-81ed-44f6-bb40-7c5ea06c124d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:37:40 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-6811b479-8cf1-4311-a56b-31cdaa83b7b2 tempest-ProjectReaderTests-1222155939 None] Created volume successfully. Sep 28 17:37:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ee4bd325-f2fb-4a54-bb6b-2bb50a1cf7bf tempest-ProjectReaderTests-1222155939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:37:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ee4bd325-f2fb-4a54-bb6b-2bb50a1cf7bf tempest-ProjectReaderTests-1222155939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:37:41 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-ee4bd325-f2fb-4a54-bb6b-2bb50a1cf7bf tempest-ProjectReaderTests-1222155939 None] Creating offline snapshot dea84a91-2258-47b5-a639-131d5364ef0d of volume 633479e0-7c0b-4b15-8832-ba21a1ac3c82 {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:37:41 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d023815-5d38-4518-b5ad-210f35244c1f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:37:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ee4bd325-f2fb-4a54-bb6b-2bb50a1cf7bf tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:41 devstack sudo[109306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82 Sep 28 17:37:41 devstack sudo[109306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:41 devstack sudo[109306]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ee4bd325-f2fb-4a54-bb6b-2bb50a1cf7bf tempest-ProjectReaderTests-1222155939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82" returned: 0 in 0.382s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:41 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ee4bd325-f2fb-4a54-bb6b-2bb50a1cf7bf tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82.dea84a91-2258-47b5-a639-131d5364ef0d 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:41 devstack sudo[109312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82.dea84a91-2258-47b5-a639-131d5364ef0d 1G Sep 28 17:37:41 devstack sudo[109312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:42 devstack sudo[109312]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ee4bd325-f2fb-4a54-bb6b-2bb50a1cf7bf tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82.dea84a91-2258-47b5-a639-131d5364ef0d 1G" returned: 0 in 0.453s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ee4bd325-f2fb-4a54-bb6b-2bb50a1cf7bf tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82.dea84a91-2258-47b5-a639-131d5364ef0d {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:42 devstack sudo[109317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82.dea84a91-2258-47b5-a639-131d5364ef0d Sep 28 17:37:42 devstack sudo[109317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:42 devstack sudo[109317]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ee4bd325-f2fb-4a54-bb6b-2bb50a1cf7bf tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82.dea84a91-2258-47b5-a639-131d5364ef0d" returned: 0 in 0.303s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:42 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-ee4bd325-f2fb-4a54-bb6b-2bb50a1cf7bf tempest-ProjectReaderTests-1222155939 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82.dea84a91-2258-47b5-a639-131d5364ef0d is being set with open permissions: ugo+rw Sep 28 17:37:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ee4bd325-f2fb-4a54-bb6b-2bb50a1cf7bf tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82.dea84a91-2258-47b5-a639-131d5364ef0d {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:42 devstack sudo[109322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82.dea84a91-2258-47b5-a639-131d5364ef0d Sep 28 17:37:42 devstack sudo[109322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:42 devstack sudo[109322]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ee4bd325-f2fb-4a54-bb6b-2bb50a1cf7bf tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82.dea84a91-2258-47b5-a639-131d5364ef0d" returned: 0 in 0.266s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ee4bd325-f2fb-4a54-bb6b-2bb50a1cf7bf tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:42 devstack sudo[109325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82.info Sep 28 17:37:42 devstack sudo[109325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:42 devstack sudo[109325]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ee4bd325-f2fb-4a54-bb6b-2bb50a1cf7bf tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82.info" returned: 0 in 0.259s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:42 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-ee4bd325-f2fb-4a54-bb6b-2bb50a1cf7bf tempest-ProjectReaderTests-1222155939 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82.info is being set with open permissions: ugo+rw Sep 28 17:37:42 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ee4bd325-f2fb-4a54-bb6b-2bb50a1cf7bf tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:42 devstack sudo[109328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82.info Sep 28 17:37:42 devstack sudo[109328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:43 devstack sudo[109328]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ee4bd325-f2fb-4a54-bb6b-2bb50a1cf7bf tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82.info" returned: 0 in 0.265s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:43 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ee4bd325-f2fb-4a54-bb6b-2bb50a1cf7bf tempest-ProjectReaderTests-1222155939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.023s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:37:43 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-ee4bd325-f2fb-4a54-bb6b-2bb50a1cf7bf tempest-ProjectReaderTests-1222155939 None] Create snapshot completed successfully Sep 28 17:37:44 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8f928398-1218-4ddf-9d1b-2f1626229c5c tempest-ProjectReaderTests-1222155939 None] Acquiring lock "cinder-dea84a91-2258-47b5-a639-131d5364ef0d-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:44 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8f928398-1218-4ddf-9d1b-2f1626229c5c tempest-ProjectReaderTests-1222155939 None] Lock "cinder-dea84a91-2258-47b5-a639-131d5364ef0d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:44 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8f928398-1218-4ddf-9d1b-2f1626229c5c tempest-ProjectReaderTests-1222155939 None] Acquiring lock "cinder-quobyte-633479e0-7c0b-4b15-8832-ba21a1ac3c82" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:44 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8f928398-1218-4ddf-9d1b-2f1626229c5c tempest-ProjectReaderTests-1222155939 None] Lock "cinder-quobyte-633479e0-7c0b-4b15-8832-ba21a1ac3c82" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:44 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8f928398-1218-4ddf-9d1b-2f1626229c5c tempest-ProjectReaderTests-1222155939 None] Acquiring lock "cinder-quobyte-dea84a91-2258-47b5-a639-131d5364ef0d" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:44 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8f928398-1218-4ddf-9d1b-2f1626229c5c tempest-ProjectReaderTests-1222155939 None] Lock "cinder-quobyte-dea84a91-2258-47b5-a639-131d5364ef0d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:44 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-8f928398-1218-4ddf-9d1b-2f1626229c5c tempest-ProjectReaderTests-1222155939 None] Deleting offline snapshot dea84a91-2258-47b5-a639-131d5364ef0d of volume 633479e0-7c0b-4b15-8832-ba21a1ac3c82 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:37:44 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-8f928398-1218-4ddf-9d1b-2f1626229c5c tempest-ProjectReaderTests-1222155939 None] snapshot_file for this snap is: volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82.dea84a91-2258-47b5-a639-131d5364ef0d {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:37:44 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7752189a-a67c-49a9-b069-0e9f3cf96075]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:37:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8f928398-1218-4ddf-9d1b-2f1626229c5c tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82.dea84a91-2258-47b5-a639-131d5364ef0d {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:44 devstack sudo[109332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82.dea84a91-2258-47b5-a639-131d5364ef0d Sep 28 17:37:44 devstack sudo[109332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:44 devstack sudo[109332]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8f928398-1218-4ddf-9d1b-2f1626229c5c tempest-ProjectReaderTests-1222155939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82.dea84a91-2258-47b5-a639-131d5364ef0d" returned: 0 in 0.355s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:44 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-8f928398-1218-4ddf-9d1b-2f1626229c5c tempest-ProjectReaderTests-1222155939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:37:44 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[84729807-facf-422f-b4ba-6fed162bc5d5]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:37:44 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8f928398-1218-4ddf-9d1b-2f1626229c5c tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:45 devstack sudo[109337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82 Sep 28 17:37:45 devstack sudo[109337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:45 devstack sudo[109337]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8f928398-1218-4ddf-9d1b-2f1626229c5c tempest-ProjectReaderTests-1222155939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82" returned: 0 in 0.364s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8f928398-1218-4ddf-9d1b-2f1626229c5c tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82.dea84a91-2258-47b5-a639-131d5364ef0d {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:45 devstack sudo[109342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82.dea84a91-2258-47b5-a639-131d5364ef0d Sep 28 17:37:45 devstack sudo[109342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:45 devstack sudo[109342]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8f928398-1218-4ddf-9d1b-2f1626229c5c tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82.dea84a91-2258-47b5-a639-131d5364ef0d" returned: 0 in 0.357s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8f928398-1218-4ddf-9d1b-2f1626229c5c tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82.dea84a91-2258-47b5-a639-131d5364ef0d {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:45 devstack sudo[109349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82.dea84a91-2258-47b5-a639-131d5364ef0d Sep 28 17:37:45 devstack sudo[109349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:45 devstack sudo[109349]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:45 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-8f928398-1218-4ddf-9d1b-2f1626229c5c tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82.dea84a91-2258-47b5-a639-131d5364ef0d" returned: 0 in 0.256s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:45 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8f928398-1218-4ddf-9d1b-2f1626229c5c tempest-ProjectReaderTests-1222155939 None] Lock "cinder-quobyte-dea84a91-2258-47b5-a639-131d5364ef0d" released by "_delete_snapshot" :: held 1.427s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:45 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8f928398-1218-4ddf-9d1b-2f1626229c5c tempest-ProjectReaderTests-1222155939 None] Lock "cinder-quobyte-633479e0-7c0b-4b15-8832-ba21a1ac3c82" released by "delete_snapshot" :: held 1.449s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:45 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-8f928398-1218-4ddf-9d1b-2f1626229c5c tempest-ProjectReaderTests-1222155939 None] Created reservations ['dd56fc97-c2ac-49d8-95b9-acd470a8e5d0', '7d9b6f8a-0c7a-4151-bdb6-6c9709bac0be', '4c24cec1-cc16-4fd7-9025-a7c215f64c71', '4bbd0a1a-ec76-4e37-9f24-97fdb093bae3'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:37:46 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-8f928398-1218-4ddf-9d1b-2f1626229c5c tempest-ProjectReaderTests-1222155939 None] Delete snapshot completed successfully. Sep 28 17:37:46 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-8f928398-1218-4ddf-9d1b-2f1626229c5c tempest-ProjectReaderTests-1222155939 None] Lock "cinder-dea84a91-2258-47b5-a639-131d5364ef0d-delete_snapshot" released by "delete_snapshot" :: held 1.589s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:46 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2712b8fa-776b-4110-831f-8f9c0633595c tempest-ProjectReaderTests-1222155939 None] Acquiring lock "cinder-633479e0-7c0b-4b15-8832-ba21a1ac3c82-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:46 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2712b8fa-776b-4110-831f-8f9c0633595c tempest-ProjectReaderTests-1222155939 None] Lock "cinder-633479e0-7c0b-4b15-8832-ba21a1ac3c82-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:46 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2712b8fa-776b-4110-831f-8f9c0633595c tempest-ProjectReaderTests-1222155939 None] Acquiring lock "cinder-quobyte-633479e0-7c0b-4b15-8832-ba21a1ac3c82" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:46 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2712b8fa-776b-4110-831f-8f9c0633595c tempest-ProjectReaderTests-1222155939 None] Lock "cinder-quobyte-633479e0-7c0b-4b15-8832-ba21a1ac3c82" acquired by "delete_volume" :: waited 0.016s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:46 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[d369bdfc-13eb-4588-8f71-6865513da86e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:37:46 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2712b8fa-776b-4110-831f-8f9c0633595c tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:46 devstack sudo[109353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82 Sep 28 17:37:46 devstack sudo[109353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:47 devstack sudo[109353]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2712b8fa-776b-4110-831f-8f9c0633595c tempest-ProjectReaderTests-1222155939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82" returned: 0 in 0.382s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2712b8fa-776b-4110-831f-8f9c0633595c tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:47 devstack sudo[109358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82 Sep 28 17:37:47 devstack sudo[109358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:47 devstack sudo[109358]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2712b8fa-776b-4110-831f-8f9c0633595c tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-633479e0-7c0b-4b15-8832-ba21a1ac3c82" returned: 0 in 0.255s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:47 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2712b8fa-776b-4110-831f-8f9c0633595c tempest-ProjectReaderTests-1222155939 None] Lock "cinder-quobyte-633479e0-7c0b-4b15-8832-ba21a1ac3c82" released by "delete_volume" :: held 0.704s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:47 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-2712b8fa-776b-4110-831f-8f9c0633595c tempest-ProjectReaderTests-1222155939 None] Created reservations ['48619ccf-a28e-49ad-925d-ad3ebb1dd6c0', '7565400d-8fdd-4090-9bd6-9b4c1d3ca45e', 'd8e45ac6-e2a5-4d04-90f2-2132ce481ebd', '2ae4dcea-e2da-4e24-8127-c3e1263a038b'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:37:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2712b8fa-776b-4110-831f-8f9c0633595c tempest-ProjectReaderTests-1222155939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:37:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2712b8fa-776b-4110-831f-8f9c0633595c tempest-ProjectReaderTests-1222155939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:37:47 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-2712b8fa-776b-4110-831f-8f9c0633595c tempest-ProjectReaderTests-1222155939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:37:47 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-2712b8fa-776b-4110-831f-8f9c0633595c tempest-ProjectReaderTests-1222155939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:37:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-2712b8fa-776b-4110-831f-8f9c0633595c tempest-ProjectReaderTests-1222155939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:37:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2712b8fa-776b-4110-831f-8f9c0633595c tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:47 devstack sudo[109361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:37:47 devstack sudo[109361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:47 devstack sudo[109361]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:47 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-2712b8fa-776b-4110-831f-8f9c0633595c tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.259s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:47 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-2712b8fa-776b-4110-831f-8f9c0633595c tempest-ProjectReaderTests-1222155939 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:37:47 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-2712b8fa-776b-4110-831f-8f9c0633595c tempest-ProjectReaderTests-1222155939 None] Deleted volume successfully. Sep 28 17:37:47 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-2712b8fa-776b-4110-831f-8f9c0633595c tempest-ProjectReaderTests-1222155939 None] Lock "cinder-633479e0-7c0b-4b15-8832-ba21a1ac3c82-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:48 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-a571083a-6462-4cf0-93e9-b5e058b3309a tempest-ProjectReaderTests-1222155939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:37:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a571083a-6462-4cf0-93e9-b5e058b3309a tempest-ProjectReaderTests-1222155939 None] Flow 'volume_create_manager' (2c8b324c-86c0-433f-abdc-bc57cd10249d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:37:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a571083a-6462-4cf0-93e9-b5e058b3309a tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf363686-76fc-435d-99a9-3eeb3843ba0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a571083a-6462-4cf0-93e9-b5e058b3309a tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf363686-76fc-435d-99a9-3eeb3843ba0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2131006842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad016c28-fb0b-4ed1-a5ee-961de8413728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae23ec65bc8f4c708326a2e2366de780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:37:48Z,use_quota=True,user_id='1d9ec54263a441558ee84f9542d8a627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a571083a-6462-4cf0-93e9-b5e058b3309a tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c70a9d1-d730-49a1-87af-8b8b71a9485d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a571083a-6462-4cf0-93e9-b5e058b3309a tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c70a9d1-d730-49a1-87af-8b8b71a9485d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a571083a-6462-4cf0-93e9-b5e058b3309a tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b8045b-d704-476d-a3cd-9bb784525df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a571083a-6462-4cf0-93e9-b5e058b3309a tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b8045b-d704-476d-a3cd-9bb784525df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad016c28-fb0b-4ed1-a5ee-961de8413728', 'volume_name': 'volume-ad016c28-fb0b-4ed1-a5ee-961de8413728', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a571083a-6462-4cf0-93e9-b5e058b3309a tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12d8d745-16a2-482c-a99f-e777cc73aad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a571083a-6462-4cf0-93e9-b5e058b3309a tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12d8d745-16a2-482c-a99f-e777cc73aad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:48 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a571083a-6462-4cf0-93e9-b5e058b3309a tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa3f49b-3083-4ca3-9242-3170615a27c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:48 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-a571083a-6462-4cf0-93e9-b5e058b3309a tempest-ProjectReaderTests-1222155939 None] Volume ad016c28-fb0b-4ed1-a5ee-961de8413728: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad016c28-fb0b-4ed1-a5ee-961de8413728', 'volume_size': 1} Sep 28 17:37:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a571083a-6462-4cf0-93e9-b5e058b3309a tempest-ProjectReaderTests-1222155939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:37:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a571083a-6462-4cf0-93e9-b5e058b3309a tempest-ProjectReaderTests-1222155939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:37:48 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a571083a-6462-4cf0-93e9-b5e058b3309a tempest-ProjectReaderTests-1222155939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2131006842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad016c28-fb0b-4ed1-a5ee-961de8413728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae23ec65bc8f4c708326a2e2366de780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:37:48Z,use_quota=True,user_id='1d9ec54263a441558ee84f9542d8a627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:37:48 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-a571083a-6462-4cf0-93e9-b5e058b3309a tempest-ProjectReaderTests-1222155939 None] Creating volume ad016c28-fb0b-4ed1-a5ee-961de8413728 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:37:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a571083a-6462-4cf0-93e9-b5e058b3309a tempest-ProjectReaderTests-1222155939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:37:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a571083a-6462-4cf0-93e9-b5e058b3309a tempest-ProjectReaderTests-1222155939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:37:48 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a571083a-6462-4cf0-93e9-b5e058b3309a tempest-ProjectReaderTests-1222155939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:37:48 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a571083a-6462-4cf0-93e9-b5e058b3309a tempest-ProjectReaderTests-1222155939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:37:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a571083a-6462-4cf0-93e9-b5e058b3309a tempest-ProjectReaderTests-1222155939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:37:48 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a571083a-6462-4cf0-93e9-b5e058b3309a tempest-ProjectReaderTests-1222155939 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:37:48 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-a571083a-6462-4cf0-93e9-b5e058b3309a tempest-ProjectReaderTests-1222155939 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:37:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a571083a-6462-4cf0-93e9-b5e058b3309a tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:48 devstack sudo[109364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728 1073741824 Sep 28 17:37:48 devstack sudo[109364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:48 devstack sudo[109364]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a571083a-6462-4cf0-93e9-b5e058b3309a tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728 1073741824" returned: 0 in 0.433s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:48 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a571083a-6462-4cf0-93e9-b5e058b3309a tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:48 devstack sudo[109369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728 Sep 28 17:37:48 devstack sudo[109369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:49 devstack sudo[109369]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-a571083a-6462-4cf0-93e9-b5e058b3309a tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728" returned: 0 in 0.258s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-a571083a-6462-4cf0-93e9-b5e058b3309a tempest-ProjectReaderTests-1222155939 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:37:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-a571083a-6462-4cf0-93e9-b5e058b3309a tempest-ProjectReaderTests-1222155939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:37:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a571083a-6462-4cf0-93e9-b5e058b3309a tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa3f49b-3083-4ca3-9242-3170615a27c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad016c28-fb0b-4ed1-a5ee-961de8413728', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a571083a-6462-4cf0-93e9-b5e058b3309a tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c783fdb-17e4-43c2-898f-d34808186b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:49 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-a571083a-6462-4cf0-93e9-b5e058b3309a tempest-ProjectReaderTests-1222155939 None] Volume volume-ad016c28-fb0b-4ed1-a5ee-961de8413728 (ad016c28-fb0b-4ed1-a5ee-961de8413728): created successfully Sep 28 17:37:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a571083a-6462-4cf0-93e9-b5e058b3309a tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c783fdb-17e4-43c2-898f-d34808186b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-a571083a-6462-4cf0-93e9-b5e058b3309a tempest-ProjectReaderTests-1222155939 None] Flow 'volume_create_manager' (2c8b324c-86c0-433f-abdc-bc57cd10249d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:37:49 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-a571083a-6462-4cf0-93e9-b5e058b3309a tempest-ProjectReaderTests-1222155939 None] Created volume successfully. Sep 28 17:37:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-339a5d0c-82a1-4b3d-85af-fbcab452d778 tempest-ProjectReaderTests-1222155939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:37:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-339a5d0c-82a1-4b3d-85af-fbcab452d778 tempest-ProjectReaderTests-1222155939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:37:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-339a5d0c-82a1-4b3d-85af-fbcab452d778 tempest-ProjectReaderTests-1222155939 None] Creating offline snapshot 98fe78ea-db7d-43cb-b8c3-75a0bdd5b88d of volume ad016c28-fb0b-4ed1-a5ee-961de8413728 {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:37:49 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c4e254-8713-4b79-bdb5-6440d4191311]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:37:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-339a5d0c-82a1-4b3d-85af-fbcab452d778 tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:37:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:37:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:37:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:37:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:37:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:37:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:49 devstack sudo[109373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:37:49 devstack sudo[109373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:49 devstack sudo[109372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728 Sep 28 17:37:49 devstack sudo[109372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:49 devstack sudo[109373]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.265s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:49 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:37:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager._thread_info {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:37:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread count: 28 {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:37:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread info: [<_MainThread(MainThread, started 132915553284224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:37:49 devstack sudo[109372]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-339a5d0c-82a1-4b3d-85af-fbcab452d778 tempest-ProjectReaderTests-1222155939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728" returned: 0 in 0.389s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-339a5d0c-82a1-4b3d-85af-fbcab452d778 tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728.98fe78ea-db7d-43cb-b8c3-75a0bdd5b88d 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:49 devstack sudo[109380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728.98fe78ea-db7d-43cb-b8c3-75a0bdd5b88d 1G Sep 28 17:37:49 devstack sudo[109380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:50 devstack sudo[109380]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-339a5d0c-82a1-4b3d-85af-fbcab452d778 tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728.98fe78ea-db7d-43cb-b8c3-75a0bdd5b88d 1G" returned: 0 in 0.393s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-339a5d0c-82a1-4b3d-85af-fbcab452d778 tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad016c28-fb0b-4ed1-a5ee-961de8413728 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728.98fe78ea-db7d-43cb-b8c3-75a0bdd5b88d {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:50 devstack sudo[109385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad016c28-fb0b-4ed1-a5ee-961de8413728 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728.98fe78ea-db7d-43cb-b8c3-75a0bdd5b88d Sep 28 17:37:50 devstack sudo[109385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:50 devstack sudo[109385]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-339a5d0c-82a1-4b3d-85af-fbcab452d778 tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad016c28-fb0b-4ed1-a5ee-961de8413728 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728.98fe78ea-db7d-43cb-b8c3-75a0bdd5b88d" returned: 0 in 0.282s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:50 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-339a5d0c-82a1-4b3d-85af-fbcab452d778 tempest-ProjectReaderTests-1222155939 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728.98fe78ea-db7d-43cb-b8c3-75a0bdd5b88d is being set with open permissions: ugo+rw Sep 28 17:37:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-339a5d0c-82a1-4b3d-85af-fbcab452d778 tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728.98fe78ea-db7d-43cb-b8c3-75a0bdd5b88d {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:50 devstack sudo[109390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728.98fe78ea-db7d-43cb-b8c3-75a0bdd5b88d Sep 28 17:37:50 devstack sudo[109390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:50 devstack sudo[109390]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-339a5d0c-82a1-4b3d-85af-fbcab452d778 tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728.98fe78ea-db7d-43cb-b8c3-75a0bdd5b88d" returned: 0 in 0.244s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:50 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-339a5d0c-82a1-4b3d-85af-fbcab452d778 tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:50 devstack sudo[109393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728.info Sep 28 17:37:50 devstack sudo[109393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:51 devstack sudo[109393]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-339a5d0c-82a1-4b3d-85af-fbcab452d778 tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728.info" returned: 0 in 0.257s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:51 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-339a5d0c-82a1-4b3d-85af-fbcab452d778 tempest-ProjectReaderTests-1222155939 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728.info is being set with open permissions: ugo+rw Sep 28 17:37:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-339a5d0c-82a1-4b3d-85af-fbcab452d778 tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:51 devstack sudo[109396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728.info Sep 28 17:37:51 devstack sudo[109396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:51 devstack sudo[109396]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-339a5d0c-82a1-4b3d-85af-fbcab452d778 tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728.info" returned: 0 in 0.264s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-339a5d0c-82a1-4b3d-85af-fbcab452d778 tempest-ProjectReaderTests-1222155939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.912s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:37:51 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-339a5d0c-82a1-4b3d-85af-fbcab452d778 tempest-ProjectReaderTests-1222155939 None] Create snapshot completed successfully Sep 28 17:37:51 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c00b2d0d-3505-4758-8e7c-1f62fa0480df tempest-ProjectReaderTests-1222155939 None] Acquiring lock "cinder-98fe78ea-db7d-43cb-b8c3-75a0bdd5b88d-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:51 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c00b2d0d-3505-4758-8e7c-1f62fa0480df tempest-ProjectReaderTests-1222155939 None] Lock "cinder-98fe78ea-db7d-43cb-b8c3-75a0bdd5b88d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:51 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c00b2d0d-3505-4758-8e7c-1f62fa0480df tempest-ProjectReaderTests-1222155939 None] Acquiring lock "cinder-quobyte-ad016c28-fb0b-4ed1-a5ee-961de8413728" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:51 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c00b2d0d-3505-4758-8e7c-1f62fa0480df tempest-ProjectReaderTests-1222155939 None] Lock "cinder-quobyte-ad016c28-fb0b-4ed1-a5ee-961de8413728" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:51 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c00b2d0d-3505-4758-8e7c-1f62fa0480df tempest-ProjectReaderTests-1222155939 None] Acquiring lock "cinder-quobyte-98fe78ea-db7d-43cb-b8c3-75a0bdd5b88d" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:51 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c00b2d0d-3505-4758-8e7c-1f62fa0480df tempest-ProjectReaderTests-1222155939 None] Lock "cinder-quobyte-98fe78ea-db7d-43cb-b8c3-75a0bdd5b88d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:51 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-c00b2d0d-3505-4758-8e7c-1f62fa0480df tempest-ProjectReaderTests-1222155939 None] Deleting offline snapshot 98fe78ea-db7d-43cb-b8c3-75a0bdd5b88d of volume ad016c28-fb0b-4ed1-a5ee-961de8413728 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:37:51 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-c00b2d0d-3505-4758-8e7c-1f62fa0480df tempest-ProjectReaderTests-1222155939 None] snapshot_file for this snap is: volume-ad016c28-fb0b-4ed1-a5ee-961de8413728.98fe78ea-db7d-43cb-b8c3-75a0bdd5b88d {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:37:51 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4479836-d0cb-4b31-8dba-f189902cd2f2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:37:51 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c00b2d0d-3505-4758-8e7c-1f62fa0480df tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728.98fe78ea-db7d-43cb-b8c3-75a0bdd5b88d {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:51 devstack sudo[109400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728.98fe78ea-db7d-43cb-b8c3-75a0bdd5b88d Sep 28 17:37:51 devstack sudo[109400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:52 devstack sudo[109400]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c00b2d0d-3505-4758-8e7c-1f62fa0480df tempest-ProjectReaderTests-1222155939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728.98fe78ea-db7d-43cb-b8c3-75a0bdd5b88d" returned: 0 in 0.365s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:52 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-c00b2d0d-3505-4758-8e7c-1f62fa0480df tempest-ProjectReaderTests-1222155939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad016c28-fb0b-4ed1-a5ee-961de8413728(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:37:52 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5507c657-b008-444b-807a-00f1974e46ef]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:37:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c00b2d0d-3505-4758-8e7c-1f62fa0480df tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:52 devstack sudo[109405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728 Sep 28 17:37:52 devstack sudo[109405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:52 devstack sudo[109405]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c00b2d0d-3505-4758-8e7c-1f62fa0480df tempest-ProjectReaderTests-1222155939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728" returned: 0 in 0.364s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c00b2d0d-3505-4758-8e7c-1f62fa0480df tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728.98fe78ea-db7d-43cb-b8c3-75a0bdd5b88d {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:52 devstack sudo[109410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728.98fe78ea-db7d-43cb-b8c3-75a0bdd5b88d Sep 28 17:37:52 devstack sudo[109410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:52 devstack sudo[109410]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c00b2d0d-3505-4758-8e7c-1f62fa0480df tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728.98fe78ea-db7d-43cb-b8c3-75a0bdd5b88d" returned: 0 in 0.328s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c00b2d0d-3505-4758-8e7c-1f62fa0480df tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728.98fe78ea-db7d-43cb-b8c3-75a0bdd5b88d {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:52 devstack sudo[109415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728.98fe78ea-db7d-43cb-b8c3-75a0bdd5b88d Sep 28 17:37:52 devstack sudo[109415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:52 devstack sudo[109415]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:52 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c00b2d0d-3505-4758-8e7c-1f62fa0480df tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728.98fe78ea-db7d-43cb-b8c3-75a0bdd5b88d" returned: 0 in 0.242s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:53 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c00b2d0d-3505-4758-8e7c-1f62fa0480df tempest-ProjectReaderTests-1222155939 None] Lock "cinder-quobyte-98fe78ea-db7d-43cb-b8c3-75a0bdd5b88d" released by "_delete_snapshot" :: held 1.399s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:53 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c00b2d0d-3505-4758-8e7c-1f62fa0480df tempest-ProjectReaderTests-1222155939 None] Lock "cinder-quobyte-ad016c28-fb0b-4ed1-a5ee-961de8413728" released by "delete_snapshot" :: held 1.421s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:53 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-c00b2d0d-3505-4758-8e7c-1f62fa0480df tempest-ProjectReaderTests-1222155939 None] Created reservations ['ac3a1664-10b9-4f08-8783-942a09445176', 'eeea2765-04af-4e16-8946-b8d2e47e5436', '81edddd7-38f5-4733-b0d0-7bd7404b72b7', '7947387c-8eed-4fec-8594-41561110f284'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:37:53 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-c00b2d0d-3505-4758-8e7c-1f62fa0480df tempest-ProjectReaderTests-1222155939 None] Delete snapshot completed successfully. Sep 28 17:37:53 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c00b2d0d-3505-4758-8e7c-1f62fa0480df tempest-ProjectReaderTests-1222155939 None] Lock "cinder-98fe78ea-db7d-43cb-b8c3-75a0bdd5b88d-delete_snapshot" released by "delete_snapshot" :: held 1.600s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:53 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1a16cc26-5ce2-42d0-93c5-fa8845cb5edc tempest-ProjectReaderTests-1222155939 None] Acquiring lock "cinder-ad016c28-fb0b-4ed1-a5ee-961de8413728-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:53 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1a16cc26-5ce2-42d0-93c5-fa8845cb5edc tempest-ProjectReaderTests-1222155939 None] Lock "cinder-ad016c28-fb0b-4ed1-a5ee-961de8413728-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:53 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1a16cc26-5ce2-42d0-93c5-fa8845cb5edc tempest-ProjectReaderTests-1222155939 None] Acquiring lock "cinder-quobyte-ad016c28-fb0b-4ed1-a5ee-961de8413728" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:53 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1a16cc26-5ce2-42d0-93c5-fa8845cb5edc tempest-ProjectReaderTests-1222155939 None] Lock "cinder-quobyte-ad016c28-fb0b-4ed1-a5ee-961de8413728" acquired by "delete_volume" :: waited 0.014s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:53 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1634cf-baf7-46ba-a386-09c51791ce22]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:37:53 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1a16cc26-5ce2-42d0-93c5-fa8845cb5edc tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:53 devstack sudo[109418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728 Sep 28 17:37:53 devstack sudo[109418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:54 devstack sudo[109418]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1a16cc26-5ce2-42d0-93c5-fa8845cb5edc tempest-ProjectReaderTests-1222155939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728" returned: 0 in 0.373s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1a16cc26-5ce2-42d0-93c5-fa8845cb5edc tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:54 devstack sudo[109423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728 Sep 28 17:37:54 devstack sudo[109423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:54 devstack sudo[109423]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1a16cc26-5ce2-42d0-93c5-fa8845cb5edc tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-ad016c28-fb0b-4ed1-a5ee-961de8413728" returned: 0 in 0.268s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:54 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1a16cc26-5ce2-42d0-93c5-fa8845cb5edc tempest-ProjectReaderTests-1222155939 None] Lock "cinder-quobyte-ad016c28-fb0b-4ed1-a5ee-961de8413728" released by "delete_volume" :: held 0.705s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:54 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-1a16cc26-5ce2-42d0-93c5-fa8845cb5edc tempest-ProjectReaderTests-1222155939 None] Created reservations ['7209b774-2542-45d1-a2bc-ed21060e6aaf', '4adf2b6d-6583-4dd0-be3e-418d78382cbe', '0b6e06d8-0ee4-4d73-9e85-1ca464f3f870', '3fa4af7f-cca9-49d0-921e-d0646226b083'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:37:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1a16cc26-5ce2-42d0-93c5-fa8845cb5edc tempest-ProjectReaderTests-1222155939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:37:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1a16cc26-5ce2-42d0-93c5-fa8845cb5edc tempest-ProjectReaderTests-1222155939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:37:54 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-1a16cc26-5ce2-42d0-93c5-fa8845cb5edc tempest-ProjectReaderTests-1222155939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:37:54 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-1a16cc26-5ce2-42d0-93c5-fa8845cb5edc tempest-ProjectReaderTests-1222155939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:37:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-1a16cc26-5ce2-42d0-93c5-fa8845cb5edc tempest-ProjectReaderTests-1222155939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:37:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1a16cc26-5ce2-42d0-93c5-fa8845cb5edc tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:54 devstack sudo[109426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:37:54 devstack sudo[109426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:54 devstack sudo[109426]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:54 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1a16cc26-5ce2-42d0-93c5-fa8845cb5edc tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.245s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:54 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-1a16cc26-5ce2-42d0-93c5-fa8845cb5edc tempest-ProjectReaderTests-1222155939 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:37:54 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-1a16cc26-5ce2-42d0-93c5-fa8845cb5edc tempest-ProjectReaderTests-1222155939 None] Deleted volume successfully. Sep 28 17:37:54 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1a16cc26-5ce2-42d0-93c5-fa8845cb5edc tempest-ProjectReaderTests-1222155939 None] Lock "cinder-ad016c28-fb0b-4ed1-a5ee-961de8413728-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:37:55 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3fb8fe6-1198-414b-a4d6-83d4e3a582df tempest-ProjectReaderTests-1222155939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:37:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f3fb8fe6-1198-414b-a4d6-83d4e3a582df tempest-ProjectReaderTests-1222155939 None] Flow 'volume_create_manager' (896a9f8f-8c82-4ac9-9965-2a087e378084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:37:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f3fb8fe6-1198-414b-a4d6-83d4e3a582df tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2acfe85-1d42-47d3-9dd8-25401a3fbf26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f3fb8fe6-1198-414b-a4d6-83d4e3a582df tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2acfe85-1d42-47d3-9dd8-25401a3fbf26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-397305779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59ffdb48-0285-4a4e-91bc-cf0da4dde7b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae23ec65bc8f4c708326a2e2366de780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:37:55Z,use_quota=True,user_id='1d9ec54263a441558ee84f9542d8a627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f3fb8fe6-1198-414b-a4d6-83d4e3a582df tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aabcad89-4df2-4c2c-a68d-eb43cf2943d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f3fb8fe6-1198-414b-a4d6-83d4e3a582df tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aabcad89-4df2-4c2c-a68d-eb43cf2943d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f3fb8fe6-1198-414b-a4d6-83d4e3a582df tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62f90fc-281d-4c25-a1ce-7fe02b64795f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f3fb8fe6-1198-414b-a4d6-83d4e3a582df tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62f90fc-281d-4c25-a1ce-7fe02b64795f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59ffdb48-0285-4a4e-91bc-cf0da4dde7b7', 'volume_name': 'volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f3fb8fe6-1198-414b-a4d6-83d4e3a582df tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc1261c-ed23-49da-9389-ca4daf43ca78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f3fb8fe6-1198-414b-a4d6-83d4e3a582df tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc1261c-ed23-49da-9389-ca4daf43ca78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:55 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f3fb8fe6-1198-414b-a4d6-83d4e3a582df tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bffd30e-b2da-4a4b-a339-20420ebcce57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:55 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-f3fb8fe6-1198-414b-a4d6-83d4e3a582df tempest-ProjectReaderTests-1222155939 None] Volume 59ffdb48-0285-4a4e-91bc-cf0da4dde7b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7', 'volume_size': 1} Sep 28 17:37:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f3fb8fe6-1198-414b-a4d6-83d4e3a582df tempest-ProjectReaderTests-1222155939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:37:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f3fb8fe6-1198-414b-a4d6-83d4e3a582df tempest-ProjectReaderTests-1222155939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:37:55 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f3fb8fe6-1198-414b-a4d6-83d4e3a582df tempest-ProjectReaderTests-1222155939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-397305779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59ffdb48-0285-4a4e-91bc-cf0da4dde7b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae23ec65bc8f4c708326a2e2366de780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:37:55Z,use_quota=True,user_id='1d9ec54263a441558ee84f9542d8a627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:37:55 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-f3fb8fe6-1198-414b-a4d6-83d4e3a582df tempest-ProjectReaderTests-1222155939 None] Creating volume 59ffdb48-0285-4a4e-91bc-cf0da4dde7b7 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:37:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f3fb8fe6-1198-414b-a4d6-83d4e3a582df tempest-ProjectReaderTests-1222155939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:37:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f3fb8fe6-1198-414b-a4d6-83d4e3a582df tempest-ProjectReaderTests-1222155939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:37:55 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f3fb8fe6-1198-414b-a4d6-83d4e3a582df tempest-ProjectReaderTests-1222155939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:37:55 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f3fb8fe6-1198-414b-a4d6-83d4e3a582df tempest-ProjectReaderTests-1222155939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:37:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f3fb8fe6-1198-414b-a4d6-83d4e3a582df tempest-ProjectReaderTests-1222155939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:37:55 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f3fb8fe6-1198-414b-a4d6-83d4e3a582df tempest-ProjectReaderTests-1222155939 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:37:55 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-f3fb8fe6-1198-414b-a4d6-83d4e3a582df tempest-ProjectReaderTests-1222155939 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:37:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f3fb8fe6-1198-414b-a4d6-83d4e3a582df tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:55 devstack sudo[109429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7 1073741824 Sep 28 17:37:55 devstack sudo[109429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:55 devstack sudo[109429]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f3fb8fe6-1198-414b-a4d6-83d4e3a582df tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7 1073741824" returned: 0 in 0.451s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:55 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f3fb8fe6-1198-414b-a4d6-83d4e3a582df tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:55 devstack sudo[109434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7 Sep 28 17:37:55 devstack sudo[109434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:56 devstack sudo[109434]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-f3fb8fe6-1198-414b-a4d6-83d4e3a582df tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7" returned: 0 in 0.285s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:56 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-f3fb8fe6-1198-414b-a4d6-83d4e3a582df tempest-ProjectReaderTests-1222155939 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:37:56 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-f3fb8fe6-1198-414b-a4d6-83d4e3a582df tempest-ProjectReaderTests-1222155939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:37:56 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f3fb8fe6-1198-414b-a4d6-83d4e3a582df tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bffd30e-b2da-4a4b-a339-20420ebcce57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:56 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f3fb8fe6-1198-414b-a4d6-83d4e3a582df tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd97b044-30b4-493b-8e81-ab2ed3caf602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:37:56 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-f3fb8fe6-1198-414b-a4d6-83d4e3a582df tempest-ProjectReaderTests-1222155939 None] Volume volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7 (59ffdb48-0285-4a4e-91bc-cf0da4dde7b7): created successfully Sep 28 17:37:56 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f3fb8fe6-1198-414b-a4d6-83d4e3a582df tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd97b044-30b4-493b-8e81-ab2ed3caf602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:37:56 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-f3fb8fe6-1198-414b-a4d6-83d4e3a582df tempest-ProjectReaderTests-1222155939 None] Flow 'volume_create_manager' (896a9f8f-8c82-4ac9-9965-2a087e378084) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:37:56 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-f3fb8fe6-1198-414b-a4d6-83d4e3a582df tempest-ProjectReaderTests-1222155939 None] Created volume successfully. Sep 28 17:37:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4ab3d5aa-cda5-404e-9821-3b1e049344a2 tempest-ProjectReaderTests-1222155939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:37:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4ab3d5aa-cda5-404e-9821-3b1e049344a2 tempest-ProjectReaderTests-1222155939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:37:57 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-4ab3d5aa-cda5-404e-9821-3b1e049344a2 tempest-ProjectReaderTests-1222155939 None] Creating offline snapshot e8edc347-4936-44a0-aeaa-31a6a54d9f2a of volume 59ffdb48-0285-4a4e-91bc-cf0da4dde7b7 {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:37:57 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c97341-d496-4182-a6c7-28315b678243]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:37:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4ab3d5aa-cda5-404e-9821-3b1e049344a2 tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:57 devstack sudo[109437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7 Sep 28 17:37:57 devstack sudo[109437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:57 devstack sudo[109437]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4ab3d5aa-cda5-404e-9821-3b1e049344a2 tempest-ProjectReaderTests-1222155939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7" returned: 0 in 0.372s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:57 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4ab3d5aa-cda5-404e-9821-3b1e049344a2 tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7.e8edc347-4936-44a0-aeaa-31a6a54d9f2a 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:57 devstack sudo[109442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7.e8edc347-4936-44a0-aeaa-31a6a54d9f2a 1G Sep 28 17:37:57 devstack sudo[109442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:58 devstack sudo[109442]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4ab3d5aa-cda5-404e-9821-3b1e049344a2 tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7.e8edc347-4936-44a0-aeaa-31a6a54d9f2a 1G" returned: 0 in 0.382s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4ab3d5aa-cda5-404e-9821-3b1e049344a2 tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7.e8edc347-4936-44a0-aeaa-31a6a54d9f2a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:58 devstack sudo[109447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7.e8edc347-4936-44a0-aeaa-31a6a54d9f2a Sep 28 17:37:58 devstack sudo[109447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:58 devstack sudo[109447]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4ab3d5aa-cda5-404e-9821-3b1e049344a2 tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7.e8edc347-4936-44a0-aeaa-31a6a54d9f2a" returned: 0 in 0.278s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:58 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-4ab3d5aa-cda5-404e-9821-3b1e049344a2 tempest-ProjectReaderTests-1222155939 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7.e8edc347-4936-44a0-aeaa-31a6a54d9f2a is being set with open permissions: ugo+rw Sep 28 17:37:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4ab3d5aa-cda5-404e-9821-3b1e049344a2 tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7.e8edc347-4936-44a0-aeaa-31a6a54d9f2a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:58 devstack sudo[109452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7.e8edc347-4936-44a0-aeaa-31a6a54d9f2a Sep 28 17:37:58 devstack sudo[109452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:58 devstack sudo[109452]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4ab3d5aa-cda5-404e-9821-3b1e049344a2 tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7.e8edc347-4936-44a0-aeaa-31a6a54d9f2a" returned: 0 in 0.232s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:58 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4ab3d5aa-cda5-404e-9821-3b1e049344a2 tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:58 devstack sudo[109455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7.info Sep 28 17:37:58 devstack sudo[109455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:59 devstack sudo[109455]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4ab3d5aa-cda5-404e-9821-3b1e049344a2 tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7.info" returned: 0 in 0.236s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:59 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-4ab3d5aa-cda5-404e-9821-3b1e049344a2 tempest-ProjectReaderTests-1222155939 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7.info is being set with open permissions: ugo+rw Sep 28 17:37:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4ab3d5aa-cda5-404e-9821-3b1e049344a2 tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:59 devstack sudo[109458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7.info Sep 28 17:37:59 devstack sudo[109458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:37:59 devstack sudo[109458]: pam_unix(sudo:session): session closed for user root Sep 28 17:37:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-4ab3d5aa-cda5-404e-9821-3b1e049344a2 tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7.info" returned: 0 in 0.242s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:37:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-4ab3d5aa-cda5-404e-9821-3b1e049344a2 tempest-ProjectReaderTests-1222155939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.826s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:37:59 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-4ab3d5aa-cda5-404e-9821-3b1e049344a2 tempest-ProjectReaderTests-1222155939 None] Create snapshot completed successfully Sep 28 17:37:59 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c75de40e-d8ab-408e-88f7-082f79d2426a tempest-ProjectReaderTests-1222155939 None] Acquiring lock "cinder-e8edc347-4936-44a0-aeaa-31a6a54d9f2a-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:59 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c75de40e-d8ab-408e-88f7-082f79d2426a tempest-ProjectReaderTests-1222155939 None] Lock "cinder-e8edc347-4936-44a0-aeaa-31a6a54d9f2a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:59 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c75de40e-d8ab-408e-88f7-082f79d2426a tempest-ProjectReaderTests-1222155939 None] Acquiring lock "cinder-quobyte-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:59 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c75de40e-d8ab-408e-88f7-082f79d2426a tempest-ProjectReaderTests-1222155939 None] Lock "cinder-quobyte-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:59 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c75de40e-d8ab-408e-88f7-082f79d2426a tempest-ProjectReaderTests-1222155939 None] Acquiring lock "cinder-quobyte-e8edc347-4936-44a0-aeaa-31a6a54d9f2a" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:37:59 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c75de40e-d8ab-408e-88f7-082f79d2426a tempest-ProjectReaderTests-1222155939 None] Lock "cinder-quobyte-e8edc347-4936-44a0-aeaa-31a6a54d9f2a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:37:59 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-c75de40e-d8ab-408e-88f7-082f79d2426a tempest-ProjectReaderTests-1222155939 None] Deleting offline snapshot e8edc347-4936-44a0-aeaa-31a6a54d9f2a of volume 59ffdb48-0285-4a4e-91bc-cf0da4dde7b7 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:37:59 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-c75de40e-d8ab-408e-88f7-082f79d2426a tempest-ProjectReaderTests-1222155939 None] snapshot_file for this snap is: volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7.e8edc347-4936-44a0-aeaa-31a6a54d9f2a {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:37:59 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dec4442-a773-4c5a-9196-5821fd21150d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:37:59 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c75de40e-d8ab-408e-88f7-082f79d2426a tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7.e8edc347-4936-44a0-aeaa-31a6a54d9f2a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:37:59 devstack sudo[109461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7.e8edc347-4936-44a0-aeaa-31a6a54d9f2a Sep 28 17:37:59 devstack sudo[109461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:00 devstack sudo[109461]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c75de40e-d8ab-408e-88f7-082f79d2426a tempest-ProjectReaderTests-1222155939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7.e8edc347-4936-44a0-aeaa-31a6a54d9f2a" returned: 0 in 0.350s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:00 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-c75de40e-d8ab-408e-88f7-082f79d2426a tempest-ProjectReaderTests-1222155939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:38:00 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aec0356-06f2-4cee-8732-39c6ccf72f62]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:38:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c75de40e-d8ab-408e-88f7-082f79d2426a tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:00 devstack sudo[109466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7 Sep 28 17:38:00 devstack sudo[109466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:00 devstack sudo[109466]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c75de40e-d8ab-408e-88f7-082f79d2426a tempest-ProjectReaderTests-1222155939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7" returned: 0 in 0.370s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c75de40e-d8ab-408e-88f7-082f79d2426a tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7.e8edc347-4936-44a0-aeaa-31a6a54d9f2a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:00 devstack sudo[109471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7.e8edc347-4936-44a0-aeaa-31a6a54d9f2a Sep 28 17:38:00 devstack sudo[109471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:00 devstack sudo[109471]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c75de40e-d8ab-408e-88f7-082f79d2426a tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7.e8edc347-4936-44a0-aeaa-31a6a54d9f2a" returned: 0 in 0.341s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:00 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c75de40e-d8ab-408e-88f7-082f79d2426a tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7.e8edc347-4936-44a0-aeaa-31a6a54d9f2a {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:00 devstack sudo[109476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7.e8edc347-4936-44a0-aeaa-31a6a54d9f2a Sep 28 17:38:00 devstack sudo[109476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:01 devstack sudo[109476]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c75de40e-d8ab-408e-88f7-082f79d2426a tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7.e8edc347-4936-44a0-aeaa-31a6a54d9f2a" returned: 0 in 0.285s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:01 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c75de40e-d8ab-408e-88f7-082f79d2426a tempest-ProjectReaderTests-1222155939 None] Lock "cinder-quobyte-e8edc347-4936-44a0-aeaa-31a6a54d9f2a" released by "_delete_snapshot" :: held 1.443s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:38:01 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c75de40e-d8ab-408e-88f7-082f79d2426a tempest-ProjectReaderTests-1222155939 None] Lock "cinder-quobyte-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7" released by "delete_snapshot" :: held 1.464s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:38:01 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-c75de40e-d8ab-408e-88f7-082f79d2426a tempest-ProjectReaderTests-1222155939 None] Created reservations ['9ced0601-5293-4424-9c37-b2d0f090ff1e', '5bf60340-5ab6-4b79-bf1e-fc2f4c10dac9', '2ec29ccb-7fc1-48e3-a3e6-5486698d9af3', '28a7a0db-c0d6-4d60-941a-abf9be98b586'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:38:01 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-c75de40e-d8ab-408e-88f7-082f79d2426a tempest-ProjectReaderTests-1222155939 None] Delete snapshot completed successfully. Sep 28 17:38:01 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c75de40e-d8ab-408e-88f7-082f79d2426a tempest-ProjectReaderTests-1222155939 None] Lock "cinder-e8edc347-4936-44a0-aeaa-31a6a54d9f2a-delete_snapshot" released by "delete_snapshot" :: held 1.607s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:38:01 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e4b3be9b-c83c-459f-90fd-e31c168ea3ac tempest-ProjectReaderTests-1222155939 None] Acquiring lock "cinder-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:38:01 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e4b3be9b-c83c-459f-90fd-e31c168ea3ac tempest-ProjectReaderTests-1222155939 None] Lock "cinder-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:38:01 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e4b3be9b-c83c-459f-90fd-e31c168ea3ac tempest-ProjectReaderTests-1222155939 None] Acquiring lock "cinder-quobyte-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:38:01 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e4b3be9b-c83c-459f-90fd-e31c168ea3ac tempest-ProjectReaderTests-1222155939 None] Lock "cinder-quobyte-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7" acquired by "delete_volume" :: waited 0.017s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:38:01 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6ecaf9-ba60-49e8-bdc4-da30dde28628]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:38:01 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e4b3be9b-c83c-459f-90fd-e31c168ea3ac tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:02 devstack sudo[109480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7 Sep 28 17:38:02 devstack sudo[109480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:02 devstack sudo[109480]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e4b3be9b-c83c-459f-90fd-e31c168ea3ac tempest-ProjectReaderTests-1222155939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7" returned: 0 in 0.361s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e4b3be9b-c83c-459f-90fd-e31c168ea3ac tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:02 devstack sudo[109485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7 Sep 28 17:38:02 devstack sudo[109485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:02 devstack sudo[109485]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e4b3be9b-c83c-459f-90fd-e31c168ea3ac tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7" returned: 0 in 0.255s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:02 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e4b3be9b-c83c-459f-90fd-e31c168ea3ac tempest-ProjectReaderTests-1222155939 None] Lock "cinder-quobyte-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7" released by "delete_volume" :: held 0.681s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:38:02 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-e4b3be9b-c83c-459f-90fd-e31c168ea3ac tempest-ProjectReaderTests-1222155939 None] Created reservations ['b8f8bd1a-d6a5-496f-a04b-79ffa3dbb3ce', '61e82bc0-b930-4ea8-806a-c90fb0756e73', 'f4e3de6a-4a4a-461d-8872-ed2785a6318d', '0f4de78f-8aec-4eba-a58b-7d1fd135608b'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:38:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e4b3be9b-c83c-459f-90fd-e31c168ea3ac tempest-ProjectReaderTests-1222155939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:38:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e4b3be9b-c83c-459f-90fd-e31c168ea3ac tempest-ProjectReaderTests-1222155939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:38:02 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-e4b3be9b-c83c-459f-90fd-e31c168ea3ac tempest-ProjectReaderTests-1222155939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:38:02 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-e4b3be9b-c83c-459f-90fd-e31c168ea3ac tempest-ProjectReaderTests-1222155939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:38:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-e4b3be9b-c83c-459f-90fd-e31c168ea3ac tempest-ProjectReaderTests-1222155939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:38:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e4b3be9b-c83c-459f-90fd-e31c168ea3ac tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:02 devstack sudo[109488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:38:02 devstack sudo[109488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:02 devstack sudo[109488]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:02 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-e4b3be9b-c83c-459f-90fd-e31c168ea3ac tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.255s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:02 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-e4b3be9b-c83c-459f-90fd-e31c168ea3ac tempest-ProjectReaderTests-1222155939 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:38:03 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-e4b3be9b-c83c-459f-90fd-e31c168ea3ac tempest-ProjectReaderTests-1222155939 None] Deleted volume successfully. Sep 28 17:38:03 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-e4b3be9b-c83c-459f-90fd-e31c168ea3ac tempest-ProjectReaderTests-1222155939 None] Lock "cinder-59ffdb48-0285-4a4e-91bc-cf0da4dde7b7-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:38:03 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-443625a4-4a97-4e88-86c9-338578a02f94 tempest-ProjectReaderTests-1222155939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:38:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-443625a4-4a97-4e88-86c9-338578a02f94 tempest-ProjectReaderTests-1222155939 None] Flow 'volume_create_manager' (062e642d-25e9-4e8b-8f06-ef0513c81ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:38:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-443625a4-4a97-4e88-86c9-338578a02f94 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c906963f-1eb2-4338-b4b9-ff15d0e403b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:38:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-443625a4-4a97-4e88-86c9-338578a02f94 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c906963f-1eb2-4338-b4b9-ff15d0e403b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-526465467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65dd601-8944-47cd-a7fb-6b67897d2c98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae23ec65bc8f4c708326a2e2366de780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:38:03Z,use_quota=True,user_id='1d9ec54263a441558ee84f9542d8a627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:38:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-443625a4-4a97-4e88-86c9-338578a02f94 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06d850ca-0dde-4c34-a09e-f0fabd77c209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:38:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-443625a4-4a97-4e88-86c9-338578a02f94 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06d850ca-0dde-4c34-a09e-f0fabd77c209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:38:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-443625a4-4a97-4e88-86c9-338578a02f94 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3788416d-a30a-4adb-9111-abed3e2eb3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:38:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-443625a4-4a97-4e88-86c9-338578a02f94 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3788416d-a30a-4adb-9111-abed3e2eb3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b65dd601-8944-47cd-a7fb-6b67897d2c98', 'volume_name': 'volume-b65dd601-8944-47cd-a7fb-6b67897d2c98', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:38:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-443625a4-4a97-4e88-86c9-338578a02f94 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66fbf4c6-9e51-4744-8ac7-be05d8d6b033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:38:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-443625a4-4a97-4e88-86c9-338578a02f94 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66fbf4c6-9e51-4744-8ac7-be05d8d6b033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:38:03 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-443625a4-4a97-4e88-86c9-338578a02f94 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df7f3fe-6950-4925-89e4-2dc71c88165f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:38:03 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-443625a4-4a97-4e88-86c9-338578a02f94 tempest-ProjectReaderTests-1222155939 None] Volume b65dd601-8944-47cd-a7fb-6b67897d2c98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b65dd601-8944-47cd-a7fb-6b67897d2c98', 'volume_size': 1} Sep 28 17:38:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-443625a4-4a97-4e88-86c9-338578a02f94 tempest-ProjectReaderTests-1222155939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:38:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-443625a4-4a97-4e88-86c9-338578a02f94 tempest-ProjectReaderTests-1222155939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:38:03 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-443625a4-4a97-4e88-86c9-338578a02f94 tempest-ProjectReaderTests-1222155939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-526465467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65dd601-8944-47cd-a7fb-6b67897d2c98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae23ec65bc8f4c708326a2e2366de780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:38:03Z,use_quota=True,user_id='1d9ec54263a441558ee84f9542d8a627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:38:03 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-443625a4-4a97-4e88-86c9-338578a02f94 tempest-ProjectReaderTests-1222155939 None] Creating volume b65dd601-8944-47cd-a7fb-6b67897d2c98 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:38:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-443625a4-4a97-4e88-86c9-338578a02f94 tempest-ProjectReaderTests-1222155939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:38:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-443625a4-4a97-4e88-86c9-338578a02f94 tempest-ProjectReaderTests-1222155939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:38:03 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-443625a4-4a97-4e88-86c9-338578a02f94 tempest-ProjectReaderTests-1222155939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:38:03 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-443625a4-4a97-4e88-86c9-338578a02f94 tempest-ProjectReaderTests-1222155939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:38:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-443625a4-4a97-4e88-86c9-338578a02f94 tempest-ProjectReaderTests-1222155939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:38:03 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-443625a4-4a97-4e88-86c9-338578a02f94 tempest-ProjectReaderTests-1222155939 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:38:03 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-443625a4-4a97-4e88-86c9-338578a02f94 tempest-ProjectReaderTests-1222155939 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:38:03 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-443625a4-4a97-4e88-86c9-338578a02f94 tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:03 devstack sudo[109491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98 1073741824 Sep 28 17:38:03 devstack sudo[109491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:04 devstack sudo[109491]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-443625a4-4a97-4e88-86c9-338578a02f94 tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98 1073741824" returned: 0 in 0.446s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-443625a4-4a97-4e88-86c9-338578a02f94 tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:04 devstack sudo[109497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98 Sep 28 17:38:04 devstack sudo[109497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:04 devstack sudo[109497]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-443625a4-4a97-4e88-86c9-338578a02f94 tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98" returned: 0 in 0.256s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:04 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-443625a4-4a97-4e88-86c9-338578a02f94 tempest-ProjectReaderTests-1222155939 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:38:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-443625a4-4a97-4e88-86c9-338578a02f94 tempest-ProjectReaderTests-1222155939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:38:04 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-443625a4-4a97-4e88-86c9-338578a02f94 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df7f3fe-6950-4925-89e4-2dc71c88165f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b65dd601-8944-47cd-a7fb-6b67897d2c98', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:38:04 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-443625a4-4a97-4e88-86c9-338578a02f94 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce0de8b-3ca1-4f44-ba07-194eb757c1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:38:04 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-443625a4-4a97-4e88-86c9-338578a02f94 tempest-ProjectReaderTests-1222155939 None] Volume volume-b65dd601-8944-47cd-a7fb-6b67897d2c98 (b65dd601-8944-47cd-a7fb-6b67897d2c98): created successfully Sep 28 17:38:04 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-443625a4-4a97-4e88-86c9-338578a02f94 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce0de8b-3ca1-4f44-ba07-194eb757c1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:38:04 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-443625a4-4a97-4e88-86c9-338578a02f94 tempest-ProjectReaderTests-1222155939 None] Flow 'volume_create_manager' (062e642d-25e9-4e8b-8f06-ef0513c81ab8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:38:04 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-443625a4-4a97-4e88-86c9-338578a02f94 tempest-ProjectReaderTests-1222155939 None] Created volume successfully. Sep 28 17:38:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-fab07fbf-eedd-4292-b642-7551e6a020c9 tempest-ProjectReaderTests-1222155939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:38:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-fab07fbf-eedd-4292-b642-7551e6a020c9 tempest-ProjectReaderTests-1222155939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:38:04 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-fab07fbf-eedd-4292-b642-7551e6a020c9 tempest-ProjectReaderTests-1222155939 None] Creating offline snapshot 0f11953a-7bb4-4404-9195-ffe1d1648b50 of volume b65dd601-8944-47cd-a7fb-6b67897d2c98 {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:38:04 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[504b7b85-0e80-4cc1-be1c-d2786e7087e9]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:38:04 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fab07fbf-eedd-4292-b642-7551e6a020c9 tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:04 devstack sudo[109500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98 Sep 28 17:38:04 devstack sudo[109500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:05 devstack sudo[109500]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fab07fbf-eedd-4292-b642-7551e6a020c9 tempest-ProjectReaderTests-1222155939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98" returned: 0 in 0.356s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fab07fbf-eedd-4292-b642-7551e6a020c9 tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98.0f11953a-7bb4-4404-9195-ffe1d1648b50 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:05 devstack sudo[109505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98.0f11953a-7bb4-4404-9195-ffe1d1648b50 1G Sep 28 17:38:05 devstack sudo[109505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:05 devstack sudo[109505]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fab07fbf-eedd-4292-b642-7551e6a020c9 tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98.0f11953a-7bb4-4404-9195-ffe1d1648b50 1G" returned: 0 in 0.383s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fab07fbf-eedd-4292-b642-7551e6a020c9 tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b65dd601-8944-47cd-a7fb-6b67897d2c98 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98.0f11953a-7bb4-4404-9195-ffe1d1648b50 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:05 devstack sudo[109510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b65dd601-8944-47cd-a7fb-6b67897d2c98 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98.0f11953a-7bb4-4404-9195-ffe1d1648b50 Sep 28 17:38:05 devstack sudo[109510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:05 devstack sudo[109510]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fab07fbf-eedd-4292-b642-7551e6a020c9 tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b65dd601-8944-47cd-a7fb-6b67897d2c98 -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98.0f11953a-7bb4-4404-9195-ffe1d1648b50" returned: 0 in 0.296s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:05 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-fab07fbf-eedd-4292-b642-7551e6a020c9 tempest-ProjectReaderTests-1222155939 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98.0f11953a-7bb4-4404-9195-ffe1d1648b50 is being set with open permissions: ugo+rw Sep 28 17:38:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fab07fbf-eedd-4292-b642-7551e6a020c9 tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98.0f11953a-7bb4-4404-9195-ffe1d1648b50 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:05 devstack sudo[109515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98.0f11953a-7bb4-4404-9195-ffe1d1648b50 Sep 28 17:38:05 devstack sudo[109515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:05 devstack sudo[109515]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fab07fbf-eedd-4292-b642-7551e6a020c9 tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98.0f11953a-7bb4-4404-9195-ffe1d1648b50" returned: 0 in 0.248s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:05 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fab07fbf-eedd-4292-b642-7551e6a020c9 tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:06 devstack sudo[109518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98.info Sep 28 17:38:06 devstack sudo[109518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:06 devstack sudo[109518]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fab07fbf-eedd-4292-b642-7551e6a020c9 tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98.info" returned: 0 in 0.259s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:06 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-fab07fbf-eedd-4292-b642-7551e6a020c9 tempest-ProjectReaderTests-1222155939 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98.info is being set with open permissions: ugo+rw Sep 28 17:38:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fab07fbf-eedd-4292-b642-7551e6a020c9 tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:06 devstack sudo[109521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98.info Sep 28 17:38:06 devstack sudo[109521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:06 devstack sudo[109521]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fab07fbf-eedd-4292-b642-7551e6a020c9 tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98.info" returned: 0 in 0.245s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-fab07fbf-eedd-4292-b642-7551e6a020c9 tempest-ProjectReaderTests-1222155939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.867s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:38:06 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-fab07fbf-eedd-4292-b642-7551e6a020c9 tempest-ProjectReaderTests-1222155939 None] Create snapshot completed successfully Sep 28 17:38:06 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1d9dab88-b744-4b36-a47a-cfc700e07087 tempest-ProjectReaderTests-1222155939 None] Acquiring lock "cinder-0f11953a-7bb4-4404-9195-ffe1d1648b50-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:38:06 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1d9dab88-b744-4b36-a47a-cfc700e07087 tempest-ProjectReaderTests-1222155939 None] Lock "cinder-0f11953a-7bb4-4404-9195-ffe1d1648b50-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:38:06 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1d9dab88-b744-4b36-a47a-cfc700e07087 tempest-ProjectReaderTests-1222155939 None] Acquiring lock "cinder-quobyte-b65dd601-8944-47cd-a7fb-6b67897d2c98" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:38:06 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1d9dab88-b744-4b36-a47a-cfc700e07087 tempest-ProjectReaderTests-1222155939 None] Lock "cinder-quobyte-b65dd601-8944-47cd-a7fb-6b67897d2c98" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:38:06 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1d9dab88-b744-4b36-a47a-cfc700e07087 tempest-ProjectReaderTests-1222155939 None] Acquiring lock "cinder-quobyte-0f11953a-7bb4-4404-9195-ffe1d1648b50" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:38:06 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1d9dab88-b744-4b36-a47a-cfc700e07087 tempest-ProjectReaderTests-1222155939 None] Lock "cinder-quobyte-0f11953a-7bb4-4404-9195-ffe1d1648b50" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:38:06 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-1d9dab88-b744-4b36-a47a-cfc700e07087 tempest-ProjectReaderTests-1222155939 None] Deleting offline snapshot 0f11953a-7bb4-4404-9195-ffe1d1648b50 of volume b65dd601-8944-47cd-a7fb-6b67897d2c98 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:38:06 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-1d9dab88-b744-4b36-a47a-cfc700e07087 tempest-ProjectReaderTests-1222155939 None] snapshot_file for this snap is: volume-b65dd601-8944-47cd-a7fb-6b67897d2c98.0f11953a-7bb4-4404-9195-ffe1d1648b50 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:38:06 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[5399a2ce-9de4-4e1b-b030-77c9e3461dcd]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:38:06 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1d9dab88-b744-4b36-a47a-cfc700e07087 tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98.0f11953a-7bb4-4404-9195-ffe1d1648b50 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:06 devstack sudo[109524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98.0f11953a-7bb4-4404-9195-ffe1d1648b50 Sep 28 17:38:06 devstack sudo[109524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:07 devstack sudo[109524]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1d9dab88-b744-4b36-a47a-cfc700e07087 tempest-ProjectReaderTests-1222155939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98.0f11953a-7bb4-4404-9195-ffe1d1648b50" returned: 0 in 0.340s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:07 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-1d9dab88-b744-4b36-a47a-cfc700e07087 tempest-ProjectReaderTests-1222155939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b65dd601-8944-47cd-a7fb-6b67897d2c98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:38:07 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b31713-2525-4eee-98de-e6f58f1dd28d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:38:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1d9dab88-b744-4b36-a47a-cfc700e07087 tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:07 devstack sudo[109529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98 Sep 28 17:38:07 devstack sudo[109529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:07 devstack sudo[109529]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1d9dab88-b744-4b36-a47a-cfc700e07087 tempest-ProjectReaderTests-1222155939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98" returned: 0 in 0.356s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1d9dab88-b744-4b36-a47a-cfc700e07087 tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98.0f11953a-7bb4-4404-9195-ffe1d1648b50 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:07 devstack sudo[109534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98.0f11953a-7bb4-4404-9195-ffe1d1648b50 Sep 28 17:38:07 devstack sudo[109534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:07 devstack sudo[109534]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1d9dab88-b744-4b36-a47a-cfc700e07087 tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98.0f11953a-7bb4-4404-9195-ffe1d1648b50" returned: 0 in 0.321s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:07 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1d9dab88-b744-4b36-a47a-cfc700e07087 tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98.0f11953a-7bb4-4404-9195-ffe1d1648b50 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:07 devstack sudo[109539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98.0f11953a-7bb4-4404-9195-ffe1d1648b50 Sep 28 17:38:07 devstack sudo[109539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:08 devstack sudo[109539]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:08 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-1d9dab88-b744-4b36-a47a-cfc700e07087 tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98.0f11953a-7bb4-4404-9195-ffe1d1648b50" returned: 0 in 0.229s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:08 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1d9dab88-b744-4b36-a47a-cfc700e07087 tempest-ProjectReaderTests-1222155939 None] Lock "cinder-quobyte-0f11953a-7bb4-4404-9195-ffe1d1648b50" released by "_delete_snapshot" :: held 1.340s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:38:08 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1d9dab88-b744-4b36-a47a-cfc700e07087 tempest-ProjectReaderTests-1222155939 None] Lock "cinder-quobyte-b65dd601-8944-47cd-a7fb-6b67897d2c98" released by "delete_snapshot" :: held 1.367s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:38:08 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-1d9dab88-b744-4b36-a47a-cfc700e07087 tempest-ProjectReaderTests-1222155939 None] Created reservations ['87f4497c-e769-442e-b785-6c3fa585479a', 'eebd90d7-553e-47ef-8cf2-04260bd6c2f7', 'ce0c8b69-145f-4cdf-9030-e61112ae97bf', '2a561b3d-8138-4fd9-9b15-93f9ae8e8a86'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:38:08 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-1d9dab88-b744-4b36-a47a-cfc700e07087 tempest-ProjectReaderTests-1222155939 None] Delete snapshot completed successfully. Sep 28 17:38:08 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-1d9dab88-b744-4b36-a47a-cfc700e07087 tempest-ProjectReaderTests-1222155939 None] Lock "cinder-0f11953a-7bb4-4404-9195-ffe1d1648b50-delete_snapshot" released by "delete_snapshot" :: held 1.501s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:38:08 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-af146e70-b8c0-4857-88c4-3f21ba8f7e06 tempest-ProjectReaderTests-1222155939 None] Acquiring lock "cinder-b65dd601-8944-47cd-a7fb-6b67897d2c98-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:38:08 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-af146e70-b8c0-4857-88c4-3f21ba8f7e06 tempest-ProjectReaderTests-1222155939 None] Lock "cinder-b65dd601-8944-47cd-a7fb-6b67897d2c98-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:38:08 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-af146e70-b8c0-4857-88c4-3f21ba8f7e06 tempest-ProjectReaderTests-1222155939 None] Acquiring lock "cinder-quobyte-b65dd601-8944-47cd-a7fb-6b67897d2c98" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:38:08 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-af146e70-b8c0-4857-88c4-3f21ba8f7e06 tempest-ProjectReaderTests-1222155939 None] Lock "cinder-quobyte-b65dd601-8944-47cd-a7fb-6b67897d2c98" acquired by "delete_volume" :: waited 0.017s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:38:09 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fc1110-8c59-4fc1-aafb-e427b0d3c846]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:38:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-af146e70-b8c0-4857-88c4-3f21ba8f7e06 tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:09 devstack sudo[109542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98 Sep 28 17:38:09 devstack sudo[109542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:09 devstack sudo[109542]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-af146e70-b8c0-4857-88c4-3f21ba8f7e06 tempest-ProjectReaderTests-1222155939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98" returned: 0 in 0.367s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-af146e70-b8c0-4857-88c4-3f21ba8f7e06 tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:09 devstack sudo[109547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98 Sep 28 17:38:09 devstack sudo[109547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:09 devstack sudo[109547]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-af146e70-b8c0-4857-88c4-3f21ba8f7e06 tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-b65dd601-8944-47cd-a7fb-6b67897d2c98" returned: 0 in 0.239s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:09 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-af146e70-b8c0-4857-88c4-3f21ba8f7e06 tempest-ProjectReaderTests-1222155939 None] Lock "cinder-quobyte-b65dd601-8944-47cd-a7fb-6b67897d2c98" released by "delete_volume" :: held 0.671s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:38:09 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-af146e70-b8c0-4857-88c4-3f21ba8f7e06 tempest-ProjectReaderTests-1222155939 None] Created reservations ['080989d2-a87e-4fd3-aa6d-493ccf430d38', '5ba6794d-1feb-4d02-bb93-84423ca40d05', 'b2ccc4fd-65da-4af1-b612-e89bad6347c1', 'c7c7089f-ba37-451d-a9a3-28ad8bc319c3'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:38:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-af146e70-b8c0-4857-88c4-3f21ba8f7e06 tempest-ProjectReaderTests-1222155939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:38:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-af146e70-b8c0-4857-88c4-3f21ba8f7e06 tempest-ProjectReaderTests-1222155939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:38:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-af146e70-b8c0-4857-88c4-3f21ba8f7e06 tempest-ProjectReaderTests-1222155939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:38:09 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-af146e70-b8c0-4857-88c4-3f21ba8f7e06 tempest-ProjectReaderTests-1222155939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:38:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-af146e70-b8c0-4857-88c4-3f21ba8f7e06 tempest-ProjectReaderTests-1222155939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:38:09 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-af146e70-b8c0-4857-88c4-3f21ba8f7e06 tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:09 devstack sudo[109550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:38:09 devstack sudo[109550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:10 devstack sudo[109550]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-af146e70-b8c0-4857-88c4-3f21ba8f7e06 tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.234s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:10 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-af146e70-b8c0-4857-88c4-3f21ba8f7e06 tempest-ProjectReaderTests-1222155939 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:38:10 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-af146e70-b8c0-4857-88c4-3f21ba8f7e06 tempest-ProjectReaderTests-1222155939 None] Deleted volume successfully. Sep 28 17:38:10 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-af146e70-b8c0-4857-88c4-3f21ba8f7e06 tempest-ProjectReaderTests-1222155939 None] Lock "cinder-b65dd601-8944-47cd-a7fb-6b67897d2c98-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:38:10 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-506ed98d-afd5-4be8-a9f9-62b6c4569c00 tempest-ProjectReaderTests-1222155939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:38:10 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-506ed98d-afd5-4be8-a9f9-62b6c4569c00 tempest-ProjectReaderTests-1222155939 None] Flow 'volume_create_manager' (2ed09d01-9dbb-4613-9c88-0db5531a043a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:38:10 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-506ed98d-afd5-4be8-a9f9-62b6c4569c00 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27027f0b-bd5a-4f07-8cf2-f4d859ae1b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:38:10 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-506ed98d-afd5-4be8-a9f9-62b6c4569c00 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27027f0b-bd5a-4f07-8cf2-f4d859ae1b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1207590950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4802808d-9a1f-48e5-9888-29d438b5aefb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae23ec65bc8f4c708326a2e2366de780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:38:10Z,use_quota=True,user_id='1d9ec54263a441558ee84f9542d8a627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:38:10 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-506ed98d-afd5-4be8-a9f9-62b6c4569c00 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (883050b3-dd19-4dce-bbef-66f9ba9ba864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:38:10 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-506ed98d-afd5-4be8-a9f9-62b6c4569c00 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (883050b3-dd19-4dce-bbef-66f9ba9ba864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:38:10 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-506ed98d-afd5-4be8-a9f9-62b6c4569c00 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f22779a6-968d-46c5-8fec-9f98cf59d2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:38:10 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-506ed98d-afd5-4be8-a9f9-62b6c4569c00 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f22779a6-968d-46c5-8fec-9f98cf59d2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4802808d-9a1f-48e5-9888-29d438b5aefb', 'volume_name': 'volume-4802808d-9a1f-48e5-9888-29d438b5aefb', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:38:10 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-506ed98d-afd5-4be8-a9f9-62b6c4569c00 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e85b2680-8ee0-4d74-aedd-584f6f672c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:38:10 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-506ed98d-afd5-4be8-a9f9-62b6c4569c00 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e85b2680-8ee0-4d74-aedd-584f6f672c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:38:10 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-506ed98d-afd5-4be8-a9f9-62b6c4569c00 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fd49b07-775e-4e5a-9292-287dba203d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:38:10 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-506ed98d-afd5-4be8-a9f9-62b6c4569c00 tempest-ProjectReaderTests-1222155939 None] Volume 4802808d-9a1f-48e5-9888-29d438b5aefb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4802808d-9a1f-48e5-9888-29d438b5aefb', 'volume_size': 1} Sep 28 17:38:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-506ed98d-afd5-4be8-a9f9-62b6c4569c00 tempest-ProjectReaderTests-1222155939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:38:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-506ed98d-afd5-4be8-a9f9-62b6c4569c00 tempest-ProjectReaderTests-1222155939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:38:10 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-506ed98d-afd5-4be8-a9f9-62b6c4569c00 tempest-ProjectReaderTests-1222155939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1207590950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4802808d-9a1f-48e5-9888-29d438b5aefb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae23ec65bc8f4c708326a2e2366de780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:38:10Z,use_quota=True,user_id='1d9ec54263a441558ee84f9542d8a627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:38:10 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-506ed98d-afd5-4be8-a9f9-62b6c4569c00 tempest-ProjectReaderTests-1222155939 None] Creating volume 4802808d-9a1f-48e5-9888-29d438b5aefb {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:38:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-506ed98d-afd5-4be8-a9f9-62b6c4569c00 tempest-ProjectReaderTests-1222155939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:38:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-506ed98d-afd5-4be8-a9f9-62b6c4569c00 tempest-ProjectReaderTests-1222155939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:38:10 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-506ed98d-afd5-4be8-a9f9-62b6c4569c00 tempest-ProjectReaderTests-1222155939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:38:10 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-506ed98d-afd5-4be8-a9f9-62b6c4569c00 tempest-ProjectReaderTests-1222155939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:38:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-506ed98d-afd5-4be8-a9f9-62b6c4569c00 tempest-ProjectReaderTests-1222155939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:38:10 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-506ed98d-afd5-4be8-a9f9-62b6c4569c00 tempest-ProjectReaderTests-1222155939 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:38:10 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-506ed98d-afd5-4be8-a9f9-62b6c4569c00 tempest-ProjectReaderTests-1222155939 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:38:10 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-506ed98d-afd5-4be8-a9f9-62b6c4569c00 tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:10 devstack sudo[109553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb 1073741824 Sep 28 17:38:10 devstack sudo[109553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:11 devstack sudo[109553]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-506ed98d-afd5-4be8-a9f9-62b6c4569c00 tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb 1073741824" returned: 0 in 0.405s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-506ed98d-afd5-4be8-a9f9-62b6c4569c00 tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:11 devstack sudo[109559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb Sep 28 17:38:11 devstack sudo[109559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:11 devstack sudo[109559]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-506ed98d-afd5-4be8-a9f9-62b6c4569c00 tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb" returned: 0 in 0.245s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-506ed98d-afd5-4be8-a9f9-62b6c4569c00 tempest-ProjectReaderTests-1222155939 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:38:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-506ed98d-afd5-4be8-a9f9-62b6c4569c00 tempest-ProjectReaderTests-1222155939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:38:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-506ed98d-afd5-4be8-a9f9-62b6c4569c00 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fd49b07-775e-4e5a-9292-287dba203d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4802808d-9a1f-48e5-9888-29d438b5aefb', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:38:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-506ed98d-afd5-4be8-a9f9-62b6c4569c00 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e56376f2-e59f-4596-a5d4-e6cf6cee7e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:38:11 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-506ed98d-afd5-4be8-a9f9-62b6c4569c00 tempest-ProjectReaderTests-1222155939 None] Volume volume-4802808d-9a1f-48e5-9888-29d438b5aefb (4802808d-9a1f-48e5-9888-29d438b5aefb): created successfully Sep 28 17:38:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-506ed98d-afd5-4be8-a9f9-62b6c4569c00 tempest-ProjectReaderTests-1222155939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e56376f2-e59f-4596-a5d4-e6cf6cee7e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:38:11 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-506ed98d-afd5-4be8-a9f9-62b6c4569c00 tempest-ProjectReaderTests-1222155939 None] Flow 'volume_create_manager' (2ed09d01-9dbb-4613-9c88-0db5531a043a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:38:11 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-506ed98d-afd5-4be8-a9f9-62b6c4569c00 tempest-ProjectReaderTests-1222155939 None] Created volume successfully. Sep 28 17:38:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-923688c6-8621-4ab4-8554-875ddf02c16b tempest-ProjectReaderTests-1222155939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:38:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-923688c6-8621-4ab4-8554-875ddf02c16b tempest-ProjectReaderTests-1222155939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:38:11 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-923688c6-8621-4ab4-8554-875ddf02c16b tempest-ProjectReaderTests-1222155939 None] Creating offline snapshot f8dfb5c6-7e38-48a3-a886-15df8b2ab930 of volume 4802808d-9a1f-48e5-9888-29d438b5aefb {{(pid=86917) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:38:11 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d4753e-6750-4e7c-a45d-b677a437a362]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:38:11 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-923688c6-8621-4ab4-8554-875ddf02c16b tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:11 devstack sudo[109563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb Sep 28 17:38:11 devstack sudo[109563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:12 devstack sudo[109563]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-923688c6-8621-4ab4-8554-875ddf02c16b tempest-ProjectReaderTests-1222155939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb" returned: 0 in 0.355s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-923688c6-8621-4ab4-8554-875ddf02c16b tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb.f8dfb5c6-7e38-48a3-a886-15df8b2ab930 1G {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:12 devstack sudo[109569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb.f8dfb5c6-7e38-48a3-a886-15df8b2ab930 1G Sep 28 17:38:12 devstack sudo[109569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:12 devstack sudo[109569]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-923688c6-8621-4ab4-8554-875ddf02c16b tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb.f8dfb5c6-7e38-48a3-a886-15df8b2ab930 1G" returned: 0 in 0.396s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-923688c6-8621-4ab4-8554-875ddf02c16b tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4802808d-9a1f-48e5-9888-29d438b5aefb -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb.f8dfb5c6-7e38-48a3-a886-15df8b2ab930 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:12 devstack sudo[109574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4802808d-9a1f-48e5-9888-29d438b5aefb -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb.f8dfb5c6-7e38-48a3-a886-15df8b2ab930 Sep 28 17:38:12 devstack sudo[109574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:12 devstack sudo[109574]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-923688c6-8621-4ab4-8554-875ddf02c16b tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4802808d-9a1f-48e5-9888-29d438b5aefb -F qcow2 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb.f8dfb5c6-7e38-48a3-a886-15df8b2ab930" returned: 0 in 0.292s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:12 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-923688c6-8621-4ab4-8554-875ddf02c16b tempest-ProjectReaderTests-1222155939 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb.f8dfb5c6-7e38-48a3-a886-15df8b2ab930 is being set with open permissions: ugo+rw Sep 28 17:38:12 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-923688c6-8621-4ab4-8554-875ddf02c16b tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb.f8dfb5c6-7e38-48a3-a886-15df8b2ab930 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:12 devstack sudo[109580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb.f8dfb5c6-7e38-48a3-a886-15df8b2ab930 Sep 28 17:38:12 devstack sudo[109580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:13 devstack sudo[109580]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-923688c6-8621-4ab4-8554-875ddf02c16b tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb.f8dfb5c6-7e38-48a3-a886-15df8b2ab930" returned: 0 in 0.234s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:13 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:INSERT=37,cinder:UPDATE=142,cinder:SELECT=98,cinder:DELETE=10 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:38:13 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=109,cinder:UPDATE=134,cinder:INSERT=38,cinder:DELETE=13 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:38:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-923688c6-8621-4ab4-8554-875ddf02c16b tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:13 devstack sudo[109583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb.info Sep 28 17:38:13 devstack sudo[109583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:13 devstack sudo[109583]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-923688c6-8621-4ab4-8554-875ddf02c16b tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb.info" returned: 0 in 0.245s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:13 devstack cinder-volume[86917]: WARNING cinder.volume.drivers.remotefs [None req-923688c6-8621-4ab4-8554-875ddf02c16b tempest-ProjectReaderTests-1222155939 None] /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb.info is being set with open permissions: ugo+rw Sep 28 17:38:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-923688c6-8621-4ab4-8554-875ddf02c16b tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb.info {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:13 devstack sudo[109586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb.info Sep 28 17:38:13 devstack sudo[109586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:13 devstack sudo[109586]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-923688c6-8621-4ab4-8554-875ddf02c16b tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb.info" returned: 0 in 0.240s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-923688c6-8621-4ab4-8554-875ddf02c16b tempest-ProjectReaderTests-1222155939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.854s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:38:13 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-923688c6-8621-4ab4-8554-875ddf02c16b tempest-ProjectReaderTests-1222155939 None] Create snapshot completed successfully Sep 28 17:38:13 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fb0ba650-2e81-4c35-8f66-a7b3c9782f0d tempest-ProjectReaderTests-1222155939 None] Acquiring lock "cinder-f8dfb5c6-7e38-48a3-a886-15df8b2ab930-delete_snapshot" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:38:13 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fb0ba650-2e81-4c35-8f66-a7b3c9782f0d tempest-ProjectReaderTests-1222155939 None] Lock "cinder-f8dfb5c6-7e38-48a3-a886-15df8b2ab930-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:38:13 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fb0ba650-2e81-4c35-8f66-a7b3c9782f0d tempest-ProjectReaderTests-1222155939 None] Acquiring lock "cinder-quobyte-4802808d-9a1f-48e5-9888-29d438b5aefb" by "delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:38:13 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fb0ba650-2e81-4c35-8f66-a7b3c9782f0d tempest-ProjectReaderTests-1222155939 None] Lock "cinder-quobyte-4802808d-9a1f-48e5-9888-29d438b5aefb" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:38:13 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fb0ba650-2e81-4c35-8f66-a7b3c9782f0d tempest-ProjectReaderTests-1222155939 None] Acquiring lock "cinder-quobyte-f8dfb5c6-7e38-48a3-a886-15df8b2ab930" by "_delete_snapshot" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:38:13 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fb0ba650-2e81-4c35-8f66-a7b3c9782f0d tempest-ProjectReaderTests-1222155939 None] Lock "cinder-quobyte-f8dfb5c6-7e38-48a3-a886-15df8b2ab930" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:38:13 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-fb0ba650-2e81-4c35-8f66-a7b3c9782f0d tempest-ProjectReaderTests-1222155939 None] Deleting offline snapshot f8dfb5c6-7e38-48a3-a886-15df8b2ab930 of volume 4802808d-9a1f-48e5-9888-29d438b5aefb {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:38:13 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-fb0ba650-2e81-4c35-8f66-a7b3c9782f0d tempest-ProjectReaderTests-1222155939 None] snapshot_file for this snap is: volume-4802808d-9a1f-48e5-9888-29d438b5aefb.f8dfb5c6-7e38-48a3-a886-15df8b2ab930 {{(pid=86917) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:38:13 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a342dfd-6132-42b1-a31d-a96d00d8fed1]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:38:13 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fb0ba650-2e81-4c35-8f66-a7b3c9782f0d tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb.f8dfb5c6-7e38-48a3-a886-15df8b2ab930 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:14 devstack sudo[109589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb.f8dfb5c6-7e38-48a3-a886-15df8b2ab930 Sep 28 17:38:14 devstack sudo[109589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:14 devstack sudo[109589]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fb0ba650-2e81-4c35-8f66-a7b3c9782f0d tempest-ProjectReaderTests-1222155939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb.f8dfb5c6-7e38-48a3-a886-15df8b2ab930" returned: 0 in 0.362s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:14 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-fb0ba650-2e81-4c35-8f66-a7b3c9782f0d tempest-ProjectReaderTests-1222155939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4802808d-9a1f-48e5-9888-29d438b5aefb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86917) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:38:14 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5003867-5620-46ce-b143-3733f9ee6b29]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:38:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fb0ba650-2e81-4c35-8f66-a7b3c9782f0d tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:14 devstack sudo[109594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb Sep 28 17:38:14 devstack sudo[109594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:14 devstack sudo[109594]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fb0ba650-2e81-4c35-8f66-a7b3c9782f0d tempest-ProjectReaderTests-1222155939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb" returned: 0 in 0.368s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:14 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fb0ba650-2e81-4c35-8f66-a7b3c9782f0d tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb.f8dfb5c6-7e38-48a3-a886-15df8b2ab930 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:14 devstack sudo[109599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb.f8dfb5c6-7e38-48a3-a886-15df8b2ab930 Sep 28 17:38:14 devstack sudo[109599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:15 devstack sudo[109599]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fb0ba650-2e81-4c35-8f66-a7b3c9782f0d tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb.f8dfb5c6-7e38-48a3-a886-15df8b2ab930" returned: 0 in 0.328s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fb0ba650-2e81-4c35-8f66-a7b3c9782f0d tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb.f8dfb5c6-7e38-48a3-a886-15df8b2ab930 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:15 devstack sudo[109605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb.f8dfb5c6-7e38-48a3-a886-15df8b2ab930 Sep 28 17:38:15 devstack sudo[109605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:15 devstack sudo[109605]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:15 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-fb0ba650-2e81-4c35-8f66-a7b3c9782f0d tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb.f8dfb5c6-7e38-48a3-a886-15df8b2ab930" returned: 0 in 0.249s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:15 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fb0ba650-2e81-4c35-8f66-a7b3c9782f0d tempest-ProjectReaderTests-1222155939 None] Lock "cinder-quobyte-f8dfb5c6-7e38-48a3-a886-15df8b2ab930" released by "_delete_snapshot" :: held 1.401s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:38:15 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fb0ba650-2e81-4c35-8f66-a7b3c9782f0d tempest-ProjectReaderTests-1222155939 None] Lock "cinder-quobyte-4802808d-9a1f-48e5-9888-29d438b5aefb" released by "delete_snapshot" :: held 1.423s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:38:15 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-fb0ba650-2e81-4c35-8f66-a7b3c9782f0d tempest-ProjectReaderTests-1222155939 None] Created reservations ['e557f914-dbff-40a3-87a5-e48e2fd548c2', '073e6627-df3f-4885-83ea-0c6b1d2af2cf', '97f6c980-6ade-42d7-9c7e-1ed39a240d4b', '49fdaf9a-94e5-4511-8beb-817d359bd8bd'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:38:15 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-fb0ba650-2e81-4c35-8f66-a7b3c9782f0d tempest-ProjectReaderTests-1222155939 None] Delete snapshot completed successfully. Sep 28 17:38:15 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-fb0ba650-2e81-4c35-8f66-a7b3c9782f0d tempest-ProjectReaderTests-1222155939 None] Lock "cinder-f8dfb5c6-7e38-48a3-a886-15df8b2ab930-delete_snapshot" released by "delete_snapshot" :: held 1.567s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:38:15 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c9671067-f87a-4dc9-b16d-bfd78d48ef63 tempest-ProjectReaderTests-1222155939 None] Acquiring lock "cinder-4802808d-9a1f-48e5-9888-29d438b5aefb-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:38:16 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c9671067-f87a-4dc9-b16d-bfd78d48ef63 tempest-ProjectReaderTests-1222155939 None] Lock "cinder-4802808d-9a1f-48e5-9888-29d438b5aefb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:38:16 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c9671067-f87a-4dc9-b16d-bfd78d48ef63 tempest-ProjectReaderTests-1222155939 None] Acquiring lock "cinder-quobyte-4802808d-9a1f-48e5-9888-29d438b5aefb" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:38:16 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c9671067-f87a-4dc9-b16d-bfd78d48ef63 tempest-ProjectReaderTests-1222155939 None] Lock "cinder-quobyte-4802808d-9a1f-48e5-9888-29d438b5aefb" acquired by "delete_volume" :: waited 0.015s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:38:16 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1bf289-39ad-4104-a822-7dce79b2dea8]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:38:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c9671067-f87a-4dc9-b16d-bfd78d48ef63 tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:16 devstack sudo[109608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb Sep 28 17:38:16 devstack sudo[109608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:16 devstack sudo[109608]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c9671067-f87a-4dc9-b16d-bfd78d48ef63 tempest-ProjectReaderTests-1222155939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb" returned: 0 in 0.377s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c9671067-f87a-4dc9-b16d-bfd78d48ef63 tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:16 devstack sudo[109613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb Sep 28 17:38:16 devstack sudo[109613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:16 devstack sudo[109613]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c9671067-f87a-4dc9-b16d-bfd78d48ef63 tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-4802808d-9a1f-48e5-9888-29d438b5aefb" returned: 0 in 0.248s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:16 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c9671067-f87a-4dc9-b16d-bfd78d48ef63 tempest-ProjectReaderTests-1222155939 None] Lock "cinder-quobyte-4802808d-9a1f-48e5-9888-29d438b5aefb" released by "delete_volume" :: held 0.693s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:38:16 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-c9671067-f87a-4dc9-b16d-bfd78d48ef63 tempest-ProjectReaderTests-1222155939 None] Created reservations ['e1d22ecf-501a-4817-9a98-2ecf182612b8', '1076392d-61ad-4830-869f-0f0e327d6950', '9bab1a67-f219-409b-a606-574d2fd61671', '8358ef71-3701-47f4-a382-c33a9c2e4a89'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:38:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c9671067-f87a-4dc9-b16d-bfd78d48ef63 tempest-ProjectReaderTests-1222155939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:38:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c9671067-f87a-4dc9-b16d-bfd78d48ef63 tempest-ProjectReaderTests-1222155939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:38:16 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c9671067-f87a-4dc9-b16d-bfd78d48ef63 tempest-ProjectReaderTests-1222155939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:38:16 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-c9671067-f87a-4dc9-b16d-bfd78d48ef63 tempest-ProjectReaderTests-1222155939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:38:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-c9671067-f87a-4dc9-b16d-bfd78d48ef63 tempest-ProjectReaderTests-1222155939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:38:16 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c9671067-f87a-4dc9-b16d-bfd78d48ef63 tempest-ProjectReaderTests-1222155939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:16 devstack sudo[109616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:38:16 devstack sudo[109616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:17 devstack sudo[109616]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:17 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-c9671067-f87a-4dc9-b16d-bfd78d48ef63 tempest-ProjectReaderTests-1222155939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.267s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:17 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-c9671067-f87a-4dc9-b16d-bfd78d48ef63 tempest-ProjectReaderTests-1222155939 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:38:17 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-c9671067-f87a-4dc9-b16d-bfd78d48ef63 tempest-ProjectReaderTests-1222155939 None] Deleted volume successfully. Sep 28 17:38:17 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-c9671067-f87a-4dc9-b16d-bfd78d48ef63 tempest-ProjectReaderTests-1222155939 None] Lock "cinder-4802808d-9a1f-48e5-9888-29d438b5aefb-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:38:26 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:UPDATE=16,cinder:SELECT=7,cinder:INSERT=4 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:38:27 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=14,cinder:INSERT=5,cinder:DELETE=2,cinder:UPDATE=12 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:38:27 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-87d90e13-2020-453f-a3ab-99f67c5088d5 tempest-ProjectReaderTests-1221840601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:38:27 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-87d90e13-2020-453f-a3ab-99f67c5088d5 tempest-ProjectReaderTests-1221840601 None] Flow 'volume_create_manager' (efc2de85-a071-4e84-83d9-48ca3b5ef983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:38:27 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-87d90e13-2020-453f-a3ab-99f67c5088d5 tempest-ProjectReaderTests-1221840601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b13b2296-56c3-4812-b045-a6ae9ad42d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:38:27 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-87d90e13-2020-453f-a3ab-99f67c5088d5 tempest-ProjectReaderTests-1221840601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b13b2296-56c3-4812-b045-a6ae9ad42d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1973666156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99ef3613-f923-4012-a535-50507e3789fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4e57f4a74cf42d1a3566aea6ee912a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:38:28Z,use_quota=True,user_id='0c29671d87d84fe1a19d7dd2a75f4adb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:38:28 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-87d90e13-2020-453f-a3ab-99f67c5088d5 tempest-ProjectReaderTests-1221840601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f07ddb-c5c1-41b7-8b42-06b2d20d0b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:38:28 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-87d90e13-2020-453f-a3ab-99f67c5088d5 tempest-ProjectReaderTests-1221840601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f07ddb-c5c1-41b7-8b42-06b2d20d0b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:38:28 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-87d90e13-2020-453f-a3ab-99f67c5088d5 tempest-ProjectReaderTests-1221840601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01d3a045-80f7-4a76-b1a4-3894a4c2c3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:38:28 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-87d90e13-2020-453f-a3ab-99f67c5088d5 tempest-ProjectReaderTests-1221840601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01d3a045-80f7-4a76-b1a4-3894a4c2c3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99ef3613-f923-4012-a535-50507e3789fd', 'volume_name': 'volume-99ef3613-f923-4012-a535-50507e3789fd', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:38:28 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-87d90e13-2020-453f-a3ab-99f67c5088d5 tempest-ProjectReaderTests-1221840601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f1499f6-78ab-4be8-8c99-8fedf051e48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:38:28 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-87d90e13-2020-453f-a3ab-99f67c5088d5 tempest-ProjectReaderTests-1221840601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f1499f6-78ab-4be8-8c99-8fedf051e48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:38:28 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-87d90e13-2020-453f-a3ab-99f67c5088d5 tempest-ProjectReaderTests-1221840601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (671a973d-a9d2-4df0-9525-39d09602f87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:38:28 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-87d90e13-2020-453f-a3ab-99f67c5088d5 tempest-ProjectReaderTests-1221840601 None] Volume 99ef3613-f923-4012-a535-50507e3789fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99ef3613-f923-4012-a535-50507e3789fd', 'volume_size': 1} Sep 28 17:38:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-87d90e13-2020-453f-a3ab-99f67c5088d5 tempest-ProjectReaderTests-1221840601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:38:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-87d90e13-2020-453f-a3ab-99f67c5088d5 tempest-ProjectReaderTests-1221840601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:38:28 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-87d90e13-2020-453f-a3ab-99f67c5088d5 tempest-ProjectReaderTests-1221840601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1973666156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99ef3613-f923-4012-a535-50507e3789fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4e57f4a74cf42d1a3566aea6ee912a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:38:28Z,use_quota=True,user_id='0c29671d87d84fe1a19d7dd2a75f4adb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:38:28 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-87d90e13-2020-453f-a3ab-99f67c5088d5 tempest-ProjectReaderTests-1221840601 None] Creating volume 99ef3613-f923-4012-a535-50507e3789fd {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:38:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-87d90e13-2020-453f-a3ab-99f67c5088d5 tempest-ProjectReaderTests-1221840601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:38:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-87d90e13-2020-453f-a3ab-99f67c5088d5 tempest-ProjectReaderTests-1221840601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:38:28 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-87d90e13-2020-453f-a3ab-99f67c5088d5 tempest-ProjectReaderTests-1221840601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:38:28 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-87d90e13-2020-453f-a3ab-99f67c5088d5 tempest-ProjectReaderTests-1221840601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:38:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-87d90e13-2020-453f-a3ab-99f67c5088d5 tempest-ProjectReaderTests-1221840601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:38:28 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-87d90e13-2020-453f-a3ab-99f67c5088d5 tempest-ProjectReaderTests-1221840601 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:38:28 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-87d90e13-2020-453f-a3ab-99f67c5088d5 tempest-ProjectReaderTests-1221840601 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:38:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-87d90e13-2020-453f-a3ab-99f67c5088d5 tempest-ProjectReaderTests-1221840601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-99ef3613-f923-4012-a535-50507e3789fd 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:28 devstack sudo[109627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-99ef3613-f923-4012-a535-50507e3789fd 1073741824 Sep 28 17:38:28 devstack sudo[109627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:28 devstack sudo[109627]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-87d90e13-2020-453f-a3ab-99f67c5088d5 tempest-ProjectReaderTests-1221840601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-99ef3613-f923-4012-a535-50507e3789fd 1073741824" returned: 0 in 0.420s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-87d90e13-2020-453f-a3ab-99f67c5088d5 tempest-ProjectReaderTests-1221840601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-99ef3613-f923-4012-a535-50507e3789fd {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:28 devstack sudo[109632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-99ef3613-f923-4012-a535-50507e3789fd Sep 28 17:38:28 devstack sudo[109632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:28 devstack sudo[109632]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-87d90e13-2020-453f-a3ab-99f67c5088d5 tempest-ProjectReaderTests-1221840601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-99ef3613-f923-4012-a535-50507e3789fd" returned: 0 in 0.247s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:28 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-87d90e13-2020-453f-a3ab-99f67c5088d5 tempest-ProjectReaderTests-1221840601 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:38:28 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-87d90e13-2020-453f-a3ab-99f67c5088d5 tempest-ProjectReaderTests-1221840601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:38:28 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-87d90e13-2020-453f-a3ab-99f67c5088d5 tempest-ProjectReaderTests-1221840601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (671a973d-a9d2-4df0-9525-39d09602f87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99ef3613-f923-4012-a535-50507e3789fd', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:38:28 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-87d90e13-2020-453f-a3ab-99f67c5088d5 tempest-ProjectReaderTests-1221840601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a7933f3-1900-447c-b701-e8844028a5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:38:28 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-87d90e13-2020-453f-a3ab-99f67c5088d5 tempest-ProjectReaderTests-1221840601 None] Volume volume-99ef3613-f923-4012-a535-50507e3789fd (99ef3613-f923-4012-a535-50507e3789fd): created successfully Sep 28 17:38:28 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-87d90e13-2020-453f-a3ab-99f67c5088d5 tempest-ProjectReaderTests-1221840601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a7933f3-1900-447c-b701-e8844028a5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:38:28 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-87d90e13-2020-453f-a3ab-99f67c5088d5 tempest-ProjectReaderTests-1221840601 None] Flow 'volume_create_manager' (efc2de85-a071-4e84-83d9-48ca3b5ef983) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:38:28 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-87d90e13-2020-453f-a3ab-99f67c5088d5 tempest-ProjectReaderTests-1221840601 None] Created volume successfully. Sep 28 17:38:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ed61a5a3-6517-44f5-b267-bee8b483d8c4 tempest-ProjectReaderTests-1221840601 None] Acquiring lock "cinder-99ef3613-f923-4012-a535-50507e3789fd-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:38:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ed61a5a3-6517-44f5-b267-bee8b483d8c4 tempest-ProjectReaderTests-1221840601 None] Lock "cinder-99ef3613-f923-4012-a535-50507e3789fd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:38:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ed61a5a3-6517-44f5-b267-bee8b483d8c4 tempest-ProjectReaderTests-1221840601 None] Acquiring lock "cinder-quobyte-99ef3613-f923-4012-a535-50507e3789fd" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:38:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ed61a5a3-6517-44f5-b267-bee8b483d8c4 tempest-ProjectReaderTests-1221840601 None] Lock "cinder-quobyte-99ef3613-f923-4012-a535-50507e3789fd" acquired by "delete_volume" :: waited 0.015s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:38:29 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56f29d6-fd72-4f3f-a860-5947ab0e4f85]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:38:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ed61a5a3-6517-44f5-b267-bee8b483d8c4 tempest-ProjectReaderTests-1221840601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-99ef3613-f923-4012-a535-50507e3789fd {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:29 devstack sudo[109638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-99ef3613-f923-4012-a535-50507e3789fd Sep 28 17:38:29 devstack sudo[109638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:29 devstack sudo[109638]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ed61a5a3-6517-44f5-b267-bee8b483d8c4 tempest-ProjectReaderTests-1221840601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-99ef3613-f923-4012-a535-50507e3789fd" returned: 0 in 0.378s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ed61a5a3-6517-44f5-b267-bee8b483d8c4 tempest-ProjectReaderTests-1221840601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-99ef3613-f923-4012-a535-50507e3789fd {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:29 devstack sudo[109644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-99ef3613-f923-4012-a535-50507e3789fd Sep 28 17:38:29 devstack sudo[109644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:29 devstack sudo[109644]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:29 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ed61a5a3-6517-44f5-b267-bee8b483d8c4 tempest-ProjectReaderTests-1221840601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-99ef3613-f923-4012-a535-50507e3789fd" returned: 0 in 0.257s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:29 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ed61a5a3-6517-44f5-b267-bee8b483d8c4 tempest-ProjectReaderTests-1221840601 None] Lock "cinder-quobyte-99ef3613-f923-4012-a535-50507e3789fd" released by "delete_volume" :: held 0.679s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:38:29 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-ed61a5a3-6517-44f5-b267-bee8b483d8c4 tempest-ProjectReaderTests-1221840601 None] Created reservations ['b27923f5-007c-4156-851d-3639642fc1a0', 'f9a0aaa0-bd9d-47cb-8ce2-b089c0e666c6', '7a24fe16-45e1-434e-a6a6-05ad4ce42dcf', 'e0f532c7-24aa-4ef2-98ee-a058784938a4'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:38:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ed61a5a3-6517-44f5-b267-bee8b483d8c4 tempest-ProjectReaderTests-1221840601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:38:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ed61a5a3-6517-44f5-b267-bee8b483d8c4 tempest-ProjectReaderTests-1221840601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:38:30 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ed61a5a3-6517-44f5-b267-bee8b483d8c4 tempest-ProjectReaderTests-1221840601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:38:30 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-ed61a5a3-6517-44f5-b267-bee8b483d8c4 tempest-ProjectReaderTests-1221840601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:38:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-ed61a5a3-6517-44f5-b267-bee8b483d8c4 tempest-ProjectReaderTests-1221840601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:38:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ed61a5a3-6517-44f5-b267-bee8b483d8c4 tempest-ProjectReaderTests-1221840601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:30 devstack sudo[109647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:38:30 devstack sudo[109647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:30 devstack sudo[109647]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:30 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-ed61a5a3-6517-44f5-b267-bee8b483d8c4 tempest-ProjectReaderTests-1221840601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.238s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:30 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-ed61a5a3-6517-44f5-b267-bee8b483d8c4 tempest-ProjectReaderTests-1221840601 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:38:30 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-ed61a5a3-6517-44f5-b267-bee8b483d8c4 tempest-ProjectReaderTests-1221840601 None] Deleted volume successfully. Sep 28 17:38:30 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-ed61a5a3-6517-44f5-b267-bee8b483d8c4 tempest-ProjectReaderTests-1221840601 None] Lock "cinder-99ef3613-f923-4012-a535-50507e3789fd-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:38:30 devstack cinder-volume[86917]: DEBUG cinder.volume.flows.manager.create_volume [None req-56d913bb-58a1-4eac-b41b-96f134051383 tempest-ProjectReaderTests-1221840601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86917) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:38:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-56d913bb-58a1-4eac-b41b-96f134051383 tempest-ProjectReaderTests-1221840601 None] Flow 'volume_create_manager' (93323264-249d-457a-acc9-d1e783ba34f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:38:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-56d913bb-58a1-4eac-b41b-96f134051383 tempest-ProjectReaderTests-1221840601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61acee6f-3729-471c-96e0-a26f9f70e44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:38:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-56d913bb-58a1-4eac-b41b-96f134051383 tempest-ProjectReaderTests-1221840601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61acee6f-3729-471c-96e0-a26f9f70e44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2131645859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f3f3e01-c3c4-447f-9cb0-0e134da80696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4e57f4a74cf42d1a3566aea6ee912a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:38:31Z,use_quota=True,user_id='0c29671d87d84fe1a19d7dd2a75f4adb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:38:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-56d913bb-58a1-4eac-b41b-96f134051383 tempest-ProjectReaderTests-1221840601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5b79b06-2de1-4286-8426-0c2e5a7c3cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:38:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-56d913bb-58a1-4eac-b41b-96f134051383 tempest-ProjectReaderTests-1221840601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5b79b06-2de1-4286-8426-0c2e5a7c3cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:38:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-56d913bb-58a1-4eac-b41b-96f134051383 tempest-ProjectReaderTests-1221840601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3843240-fb57-4d52-a7ae-7ddfa0405dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:38:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-56d913bb-58a1-4eac-b41b-96f134051383 tempest-ProjectReaderTests-1221840601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3843240-fb57-4d52-a7ae-7ddfa0405dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f3f3e01-c3c4-447f-9cb0-0e134da80696', 'volume_name': 'volume-3f3f3e01-c3c4-447f-9cb0-0e134da80696', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:38:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-56d913bb-58a1-4eac-b41b-96f134051383 tempest-ProjectReaderTests-1221840601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e8d2362-755f-4d8f-a476-fbef5fe97123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:38:30 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-56d913bb-58a1-4eac-b41b-96f134051383 tempest-ProjectReaderTests-1221840601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e8d2362-755f-4d8f-a476-fbef5fe97123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:38:31 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-56d913bb-58a1-4eac-b41b-96f134051383 tempest-ProjectReaderTests-1221840601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94a9f348-9f73-4a9b-a648-83b11087a41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:38:31 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-56d913bb-58a1-4eac-b41b-96f134051383 tempest-ProjectReaderTests-1221840601 None] Volume 3f3f3e01-c3c4-447f-9cb0-0e134da80696: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f3f3e01-c3c4-447f-9cb0-0e134da80696', 'volume_size': 1} Sep 28 17:38:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-56d913bb-58a1-4eac-b41b-96f134051383 tempest-ProjectReaderTests-1221840601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:38:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-56d913bb-58a1-4eac-b41b-96f134051383 tempest-ProjectReaderTests-1221840601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:38:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-56d913bb-58a1-4eac-b41b-96f134051383 tempest-ProjectReaderTests-1221840601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2131645859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f3f3e01-c3c4-447f-9cb0-0e134da80696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4e57f4a74cf42d1a3566aea6ee912a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:38:31Z,use_quota=True,user_id='0c29671d87d84fe1a19d7dd2a75f4adb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c0802c-74e2-4783-85f7-decf12b790f6),volume_type_id=75c0802c-74e2-4783-85f7-decf12b790f6)}" {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:38:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.remotefs [None req-56d913bb-58a1-4eac-b41b-96f134051383 tempest-ProjectReaderTests-1221840601 None] Creating volume 3f3f3e01-c3c4-447f-9cb0-0e134da80696 {{(pid=86917) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:38:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-56d913bb-58a1-4eac-b41b-96f134051383 tempest-ProjectReaderTests-1221840601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:38:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-56d913bb-58a1-4eac-b41b-96f134051383 tempest-ProjectReaderTests-1221840601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:38:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-56d913bb-58a1-4eac-b41b-96f134051383 tempest-ProjectReaderTests-1221840601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:38:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-56d913bb-58a1-4eac-b41b-96f134051383 tempest-ProjectReaderTests-1221840601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:38:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-56d913bb-58a1-4eac-b41b-96f134051383 tempest-ProjectReaderTests-1221840601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:38:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-56d913bb-58a1-4eac-b41b-96f134051383 tempest-ProjectReaderTests-1221840601 None] Selected osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 as target Quobyte volume. {{(pid=86917) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:38:31 devstack cinder-volume[86917]: INFO cinder.volume.drivers.remotefs [None req-56d913bb-58a1-4eac-b41b-96f134051383 tempest-ProjectReaderTests-1221840601 None] casted to osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069 Sep 28 17:38:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-56d913bb-58a1-4eac-b41b-96f134051383 tempest-ProjectReaderTests-1221840601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f3f3e01-c3c4-447f-9cb0-0e134da80696 1073741824 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:31 devstack sudo[109650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f3f3e01-c3c4-447f-9cb0-0e134da80696 1073741824 Sep 28 17:38:31 devstack sudo[109650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:31 devstack sudo[109650]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-56d913bb-58a1-4eac-b41b-96f134051383 tempest-ProjectReaderTests-1221840601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f3f3e01-c3c4-447f-9cb0-0e134da80696 1073741824" returned: 0 in 0.464s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-56d913bb-58a1-4eac-b41b-96f134051383 tempest-ProjectReaderTests-1221840601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f3f3e01-c3c4-447f-9cb0-0e134da80696 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:31 devstack sudo[109656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f3f3e01-c3c4-447f-9cb0-0e134da80696 Sep 28 17:38:31 devstack sudo[109656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:31 devstack sudo[109656]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-56d913bb-58a1-4eac-b41b-96f134051383 tempest-ProjectReaderTests-1221840601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f3f3e01-c3c4-447f-9cb0-0e134da80696" returned: 0 in 0.270s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:31 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-56d913bb-58a1-4eac-b41b-96f134051383 tempest-ProjectReaderTests-1221840601 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'} {{(pid=86917) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:38:31 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-56d913bb-58a1-4eac-b41b-96f134051383 tempest-ProjectReaderTests-1221840601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:38:31 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-56d913bb-58a1-4eac-b41b-96f134051383 tempest-ProjectReaderTests-1221840601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94a9f348-9f73-4a9b-a648-83b11087a41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f3f3e01-c3c4-447f-9cb0-0e134da80696', 'volume_size': 1}' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:38:31 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-56d913bb-58a1-4eac-b41b-96f134051383 tempest-ProjectReaderTests-1221840601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc2e781b-1fa5-4b56-9625-94660da221a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:38:31 devstack cinder-volume[86917]: INFO cinder.volume.flows.manager.create_volume [None req-56d913bb-58a1-4eac-b41b-96f134051383 tempest-ProjectReaderTests-1221840601 None] Volume volume-3f3f3e01-c3c4-447f-9cb0-0e134da80696 (3f3f3e01-c3c4-447f-9cb0-0e134da80696): created successfully Sep 28 17:38:31 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-56d913bb-58a1-4eac-b41b-96f134051383 tempest-ProjectReaderTests-1221840601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc2e781b-1fa5-4b56-9625-94660da221a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86917) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:38:31 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-56d913bb-58a1-4eac-b41b-96f134051383 tempest-ProjectReaderTests-1221840601 None] Flow 'volume_create_manager' (93323264-249d-457a-acc9-d1e783ba34f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86917) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:38:31 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-56d913bb-58a1-4eac-b41b-96f134051383 tempest-ProjectReaderTests-1221840601 None] Created volume successfully. Sep 28 17:38:32 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-480fc46b-9c5b-434e-aaaa-98f7118ae3ce tempest-ProjectReaderTests-1221840601 None] Acquiring lock "cinder-3f3f3e01-c3c4-447f-9cb0-0e134da80696-delete_volume" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:38:33 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-480fc46b-9c5b-434e-aaaa-98f7118ae3ce tempest-ProjectReaderTests-1221840601 None] Lock "cinder-3f3f3e01-c3c4-447f-9cb0-0e134da80696-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:38:33 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-480fc46b-9c5b-434e-aaaa-98f7118ae3ce tempest-ProjectReaderTests-1221840601 None] Acquiring lock "cinder-quobyte-3f3f3e01-c3c4-447f-9cb0-0e134da80696" by "delete_volume" {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:38:33 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-480fc46b-9c5b-434e-aaaa-98f7118ae3ce tempest-ProjectReaderTests-1221840601 None] Lock "cinder-quobyte-3f3f3e01-c3c4-447f-9cb0-0e134da80696" acquired by "delete_volume" :: waited 0.015s {{(pid=86917) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:38:33 devstack cinder-volume[86917]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9df7df-9a32-4898-a818-3d10c36e2357]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:38:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-480fc46b-9c5b-434e-aaaa-98f7118ae3ce tempest-ProjectReaderTests-1221840601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f3f3e01-c3c4-447f-9cb0-0e134da80696 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:33 devstack sudo[109659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f3f3e01-c3c4-447f-9cb0-0e134da80696 Sep 28 17:38:33 devstack sudo[109659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:33 devstack sudo[109659]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-480fc46b-9c5b-434e-aaaa-98f7118ae3ce tempest-ProjectReaderTests-1221840601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f3f3e01-c3c4-447f-9cb0-0e134da80696" returned: 0 in 0.355s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-480fc46b-9c5b-434e-aaaa-98f7118ae3ce tempest-ProjectReaderTests-1221840601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f3f3e01-c3c4-447f-9cb0-0e134da80696 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:33 devstack sudo[109698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f3f3e01-c3c4-447f-9cb0-0e134da80696 Sep 28 17:38:33 devstack sudo[109698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:33 devstack sudo[109698]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-480fc46b-9c5b-434e-aaaa-98f7118ae3ce tempest-ProjectReaderTests-1221840601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35/volume-3f3f3e01-c3c4-447f-9cb0-0e134da80696" returned: 0 in 0.256s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:33 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-480fc46b-9c5b-434e-aaaa-98f7118ae3ce tempest-ProjectReaderTests-1221840601 None] Lock "cinder-quobyte-3f3f3e01-c3c4-447f-9cb0-0e134da80696" released by "delete_volume" :: held 0.655s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:38:33 devstack cinder-volume[86917]: DEBUG cinder.quota [None req-480fc46b-9c5b-434e-aaaa-98f7118ae3ce tempest-ProjectReaderTests-1221840601 None] Created reservations ['c5405ac4-85b3-4ae1-88a0-c2a63a817aa0', 'e2d58c6d-75d7-4c9e-8f67-b35dfc5941dc', 'dbb5d4d9-9c37-4367-ab3c-07157bdf7e60', '983da790-8c09-4ca6-8338-3694bfa2432c'] {{(pid=86917) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:38:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-480fc46b-9c5b-434e-aaaa-98f7118ae3ce tempest-ProjectReaderTests-1221840601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:38:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-480fc46b-9c5b-434e-aaaa-98f7118ae3ce tempest-ProjectReaderTests-1221840601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:38:33 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-480fc46b-9c5b-434e-aaaa-98f7118ae3ce tempest-ProjectReaderTests-1221840601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:38:33 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-480fc46b-9c5b-434e-aaaa-98f7118ae3ce tempest-ProjectReaderTests-1221840601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:38:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-480fc46b-9c5b-434e-aaaa-98f7118ae3ce tempest-ProjectReaderTests-1221840601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:38:33 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-480fc46b-9c5b-434e-aaaa-98f7118ae3ce tempest-ProjectReaderTests-1221840601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:33 devstack sudo[109703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:38:33 devstack sudo[109703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:34 devstack sudo[109703]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:34 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-480fc46b-9c5b-434e-aaaa-98f7118ae3ce tempest-ProjectReaderTests-1221840601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.287s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:34 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-480fc46b-9c5b-434e-aaaa-98f7118ae3ce tempest-ProjectReaderTests-1221840601 None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:38:34 devstack cinder-volume[86917]: INFO cinder.volume.manager [None req-480fc46b-9c5b-434e-aaaa-98f7118ae3ce tempest-ProjectReaderTests-1221840601 None] Deleted volume successfully. Sep 28 17:38:34 devstack cinder-volume[86917]: DEBUG cinder.coordination [None req-480fc46b-9c5b-434e-aaaa-98f7118ae3ce tempest-ProjectReaderTests-1221840601 None] Lock "cinder-3f3f3e01-c3c4-447f-9cb0-0e134da80696-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=86917) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:38:43 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=11,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:38:44 devstack cinder-volume[86917]: DEBUG dbcounter [-] [86917] Writing DB stats cinder:SELECT=17,cinder:UPDATE=20,cinder:INSERT=4,cinder:DELETE=3 {{(pid=86917) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:38:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:38:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:38:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:38:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069': None} {{(pid=86917) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:38:49 devstack cinder-volume[86917]: DEBUG cinder.volume.drivers.quobyte [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7059c975-349c-45f8-8bde-806a48c27069'] {{(pid=86917) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:38:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.lockutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86917) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:38:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:38:49 devstack sudo[109821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35 Sep 28 17:38:49 devstack sudo[109821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:38:49 devstack sudo[109821]: pam_unix(sudo:session): session closed for user root Sep 28 17:38:49 devstack cinder-volume[86917]: DEBUG oslo_concurrency.processutils [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a281bd303b280d656a935e36a2ca1c35" returned: 0 in 0.286s {{(pid=86917) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:38:49 devstack cinder-volume[86917]: DEBUG cinder.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Notifying Schedulers of capabilities ... {{(pid=86917) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:38:49 devstack cinder-volume[86917]: DEBUG oslo_service.periodic_task [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] Running periodic task VolumeManager._thread_info {{(pid=86917) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:38:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread count: 28 {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:38:49 devstack cinder-volume[86917]: DEBUG cinder.volume.manager [None req-880ec8a3-a4dd-4bc3-9be3-31c5b1507fc1 None None] thread info: [<_MainThread(MainThread, started 132915553284224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86917) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}